[ 526.923195] env[65280]: /opt/stack/neutron/neutron/__init__.py:25: UserWarning: The selected oslo_service backend is "eventlet" [ 526.923195] env[65280]: warnings.warn('The selected oslo_service backend is "eventlet"') [ 527.931685] env[65370]: /opt/stack/neutron/neutron/__init__.py:25: UserWarning: The selected oslo_service backend is "eventlet" [ 527.931685] env[65370]: warnings.warn('The selected oslo_service backend is "eventlet"') [ 529.752454] env[65370]: INFO neutron.common.config [-] Logging enabled! [ 529.752813] env[65370]: INFO neutron.common.config [-] /opt/stack/data/venv/bin/neutron-nsxv3-agent version 27.0.1.dev90 [ 529.752973] env[65370]: DEBUG neutron.common.config [-] command line: /opt/stack/data/venv/bin/neutron-nsxv3-agent --config-file /etc/neutron/neutron.conf --config-file /etc/neutron/plugins/ml2/ml2_conf.ini --config-file /etc/neutron/plugins/ml2/ml2-nsxv3-1.ini {{(pid=65370) setup_logging /opt/stack/neutron/neutron/common/config.py:124}} [ 529.753285] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.agent [-] VMware NSXv3 Agent initializing ... [ 529.753380] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.agent [-] Eventlet blocking behavior detection initialization completed. [ 529.754209] env[65370]: WARNING oslo_policy.policy [None req-7b101f6e-9227-4428-a0f2-ad6ee2bde4d7 None None] JSON formatted policy_file support is deprecated since Victoria release. You need to use YAML format which will be default in future. You can use ``oslopolicy-convert-json-to-yaml`` tool to convert existing JSON-formatted policy file to YAML-formatted in backward compatible way: https://docs.openstack.org/oslo.policy/latest/cli/oslopolicy-convert-json-to-yaml.html. [ 529.754450] env[65370]: WARNING oslo_policy.policy [None req-7b101f6e-9227-4428-a0f2-ad6ee2bde4d7 None None] JSON formatted policy_file support is deprecated since Victoria release. You need to use YAML format which will be default in future. You can use ``oslopolicy-convert-json-to-yaml`` tool to convert existing JSON-formatted policy file to YAML-formatted in backward compatible way: https://docs.openstack.org/oslo.policy/latest/cli/oslopolicy-convert-json-to-yaml.html. [ 529.756113] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.agent [None req-7b101f6e-9227-4428-a0f2-ad6ee2bde4d7 None None] VMware NSXv3 Agent initialized successfully. [ 529.756462] env[65370]: DEBUG oslo_concurrency.lockutils [None req-7b101f6e-9227-4428-a0f2-ad6ee2bde4d7 None None] Acquiring lock "singleton_lock" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 529.756591] env[65370]: DEBUG oslo_concurrency.lockutils [None req-7b101f6e-9227-4428-a0f2-ad6ee2bde4d7 None None] Acquired lock "singleton_lock" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 529.756787] env[65370]: DEBUG oslo_concurrency.lockutils [None req-7b101f6e-9227-4428-a0f2-ad6ee2bde4d7 None None] Releasing lock "singleton_lock" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 529.757082] env[65370]: DEBUG oslo_service.backend._eventlet.service [None req-7b101f6e-9227-4428-a0f2-ad6ee2bde4d7 None None] Full set of CONF: {{(pid=65370) _wait_for_exit_or_signal /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:275}} [ 529.757193] env[65370]: DEBUG oslo_service.backend._eventlet.service [None req-7b101f6e-9227-4428-a0f2-ad6ee2bde4d7 None None] ******************************************************************************** {{(pid=65370) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2804}} [ 529.757292] env[65370]: DEBUG oslo_service.backend._eventlet.service [None req-7b101f6e-9227-4428-a0f2-ad6ee2bde4d7 None None] Configuration options gathered from: {{(pid=65370) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2805}} [ 529.757864] env[65370]: DEBUG oslo_service.backend._eventlet.service [None req-7b101f6e-9227-4428-a0f2-ad6ee2bde4d7 None None] command line args: ['--config-file', '/etc/neutron/neutron.conf', '--config-file', '/etc/neutron/plugins/ml2/ml2_conf.ini', '--config-file', '/etc/neutron/plugins/ml2/ml2-nsxv3-1.ini'] {{(pid=65370) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2806}} [ 529.758044] env[65370]: DEBUG oslo_service.backend._eventlet.service [None req-7b101f6e-9227-4428-a0f2-ad6ee2bde4d7 None None] config files: ['/etc/neutron/neutron.conf', '/etc/neutron/plugins/ml2/ml2_conf.ini', '/etc/neutron/plugins/ml2/ml2-nsxv3-1.ini'] {{(pid=65370) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2807}} [ 529.758153] env[65370]: DEBUG oslo_service.backend._eventlet.service [None req-7b101f6e-9227-4428-a0f2-ad6ee2bde4d7 None None] ================================================================================ {{(pid=65370) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2809}} [ 529.758317] env[65370]: DEBUG oslo_service.backend._eventlet.service [None req-7b101f6e-9227-4428-a0f2-ad6ee2bde4d7 None None] agent_down_time = 75 {{(pid=65370) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 529.758453] env[65370]: DEBUG oslo_service.backend._eventlet.service [None req-7b101f6e-9227-4428-a0f2-ad6ee2bde4d7 None None] allow_automatic_dhcp_failover = True {{(pid=65370) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 529.758584] env[65370]: DEBUG oslo_service.backend._eventlet.service [None req-7b101f6e-9227-4428-a0f2-ad6ee2bde4d7 None None] allow_bulk = True {{(pid=65370) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 529.758720] env[65370]: DEBUG oslo_service.backend._eventlet.service [None req-7b101f6e-9227-4428-a0f2-ad6ee2bde4d7 None None] api_extensions_path = {{(pid=65370) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 529.758851] env[65370]: DEBUG oslo_service.backend._eventlet.service [None req-7b101f6e-9227-4428-a0f2-ad6ee2bde4d7 None None] api_paste_config = api-paste.ini {{(pid=65370) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 529.758984] env[65370]: DEBUG oslo_service.backend._eventlet.service [None req-7b101f6e-9227-4428-a0f2-ad6ee2bde4d7 None None] auth_strategy = keystone {{(pid=65370) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 529.759099] env[65370]: DEBUG oslo_service.backend._eventlet.service [None req-7b101f6e-9227-4428-a0f2-ad6ee2bde4d7 None None] backdoor_port = None {{(pid=65370) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 529.759196] env[65370]: DEBUG oslo_service.backend._eventlet.service [None req-7b101f6e-9227-4428-a0f2-ad6ee2bde4d7 None None] backdoor_socket = None {{(pid=65370) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 529.759325] env[65370]: DEBUG oslo_service.backend._eventlet.service [None req-7b101f6e-9227-4428-a0f2-ad6ee2bde4d7 None None] backlog = 4096 {{(pid=65370) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 529.759455] env[65370]: DEBUG oslo_service.backend._eventlet.service [None req-7b101f6e-9227-4428-a0f2-ad6ee2bde4d7 None None] base_mac = fa:16:3e:00:00:00 {{(pid=65370) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 529.759611] env[65370]: DEBUG oslo_service.backend._eventlet.service [None req-7b101f6e-9227-4428-a0f2-ad6ee2bde4d7 None None] bind_host = 0.0.0.0 {{(pid=65370) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 529.759740] env[65370]: DEBUG oslo_service.backend._eventlet.service [None req-7b101f6e-9227-4428-a0f2-ad6ee2bde4d7 None None] bind_port = 9696 {{(pid=65370) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 529.759870] env[65370]: DEBUG oslo_service.backend._eventlet.service [None req-7b101f6e-9227-4428-a0f2-ad6ee2bde4d7 None None] client_socket_timeout = 900 {{(pid=65370) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 529.760007] env[65370]: DEBUG oslo_service.backend._eventlet.service [None req-7b101f6e-9227-4428-a0f2-ad6ee2bde4d7 None None] config_dir = [] {{(pid=65370) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 529.760116] env[65370]: DEBUG oslo_service.backend._eventlet.service [None req-7b101f6e-9227-4428-a0f2-ad6ee2bde4d7 None None] config_file = ['/etc/neutron/neutron.conf', '/etc/neutron/plugins/ml2/ml2_conf.ini', '/etc/neutron/plugins/ml2/ml2-nsxv3-1.ini'] {{(pid=65370) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 529.760248] env[65370]: DEBUG oslo_service.backend._eventlet.service [None req-7b101f6e-9227-4428-a0f2-ad6ee2bde4d7 None None] config_source = [] {{(pid=65370) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 529.760378] env[65370]: DEBUG oslo_service.backend._eventlet.service [None req-7b101f6e-9227-4428-a0f2-ad6ee2bde4d7 None None] control_exchange = neutron {{(pid=65370) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 529.760510] env[65370]: DEBUG oslo_service.backend._eventlet.service [None req-7b101f6e-9227-4428-a0f2-ad6ee2bde4d7 None None] core_plugin = ml2 {{(pid=65370) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 529.760640] env[65370]: DEBUG oslo_service.backend._eventlet.service [None req-7b101f6e-9227-4428-a0f2-ad6ee2bde4d7 None None] debug = True {{(pid=65370) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 529.760800] env[65370]: DEBUG oslo_service.backend._eventlet.service [None req-7b101f6e-9227-4428-a0f2-ad6ee2bde4d7 None None] default_availability_zones = [] {{(pid=65370) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 529.760967] env[65370]: DEBUG oslo_service.backend._eventlet.service [None req-7b101f6e-9227-4428-a0f2-ad6ee2bde4d7 None None] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'OFPHandler=INFO', 'OfctlService=INFO', 'os_ken.base.app_manager=INFO', 'os_ken.controller.controller=INFO'] {{(pid=65370) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 529.761115] env[65370]: DEBUG oslo_service.backend._eventlet.service [None req-7b101f6e-9227-4428-a0f2-ad6ee2bde4d7 None None] dhcp_agent_notification = True {{(pid=65370) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 529.761248] env[65370]: DEBUG oslo_service.backend._eventlet.service [None req-7b101f6e-9227-4428-a0f2-ad6ee2bde4d7 None None] dhcp_agents_per_network = 1 {{(pid=65370) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 529.761373] env[65370]: DEBUG oslo_service.backend._eventlet.service [None req-7b101f6e-9227-4428-a0f2-ad6ee2bde4d7 None None] dhcp_lease_duration = 86400 {{(pid=65370) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 529.761507] env[65370]: DEBUG oslo_service.backend._eventlet.service [None req-7b101f6e-9227-4428-a0f2-ad6ee2bde4d7 None None] dhcp_load_type = networks {{(pid=65370) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 529.761638] env[65370]: DEBUG oslo_service.backend._eventlet.service [None req-7b101f6e-9227-4428-a0f2-ad6ee2bde4d7 None None] dns_domain = openstacklocal {{(pid=65370) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 529.761766] env[65370]: DEBUG oslo_service.backend._eventlet.service [None req-7b101f6e-9227-4428-a0f2-ad6ee2bde4d7 None None] dvr_base_mac = fa:16:3f:00:00:00 {{(pid=65370) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 529.761889] env[65370]: DEBUG oslo_service.backend._eventlet.service [None req-7b101f6e-9227-4428-a0f2-ad6ee2bde4d7 None None] enable_default_route_bfd = False {{(pid=65370) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 529.762018] env[65370]: DEBUG oslo_service.backend._eventlet.service [None req-7b101f6e-9227-4428-a0f2-ad6ee2bde4d7 None None] enable_default_route_ecmp = False {{(pid=65370) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 529.762142] env[65370]: DEBUG oslo_service.backend._eventlet.service [None req-7b101f6e-9227-4428-a0f2-ad6ee2bde4d7 None None] enable_dvr = True {{(pid=65370) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 529.762262] env[65370]: DEBUG oslo_service.backend._eventlet.service [None req-7b101f6e-9227-4428-a0f2-ad6ee2bde4d7 None None] enable_new_agents = True {{(pid=65370) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 529.762387] env[65370]: DEBUG oslo_service.backend._eventlet.service [None req-7b101f6e-9227-4428-a0f2-ad6ee2bde4d7 None None] enable_services_on_agents_with_admin_state_down = False {{(pid=65370) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 529.762509] env[65370]: DEBUG oslo_service.backend._eventlet.service [None req-7b101f6e-9227-4428-a0f2-ad6ee2bde4d7 None None] enable_signals = True {{(pid=65370) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 529.762633] env[65370]: DEBUG oslo_service.backend._eventlet.service [None req-7b101f6e-9227-4428-a0f2-ad6ee2bde4d7 None None] enable_traditional_dhcp = True {{(pid=65370) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 529.762752] env[65370]: DEBUG oslo_service.backend._eventlet.service [None req-7b101f6e-9227-4428-a0f2-ad6ee2bde4d7 None None] external_dns_driver = None {{(pid=65370) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 529.762872] env[65370]: DEBUG oslo_service.backend._eventlet.service [None req-7b101f6e-9227-4428-a0f2-ad6ee2bde4d7 None None] filter_validation = True {{(pid=65370) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 529.763010] env[65370]: DEBUG oslo_service.backend._eventlet.service [None req-7b101f6e-9227-4428-a0f2-ad6ee2bde4d7 None None] global_physnet_mtu = 8950 {{(pid=65370) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 529.763141] env[65370]: DEBUG oslo_service.backend._eventlet.service [None req-7b101f6e-9227-4428-a0f2-ad6ee2bde4d7 None None] graceful_shutdown_timeout = 60 {{(pid=65370) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 529.763313] env[65370]: DEBUG oslo_service.backend._eventlet.service [None req-7b101f6e-9227-4428-a0f2-ad6ee2bde4d7 None None] host = cpu-1 {{(pid=65370) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 529.763445] env[65370]: DEBUG oslo_service.backend._eventlet.service [None req-7b101f6e-9227-4428-a0f2-ad6ee2bde4d7 None None] host_dvr_for_dhcp = True {{(pid=65370) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 529.763574] env[65370]: DEBUG oslo_service.backend._eventlet.service [None req-7b101f6e-9227-4428-a0f2-ad6ee2bde4d7 None None] http_retries = 3 {{(pid=65370) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 529.763749] env[65370]: DEBUG oslo_service.backend._eventlet.service [None req-7b101f6e-9227-4428-a0f2-ad6ee2bde4d7 None None] instance_format = [instance: %(uuid)s] {{(pid=65370) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 529.763834] env[65370]: DEBUG oslo_service.backend._eventlet.service [None req-7b101f6e-9227-4428-a0f2-ad6ee2bde4d7 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=65370) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 529.763963] env[65370]: DEBUG oslo_service.backend._eventlet.service [None req-7b101f6e-9227-4428-a0f2-ad6ee2bde4d7 None None] ipam_driver = internal {{(pid=65370) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 529.764099] env[65370]: DEBUG oslo_service.backend._eventlet.service [None req-7b101f6e-9227-4428-a0f2-ad6ee2bde4d7 None None] ipv6_pd_enabled = False {{(pid=65370) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 529.764224] env[65370]: DEBUG oslo_service.backend._eventlet.service [None req-7b101f6e-9227-4428-a0f2-ad6ee2bde4d7 None None] l3_ha = False {{(pid=65370) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 529.764353] env[65370]: DEBUG oslo_service.backend._eventlet.service [None req-7b101f6e-9227-4428-a0f2-ad6ee2bde4d7 None None] l3_ha_net_cidr = 169.254.192.0/18 {{(pid=65370) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 529.764515] env[65370]: DEBUG oslo_service.backend._eventlet.service [None req-7b101f6e-9227-4428-a0f2-ad6ee2bde4d7 None None] l3_ha_network_physical_name = {{(pid=65370) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 529.764650] env[65370]: DEBUG oslo_service.backend._eventlet.service [None req-7b101f6e-9227-4428-a0f2-ad6ee2bde4d7 None None] l3_ha_network_type = {{(pid=65370) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 529.764784] env[65370]: DEBUG oslo_service.backend._eventlet.service [None req-7b101f6e-9227-4428-a0f2-ad6ee2bde4d7 None None] log_color = False {{(pid=65370) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 529.764912] env[65370]: DEBUG oslo_service.backend._eventlet.service [None req-7b101f6e-9227-4428-a0f2-ad6ee2bde4d7 None None] log_config_append = None {{(pid=65370) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 529.765051] env[65370]: DEBUG oslo_service.backend._eventlet.service [None req-7b101f6e-9227-4428-a0f2-ad6ee2bde4d7 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=65370) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 529.765180] env[65370]: DEBUG oslo_service.backend._eventlet.service [None req-7b101f6e-9227-4428-a0f2-ad6ee2bde4d7 None None] log_dir = None {{(pid=65370) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 529.765301] env[65370]: DEBUG oslo_service.backend._eventlet.service [None req-7b101f6e-9227-4428-a0f2-ad6ee2bde4d7 None None] log_file = None {{(pid=65370) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 529.765404] env[65370]: DEBUG oslo_service.backend._eventlet.service [None req-7b101f6e-9227-4428-a0f2-ad6ee2bde4d7 None None] log_options = True {{(pid=65370) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 529.765595] env[65370]: DEBUG oslo_service.backend._eventlet.service [None req-7b101f6e-9227-4428-a0f2-ad6ee2bde4d7 None None] log_rotate_interval = 1 {{(pid=65370) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 529.765779] env[65370]: DEBUG oslo_service.backend._eventlet.service [None req-7b101f6e-9227-4428-a0f2-ad6ee2bde4d7 None None] log_rotate_interval_type = days {{(pid=65370) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 529.765920] env[65370]: DEBUG oslo_service.backend._eventlet.service [None req-7b101f6e-9227-4428-a0f2-ad6ee2bde4d7 None None] log_rotation_type = none {{(pid=65370) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 529.766028] env[65370]: DEBUG oslo_service.backend._eventlet.service [None req-7b101f6e-9227-4428-a0f2-ad6ee2bde4d7 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=65370) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 529.766131] env[65370]: DEBUG oslo_service.backend._eventlet.service [None req-7b101f6e-9227-4428-a0f2-ad6ee2bde4d7 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=65370) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 529.766265] env[65370]: DEBUG oslo_service.backend._eventlet.service [None req-7b101f6e-9227-4428-a0f2-ad6ee2bde4d7 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=65370) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 529.766394] env[65370]: DEBUG oslo_service.backend._eventlet.service [None req-7b101f6e-9227-4428-a0f2-ad6ee2bde4d7 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=65370) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 529.766492] env[65370]: DEBUG oslo_service.backend._eventlet.service [None req-7b101f6e-9227-4428-a0f2-ad6ee2bde4d7 None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=65370) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 529.766623] env[65370]: DEBUG oslo_service.backend._eventlet.service [None req-7b101f6e-9227-4428-a0f2-ad6ee2bde4d7 None None] max_dns_nameservers = 5 {{(pid=65370) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 529.766750] env[65370]: DEBUG oslo_service.backend._eventlet.service [None req-7b101f6e-9227-4428-a0f2-ad6ee2bde4d7 None None] max_header_line = 16384 {{(pid=65370) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 529.766872] env[65370]: DEBUG oslo_service.backend._eventlet.service [None req-7b101f6e-9227-4428-a0f2-ad6ee2bde4d7 None None] max_l3_agents_per_router = 3 {{(pid=65370) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 529.766994] env[65370]: DEBUG oslo_service.backend._eventlet.service [None req-7b101f6e-9227-4428-a0f2-ad6ee2bde4d7 None None] max_logfile_count = 30 {{(pid=65370) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 529.767135] env[65370]: DEBUG oslo_service.backend._eventlet.service [None req-7b101f6e-9227-4428-a0f2-ad6ee2bde4d7 None None] max_logfile_size_mb = 200 {{(pid=65370) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 529.767258] env[65370]: DEBUG oslo_service.backend._eventlet.service [None req-7b101f6e-9227-4428-a0f2-ad6ee2bde4d7 None None] max_subnet_host_routes = 20 {{(pid=65370) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 529.767387] env[65370]: DEBUG oslo_service.backend._eventlet.service [None req-7b101f6e-9227-4428-a0f2-ad6ee2bde4d7 None None] my_ip = 10.180.1.21 {{(pid=65370) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 529.767548] env[65370]: DEBUG oslo_service.backend._eventlet.service [None req-7b101f6e-9227-4428-a0f2-ad6ee2bde4d7 None None] my_ipv6 = ::1 {{(pid=65370) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 529.767691] env[65370]: DEBUG oslo_service.backend._eventlet.service [None req-7b101f6e-9227-4428-a0f2-ad6ee2bde4d7 None None] network_auto_schedule = True {{(pid=65370) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 529.767815] env[65370]: DEBUG oslo_service.backend._eventlet.service [None req-7b101f6e-9227-4428-a0f2-ad6ee2bde4d7 None None] network_link_prefix = None {{(pid=65370) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 529.767952] env[65370]: DEBUG oslo_service.backend._eventlet.service [None req-7b101f6e-9227-4428-a0f2-ad6ee2bde4d7 None None] network_scheduler_driver = neutron.scheduler.dhcp_agent_scheduler.WeightScheduler {{(pid=65370) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 529.768100] env[65370]: DEBUG oslo_service.backend._eventlet.service [None req-7b101f6e-9227-4428-a0f2-ad6ee2bde4d7 None None] notify_nova_on_port_data_changes = True {{(pid=65370) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 529.768230] env[65370]: DEBUG oslo_service.backend._eventlet.service [None req-7b101f6e-9227-4428-a0f2-ad6ee2bde4d7 None None] notify_nova_on_port_status_changes = True {{(pid=65370) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 529.768360] env[65370]: DEBUG oslo_service.backend._eventlet.service [None req-7b101f6e-9227-4428-a0f2-ad6ee2bde4d7 None None] pagination_max_limit = -1 {{(pid=65370) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 529.768483] env[65370]: DEBUG oslo_service.backend._eventlet.service [None req-7b101f6e-9227-4428-a0f2-ad6ee2bde4d7 None None] publish_errors = False {{(pid=65370) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 529.768609] env[65370]: DEBUG oslo_service.backend._eventlet.service [None req-7b101f6e-9227-4428-a0f2-ad6ee2bde4d7 None None] rate_limit_burst = 0 {{(pid=65370) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 529.768738] env[65370]: DEBUG oslo_service.backend._eventlet.service [None req-7b101f6e-9227-4428-a0f2-ad6ee2bde4d7 None None] rate_limit_except_level = CRITICAL {{(pid=65370) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 529.768861] env[65370]: DEBUG oslo_service.backend._eventlet.service [None req-7b101f6e-9227-4428-a0f2-ad6ee2bde4d7 None None] rate_limit_interval = 0 {{(pid=65370) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 529.768982] env[65370]: DEBUG oslo_service.backend._eventlet.service [None req-7b101f6e-9227-4428-a0f2-ad6ee2bde4d7 None None] retry_until_window = 30 {{(pid=65370) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 529.769116] env[65370]: DEBUG oslo_service.backend._eventlet.service [None req-7b101f6e-9227-4428-a0f2-ad6ee2bde4d7 None None] router_distributed = False {{(pid=65370) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 529.769238] env[65370]: DEBUG oslo_service.backend._eventlet.service [None req-7b101f6e-9227-4428-a0f2-ad6ee2bde4d7 None None] rpc_resources_processing_step = 20 {{(pid=65370) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 529.769359] env[65370]: DEBUG oslo_service.backend._eventlet.service [None req-7b101f6e-9227-4428-a0f2-ad6ee2bde4d7 None None] rpc_response_max_timeout = 600 {{(pid=65370) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 529.769482] env[65370]: DEBUG oslo_service.backend._eventlet.service [None req-7b101f6e-9227-4428-a0f2-ad6ee2bde4d7 None None] rpc_response_timeout = 60 {{(pid=65370) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 529.769606] env[65370]: DEBUG oslo_service.backend._eventlet.service [None req-7b101f6e-9227-4428-a0f2-ad6ee2bde4d7 None None] send_events_interval = 2 {{(pid=65370) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 529.769748] env[65370]: DEBUG oslo_service.backend._eventlet.service [None req-7b101f6e-9227-4428-a0f2-ad6ee2bde4d7 None None] service_plugins = ['router'] {{(pid=65370) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 529.769877] env[65370]: DEBUG oslo_service.backend._eventlet.service [None req-7b101f6e-9227-4428-a0f2-ad6ee2bde4d7 None None] setproctitle = on {{(pid=65370) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 529.769996] env[65370]: DEBUG oslo_service.backend._eventlet.service [None req-7b101f6e-9227-4428-a0f2-ad6ee2bde4d7 None None] shell_completion = None {{(pid=65370) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 529.770138] env[65370]: DEBUG oslo_service.backend._eventlet.service [None req-7b101f6e-9227-4428-a0f2-ad6ee2bde4d7 None None] state_path = /opt/stack/data/neutron {{(pid=65370) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 529.770267] env[65370]: DEBUG oslo_service.backend._eventlet.service [None req-7b101f6e-9227-4428-a0f2-ad6ee2bde4d7 None None] syslog_log_facility = LOG_USER {{(pid=65370) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 529.770391] env[65370]: DEBUG oslo_service.backend._eventlet.service [None req-7b101f6e-9227-4428-a0f2-ad6ee2bde4d7 None None] tcp_keepidle = 600 {{(pid=65370) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 529.770520] env[65370]: DEBUG oslo_service.backend._eventlet.service [None req-7b101f6e-9227-4428-a0f2-ad6ee2bde4d7 None None] transport_url = **** {{(pid=65370) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 529.770645] env[65370]: DEBUG oslo_service.backend._eventlet.service [None req-7b101f6e-9227-4428-a0f2-ad6ee2bde4d7 None None] use_journal = False {{(pid=65370) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 529.770764] env[65370]: DEBUG oslo_service.backend._eventlet.service [None req-7b101f6e-9227-4428-a0f2-ad6ee2bde4d7 None None] use_json = False {{(pid=65370) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 529.770884] env[65370]: DEBUG oslo_service.backend._eventlet.service [None req-7b101f6e-9227-4428-a0f2-ad6ee2bde4d7 None None] use_ssl = False {{(pid=65370) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 529.771026] env[65370]: DEBUG oslo_service.backend._eventlet.service [None req-7b101f6e-9227-4428-a0f2-ad6ee2bde4d7 None None] use_stderr = False {{(pid=65370) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 529.771146] env[65370]: DEBUG oslo_service.backend._eventlet.service [None req-7b101f6e-9227-4428-a0f2-ad6ee2bde4d7 None None] use_syslog = False {{(pid=65370) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 529.771269] env[65370]: DEBUG oslo_service.backend._eventlet.service [None req-7b101f6e-9227-4428-a0f2-ad6ee2bde4d7 None None] vlan_qinq = None {{(pid=65370) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 529.771389] env[65370]: DEBUG oslo_service.backend._eventlet.service [None req-7b101f6e-9227-4428-a0f2-ad6ee2bde4d7 None None] vlan_transparent = None {{(pid=65370) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 529.771510] env[65370]: DEBUG oslo_service.backend._eventlet.service [None req-7b101f6e-9227-4428-a0f2-ad6ee2bde4d7 None None] watch_log_file = False {{(pid=65370) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 529.771635] env[65370]: DEBUG oslo_service.backend._eventlet.service [None req-7b101f6e-9227-4428-a0f2-ad6ee2bde4d7 None None] wsgi_default_pool_size = 100 {{(pid=65370) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 529.771756] env[65370]: DEBUG oslo_service.backend._eventlet.service [None req-7b101f6e-9227-4428-a0f2-ad6ee2bde4d7 None None] wsgi_keep_alive = True {{(pid=65370) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 529.771885] env[65370]: DEBUG oslo_service.backend._eventlet.service [None req-7b101f6e-9227-4428-a0f2-ad6ee2bde4d7 None None] wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=65370) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 529.772019] env[65370]: DEBUG oslo_service.backend._eventlet.service [None req-7b101f6e-9227-4428-a0f2-ad6ee2bde4d7 None None] wsgi_server_debug = False {{(pid=65370) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 529.772166] env[65370]: DEBUG oslo_service.backend._eventlet.service [None req-7b101f6e-9227-4428-a0f2-ad6ee2bde4d7 None None] oslo_concurrency.disable_process_locking = False {{(pid=65370) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.772303] env[65370]: DEBUG oslo_service.backend._eventlet.service [None req-7b101f6e-9227-4428-a0f2-ad6ee2bde4d7 None None] oslo_concurrency.lock_path = /opt/stack/data/neutron/lock {{(pid=65370) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.772471] env[65370]: DEBUG oslo_service.backend._eventlet.service [None req-7b101f6e-9227-4428-a0f2-ad6ee2bde4d7 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=65370) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.772610] env[65370]: DEBUG oslo_service.backend._eventlet.service [None req-7b101f6e-9227-4428-a0f2-ad6ee2bde4d7 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=65370) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.772748] env[65370]: DEBUG oslo_service.backend._eventlet.service [None req-7b101f6e-9227-4428-a0f2-ad6ee2bde4d7 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=65370) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.772883] env[65370]: DEBUG oslo_service.backend._eventlet.service [None req-7b101f6e-9227-4428-a0f2-ad6ee2bde4d7 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=65370) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.773025] env[65370]: DEBUG oslo_service.backend._eventlet.service [None req-7b101f6e-9227-4428-a0f2-ad6ee2bde4d7 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=65370) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.773175] env[65370]: DEBUG oslo_service.backend._eventlet.service [None req-7b101f6e-9227-4428-a0f2-ad6ee2bde4d7 None None] profiler.connection_string = messaging:// {{(pid=65370) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.773312] env[65370]: DEBUG oslo_service.backend._eventlet.service [None req-7b101f6e-9227-4428-a0f2-ad6ee2bde4d7 None None] profiler.enabled = False {{(pid=65370) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.773451] env[65370]: DEBUG oslo_service.backend._eventlet.service [None req-7b101f6e-9227-4428-a0f2-ad6ee2bde4d7 None None] profiler.es_doc_type = notification {{(pid=65370) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.773584] env[65370]: DEBUG oslo_service.backend._eventlet.service [None req-7b101f6e-9227-4428-a0f2-ad6ee2bde4d7 None None] profiler.es_scroll_size = 10000 {{(pid=65370) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.773720] env[65370]: DEBUG oslo_service.backend._eventlet.service [None req-7b101f6e-9227-4428-a0f2-ad6ee2bde4d7 None None] profiler.es_scroll_time = 2m {{(pid=65370) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.773862] env[65370]: DEBUG oslo_service.backend._eventlet.service [None req-7b101f6e-9227-4428-a0f2-ad6ee2bde4d7 None None] profiler.filter_error_trace = False {{(pid=65370) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.773981] env[65370]: DEBUG oslo_service.backend._eventlet.service [None req-7b101f6e-9227-4428-a0f2-ad6ee2bde4d7 None None] profiler.hmac_keys = **** {{(pid=65370) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.774126] env[65370]: DEBUG oslo_service.backend._eventlet.service [None req-7b101f6e-9227-4428-a0f2-ad6ee2bde4d7 None None] profiler.sentinel_service_name = mymaster {{(pid=65370) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.774266] env[65370]: DEBUG oslo_service.backend._eventlet.service [None req-7b101f6e-9227-4428-a0f2-ad6ee2bde4d7 None None] profiler.socket_timeout = 0.1 {{(pid=65370) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.774454] env[65370]: DEBUG oslo_service.backend._eventlet.service [None req-7b101f6e-9227-4428-a0f2-ad6ee2bde4d7 None None] profiler.trace_requests = False {{(pid=65370) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.774587] env[65370]: DEBUG oslo_service.backend._eventlet.service [None req-7b101f6e-9227-4428-a0f2-ad6ee2bde4d7 None None] profiler.trace_sqlalchemy = False {{(pid=65370) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.774707] env[65370]: DEBUG oslo_service.backend._eventlet.service [None req-7b101f6e-9227-4428-a0f2-ad6ee2bde4d7 None None] profiler_jaeger.process_tags = {} {{(pid=65370) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.774836] env[65370]: DEBUG oslo_service.backend._eventlet.service [None req-7b101f6e-9227-4428-a0f2-ad6ee2bde4d7 None None] profiler_jaeger.service_name_prefix = None {{(pid=65370) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.774967] env[65370]: DEBUG oslo_service.backend._eventlet.service [None req-7b101f6e-9227-4428-a0f2-ad6ee2bde4d7 None None] profiler_otlp.service_name_prefix = None {{(pid=65370) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.775125] env[65370]: DEBUG oslo_service.backend._eventlet.service [None req-7b101f6e-9227-4428-a0f2-ad6ee2bde4d7 None None] oslo_policy.enforce_new_defaults = True {{(pid=65370) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.775414] env[65370]: WARNING oslo_config.cfg [None req-7b101f6e-9227-4428-a0f2-ad6ee2bde4d7 None None] Deprecated: Option "enforce_scope" from group "oslo_policy" is deprecated for removal (This configuration was added temporarily to facilitate a smooth transition to the new RBAC. OpenStack will always enforce scope checks. This configuration option is deprecated and will be removed in the 2025.2 cycle.). Its value may be silently ignored in the future. [ 529.775623] env[65370]: DEBUG oslo_service.backend._eventlet.service [None req-7b101f6e-9227-4428-a0f2-ad6ee2bde4d7 None None] oslo_policy.enforce_scope = True {{(pid=65370) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.775831] env[65370]: DEBUG oslo_service.backend._eventlet.service [None req-7b101f6e-9227-4428-a0f2-ad6ee2bde4d7 None None] oslo_policy.policy_default_rule = default {{(pid=65370) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.775994] env[65370]: DEBUG oslo_service.backend._eventlet.service [None req-7b101f6e-9227-4428-a0f2-ad6ee2bde4d7 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=65370) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.776152] env[65370]: DEBUG oslo_service.backend._eventlet.service [None req-7b101f6e-9227-4428-a0f2-ad6ee2bde4d7 None None] oslo_policy.policy_file = /etc/neutron/policy.json {{(pid=65370) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.776297] env[65370]: DEBUG oslo_service.backend._eventlet.service [None req-7b101f6e-9227-4428-a0f2-ad6ee2bde4d7 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=65370) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.776429] env[65370]: DEBUG oslo_service.backend._eventlet.service [None req-7b101f6e-9227-4428-a0f2-ad6ee2bde4d7 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=65370) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.776562] env[65370]: DEBUG oslo_service.backend._eventlet.service [None req-7b101f6e-9227-4428-a0f2-ad6ee2bde4d7 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=65370) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.776690] env[65370]: DEBUG oslo_service.backend._eventlet.service [None req-7b101f6e-9227-4428-a0f2-ad6ee2bde4d7 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=65370) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.776820] env[65370]: DEBUG oslo_service.backend._eventlet.service [None req-7b101f6e-9227-4428-a0f2-ad6ee2bde4d7 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=65370) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.776958] env[65370]: DEBUG oslo_service.backend._eventlet.service [None req-7b101f6e-9227-4428-a0f2-ad6ee2bde4d7 None None] oslo_policy.remote_timeout = 60.0 {{(pid=65370) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.777120] env[65370]: DEBUG oslo_service.backend._eventlet.service [None req-7b101f6e-9227-4428-a0f2-ad6ee2bde4d7 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=65370) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.777265] env[65370]: DEBUG oslo_service.backend._eventlet.service [None req-7b101f6e-9227-4428-a0f2-ad6ee2bde4d7 None None] agent.extensions = [] {{(pid=65370) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.777403] env[65370]: DEBUG oslo_service.backend._eventlet.service [None req-7b101f6e-9227-4428-a0f2-ad6ee2bde4d7 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=65370) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.777548] env[65370]: DEBUG oslo_service.backend._eventlet.service [None req-7b101f6e-9227-4428-a0f2-ad6ee2bde4d7 None None] service_providers.service_provider = [] {{(pid=65370) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.777690] env[65370]: DEBUG oslo_service.backend._eventlet.service [None req-7b101f6e-9227-4428-a0f2-ad6ee2bde4d7 None None] QUOTAS.default_quota = -1 {{(pid=65370) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.777830] env[65370]: DEBUG oslo_service.backend._eventlet.service [None req-7b101f6e-9227-4428-a0f2-ad6ee2bde4d7 None None] QUOTAS.quota_driver = neutron.db.quota.driver_nolock.DbQuotaNoLockDriver {{(pid=65370) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.777962] env[65370]: DEBUG oslo_service.backend._eventlet.service [None req-7b101f6e-9227-4428-a0f2-ad6ee2bde4d7 None None] QUOTAS.quota_floatingip = 50 {{(pid=65370) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.778104] env[65370]: DEBUG oslo_service.backend._eventlet.service [None req-7b101f6e-9227-4428-a0f2-ad6ee2bde4d7 None None] QUOTAS.quota_network = 100 {{(pid=65370) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.778234] env[65370]: DEBUG oslo_service.backend._eventlet.service [None req-7b101f6e-9227-4428-a0f2-ad6ee2bde4d7 None None] QUOTAS.quota_port = 500 {{(pid=65370) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.778363] env[65370]: DEBUG oslo_service.backend._eventlet.service [None req-7b101f6e-9227-4428-a0f2-ad6ee2bde4d7 None None] QUOTAS.quota_rbac_policy = 10 {{(pid=65370) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.778492] env[65370]: DEBUG oslo_service.backend._eventlet.service [None req-7b101f6e-9227-4428-a0f2-ad6ee2bde4d7 None None] QUOTAS.quota_router = 10 {{(pid=65370) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.778622] env[65370]: DEBUG oslo_service.backend._eventlet.service [None req-7b101f6e-9227-4428-a0f2-ad6ee2bde4d7 None None] QUOTAS.quota_security_group = 10 {{(pid=65370) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.778751] env[65370]: DEBUG oslo_service.backend._eventlet.service [None req-7b101f6e-9227-4428-a0f2-ad6ee2bde4d7 None None] QUOTAS.quota_security_group_rule = 100 {{(pid=65370) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.778879] env[65370]: DEBUG oslo_service.backend._eventlet.service [None req-7b101f6e-9227-4428-a0f2-ad6ee2bde4d7 None None] QUOTAS.quota_subnet = 100 {{(pid=65370) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.779014] env[65370]: DEBUG oslo_service.backend._eventlet.service [None req-7b101f6e-9227-4428-a0f2-ad6ee2bde4d7 None None] QUOTAS.track_quota_usage = True {{(pid=65370) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.779161] env[65370]: DEBUG oslo_service.backend._eventlet.service [None req-7b101f6e-9227-4428-a0f2-ad6ee2bde4d7 None None] privsep.capabilities = [21, 12, 1, 2, 19] {{(pid=65370) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.779291] env[65370]: DEBUG oslo_service.backend._eventlet.service [None req-7b101f6e-9227-4428-a0f2-ad6ee2bde4d7 None None] privsep.group = None {{(pid=65370) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.779421] env[65370]: DEBUG oslo_service.backend._eventlet.service [None req-7b101f6e-9227-4428-a0f2-ad6ee2bde4d7 None None] privsep.helper_command = None {{(pid=65370) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.779584] env[65370]: DEBUG oslo_service.backend._eventlet.service [None req-7b101f6e-9227-4428-a0f2-ad6ee2bde4d7 None None] privsep.log_daemon_traceback = False {{(pid=65370) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.779740] env[65370]: DEBUG oslo_service.backend._eventlet.service [None req-7b101f6e-9227-4428-a0f2-ad6ee2bde4d7 None None] privsep.logger_name = oslo_privsep.daemon {{(pid=65370) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.779876] env[65370]: DEBUG oslo_service.backend._eventlet.service [None req-7b101f6e-9227-4428-a0f2-ad6ee2bde4d7 None None] privsep.thread_pool_size = 8 {{(pid=65370) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.780024] env[65370]: DEBUG oslo_service.backend._eventlet.service [None req-7b101f6e-9227-4428-a0f2-ad6ee2bde4d7 None None] privsep.user = None {{(pid=65370) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.780159] env[65370]: DEBUG oslo_service.backend._eventlet.service [None req-7b101f6e-9227-4428-a0f2-ad6ee2bde4d7 None None] privsep_dhcp_release.capabilities = [21, 12] {{(pid=65370) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.780288] env[65370]: DEBUG oslo_service.backend._eventlet.service [None req-7b101f6e-9227-4428-a0f2-ad6ee2bde4d7 None None] privsep_dhcp_release.group = None {{(pid=65370) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.780416] env[65370]: DEBUG oslo_service.backend._eventlet.service [None req-7b101f6e-9227-4428-a0f2-ad6ee2bde4d7 None None] privsep_dhcp_release.helper_command = None {{(pid=65370) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.780544] env[65370]: DEBUG oslo_service.backend._eventlet.service [None req-7b101f6e-9227-4428-a0f2-ad6ee2bde4d7 None None] privsep_dhcp_release.log_daemon_traceback = False {{(pid=65370) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.780674] env[65370]: DEBUG oslo_service.backend._eventlet.service [None req-7b101f6e-9227-4428-a0f2-ad6ee2bde4d7 None None] privsep_dhcp_release.logger_name = oslo_privsep.daemon {{(pid=65370) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.780801] env[65370]: DEBUG oslo_service.backend._eventlet.service [None req-7b101f6e-9227-4428-a0f2-ad6ee2bde4d7 None None] privsep_dhcp_release.thread_pool_size = 8 {{(pid=65370) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.780927] env[65370]: DEBUG oslo_service.backend._eventlet.service [None req-7b101f6e-9227-4428-a0f2-ad6ee2bde4d7 None None] privsep_dhcp_release.user = None {{(pid=65370) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.781072] env[65370]: DEBUG oslo_service.backend._eventlet.service [None req-7b101f6e-9227-4428-a0f2-ad6ee2bde4d7 None None] privsep_ovs_vsctl.capabilities = [21, 12] {{(pid=65370) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.781200] env[65370]: DEBUG oslo_service.backend._eventlet.service [None req-7b101f6e-9227-4428-a0f2-ad6ee2bde4d7 None None] privsep_ovs_vsctl.group = None {{(pid=65370) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.781321] env[65370]: DEBUG oslo_service.backend._eventlet.service [None req-7b101f6e-9227-4428-a0f2-ad6ee2bde4d7 None None] privsep_ovs_vsctl.helper_command = None {{(pid=65370) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.781448] env[65370]: DEBUG oslo_service.backend._eventlet.service [None req-7b101f6e-9227-4428-a0f2-ad6ee2bde4d7 None None] privsep_ovs_vsctl.log_daemon_traceback = False {{(pid=65370) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.781580] env[65370]: DEBUG oslo_service.backend._eventlet.service [None req-7b101f6e-9227-4428-a0f2-ad6ee2bde4d7 None None] privsep_ovs_vsctl.logger_name = oslo_privsep.daemon {{(pid=65370) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.781706] env[65370]: DEBUG oslo_service.backend._eventlet.service [None req-7b101f6e-9227-4428-a0f2-ad6ee2bde4d7 None None] privsep_ovs_vsctl.thread_pool_size = 8 {{(pid=65370) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.781831] env[65370]: DEBUG oslo_service.backend._eventlet.service [None req-7b101f6e-9227-4428-a0f2-ad6ee2bde4d7 None None] privsep_ovs_vsctl.user = None {{(pid=65370) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.781961] env[65370]: DEBUG oslo_service.backend._eventlet.service [None req-7b101f6e-9227-4428-a0f2-ad6ee2bde4d7 None None] privsep_namespace.capabilities = [21] {{(pid=65370) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.782095] env[65370]: DEBUG oslo_service.backend._eventlet.service [None req-7b101f6e-9227-4428-a0f2-ad6ee2bde4d7 None None] privsep_namespace.group = None {{(pid=65370) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.782218] env[65370]: DEBUG oslo_service.backend._eventlet.service [None req-7b101f6e-9227-4428-a0f2-ad6ee2bde4d7 None None] privsep_namespace.helper_command = None {{(pid=65370) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.782344] env[65370]: DEBUG oslo_service.backend._eventlet.service [None req-7b101f6e-9227-4428-a0f2-ad6ee2bde4d7 None None] privsep_namespace.log_daemon_traceback = False {{(pid=65370) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.782496] env[65370]: DEBUG oslo_service.backend._eventlet.service [None req-7b101f6e-9227-4428-a0f2-ad6ee2bde4d7 None None] privsep_namespace.logger_name = oslo_privsep.daemon {{(pid=65370) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.782636] env[65370]: DEBUG oslo_service.backend._eventlet.service [None req-7b101f6e-9227-4428-a0f2-ad6ee2bde4d7 None None] privsep_namespace.thread_pool_size = 8 {{(pid=65370) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.782764] env[65370]: DEBUG oslo_service.backend._eventlet.service [None req-7b101f6e-9227-4428-a0f2-ad6ee2bde4d7 None None] privsep_namespace.user = None {{(pid=65370) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.782897] env[65370]: DEBUG oslo_service.backend._eventlet.service [None req-7b101f6e-9227-4428-a0f2-ad6ee2bde4d7 None None] privsep_conntrack.capabilities = [12] {{(pid=65370) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.783030] env[65370]: DEBUG oslo_service.backend._eventlet.service [None req-7b101f6e-9227-4428-a0f2-ad6ee2bde4d7 None None] privsep_conntrack.group = None {{(pid=65370) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.783158] env[65370]: DEBUG oslo_service.backend._eventlet.service [None req-7b101f6e-9227-4428-a0f2-ad6ee2bde4d7 None None] privsep_conntrack.helper_command = None {{(pid=65370) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.783285] env[65370]: DEBUG oslo_service.backend._eventlet.service [None req-7b101f6e-9227-4428-a0f2-ad6ee2bde4d7 None None] privsep_conntrack.log_daemon_traceback = False {{(pid=65370) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.783419] env[65370]: DEBUG oslo_service.backend._eventlet.service [None req-7b101f6e-9227-4428-a0f2-ad6ee2bde4d7 None None] privsep_conntrack.logger_name = oslo_privsep.daemon {{(pid=65370) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.783549] env[65370]: DEBUG oslo_service.backend._eventlet.service [None req-7b101f6e-9227-4428-a0f2-ad6ee2bde4d7 None None] privsep_conntrack.thread_pool_size = 8 {{(pid=65370) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.783673] env[65370]: DEBUG oslo_service.backend._eventlet.service [None req-7b101f6e-9227-4428-a0f2-ad6ee2bde4d7 None None] privsep_conntrack.user = None {{(pid=65370) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.783806] env[65370]: DEBUG oslo_service.backend._eventlet.service [None req-7b101f6e-9227-4428-a0f2-ad6ee2bde4d7 None None] privsep_link.capabilities = [12, 21] {{(pid=65370) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.783983] env[65370]: DEBUG oslo_service.backend._eventlet.service [None req-7b101f6e-9227-4428-a0f2-ad6ee2bde4d7 None None] privsep_link.group = None {{(pid=65370) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.784073] env[65370]: DEBUG oslo_service.backend._eventlet.service [None req-7b101f6e-9227-4428-a0f2-ad6ee2bde4d7 None None] privsep_link.helper_command = None {{(pid=65370) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.784182] env[65370]: DEBUG oslo_service.backend._eventlet.service [None req-7b101f6e-9227-4428-a0f2-ad6ee2bde4d7 None None] privsep_link.log_daemon_traceback = False {{(pid=65370) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.784309] env[65370]: DEBUG oslo_service.backend._eventlet.service [None req-7b101f6e-9227-4428-a0f2-ad6ee2bde4d7 None None] privsep_link.logger_name = oslo_privsep.daemon {{(pid=65370) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.784461] env[65370]: DEBUG oslo_service.backend._eventlet.service [None req-7b101f6e-9227-4428-a0f2-ad6ee2bde4d7 None None] privsep_link.thread_pool_size = 8 {{(pid=65370) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.784600] env[65370]: DEBUG oslo_service.backend._eventlet.service [None req-7b101f6e-9227-4428-a0f2-ad6ee2bde4d7 None None] privsep_link.user = None {{(pid=65370) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.784748] env[65370]: DEBUG oslo_service.backend._eventlet.service [None req-7b101f6e-9227-4428-a0f2-ad6ee2bde4d7 None None] AGENT.agent_id = nsxm-l-01a.corp.local {{(pid=65370) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.784892] env[65370]: DEBUG oslo_service.backend._eventlet.service [None req-7b101f6e-9227-4428-a0f2-ad6ee2bde4d7 None None] AGENT.agent_prometheus_exporter_port = 8000 {{(pid=65370) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.785036] env[65370]: DEBUG oslo_service.backend._eventlet.service [None req-7b101f6e-9227-4428-a0f2-ad6ee2bde4d7 None None] AGENT.continue_on_failed_promotions = False {{(pid=65370) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.785217] env[65370]: DEBUG oslo_service.backend._eventlet.service [None req-7b101f6e-9227-4428-a0f2-ad6ee2bde4d7 None None] AGENT.dscp = None {{(pid=65370) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.785425] env[65370]: DEBUG oslo_service.backend._eventlet.service [None req-7b101f6e-9227-4428-a0f2-ad6ee2bde4d7 None None] AGENT.dscp_inherit = False {{(pid=65370) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.785554] env[65370]: DEBUG oslo_service.backend._eventlet.service [None req-7b101f6e-9227-4428-a0f2-ad6ee2bde4d7 None None] AGENT.force_mp_to_policy = True {{(pid=65370) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.785692] env[65370]: DEBUG oslo_service.backend._eventlet.service [None req-7b101f6e-9227-4428-a0f2-ad6ee2bde4d7 None None] AGENT.locking_coordinator_url = None {{(pid=65370) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.785826] env[65370]: DEBUG oslo_service.backend._eventlet.service [None req-7b101f6e-9227-4428-a0f2-ad6ee2bde4d7 None None] AGENT.log_agent_heartbeats = False {{(pid=65370) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.785962] env[65370]: DEBUG oslo_service.backend._eventlet.service [None req-7b101f6e-9227-4428-a0f2-ad6ee2bde4d7 None None] AGENT.logging_expire = 1 {{(pid=65370) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.786116] env[65370]: DEBUG oslo_service.backend._eventlet.service [None req-7b101f6e-9227-4428-a0f2-ad6ee2bde4d7 None None] AGENT.logging_url = unix:///var/run/redis/socket/redis.sock {{(pid=65370) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.786249] env[65370]: DEBUG oslo_service.backend._eventlet.service [None req-7b101f6e-9227-4428-a0f2-ad6ee2bde4d7 None None] AGENT.max_sg_tags_per_segment_port = 27 {{(pid=65370) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.786390] env[65370]: DEBUG oslo_service.backend._eventlet.service [None req-7b101f6e-9227-4428-a0f2-ad6ee2bde4d7 None None] AGENT.polling_interval = 240 {{(pid=65370) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.786524] env[65370]: DEBUG oslo_service.backend._eventlet.service [None req-7b101f6e-9227-4428-a0f2-ad6ee2bde4d7 None None] AGENT.ports_tag_number_decrease_workaround = True {{(pid=65370) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.786663] env[65370]: DEBUG oslo_service.backend._eventlet.service [None req-7b101f6e-9227-4428-a0f2-ad6ee2bde4d7 None None] AGENT.quitting_rpc_timeout = 120 {{(pid=65370) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.786802] env[65370]: DEBUG oslo_service.backend._eventlet.service [None req-7b101f6e-9227-4428-a0f2-ad6ee2bde4d7 None None] AGENT.report_interval = 30.0 {{(pid=65370) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.786940] env[65370]: DEBUG oslo_service.backend._eventlet.service [None req-7b101f6e-9227-4428-a0f2-ad6ee2bde4d7 None None] AGENT.root_helper = sudo /opt/stack/data/venv/bin/neutron-rootwrap /etc/neutron/rootwrap.conf {{(pid=65370) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.787085] env[65370]: DEBUG oslo_service.backend._eventlet.service [None req-7b101f6e-9227-4428-a0f2-ad6ee2bde4d7 None None] AGENT.root_helper_daemon = sudo /opt/stack/data/venv/bin/neutron-rootwrap-daemon /etc/neutron/rootwrap.conf {{(pid=65370) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.787226] env[65370]: DEBUG oslo_service.backend._eventlet.service [None req-7b101f6e-9227-4428-a0f2-ad6ee2bde4d7 None None] AGENT.rpc_max_records_per_query = 1000 {{(pid=65370) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.787358] env[65370]: DEBUG oslo_service.backend._eventlet.service [None req-7b101f6e-9227-4428-a0f2-ad6ee2bde4d7 None None] AGENT.sync_skew = 60 {{(pid=65370) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.787488] env[65370]: DEBUG oslo_service.backend._eventlet.service [None req-7b101f6e-9227-4428-a0f2-ad6ee2bde4d7 None None] AGENT.synchronization_queue_size = 20 {{(pid=65370) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.787623] env[65370]: DEBUG oslo_service.backend._eventlet.service [None req-7b101f6e-9227-4428-a0f2-ad6ee2bde4d7 None None] AGENT.use_helper_for_ns_read = True {{(pid=65370) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.787762] env[65370]: DEBUG oslo_service.backend._eventlet.service [None req-7b101f6e-9227-4428-a0f2-ad6ee2bde4d7 None None] SECURITYGROUP.enable_ipset = True {{(pid=65370) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.787901] env[65370]: DEBUG oslo_service.backend._eventlet.service [None req-7b101f6e-9227-4428-a0f2-ad6ee2bde4d7 None None] SECURITYGROUP.enable_security_group = True {{(pid=65370) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.788045] env[65370]: DEBUG oslo_service.backend._eventlet.service [None req-7b101f6e-9227-4428-a0f2-ad6ee2bde4d7 None None] SECURITYGROUP.firewall_driver = nsxv3 {{(pid=65370) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.788186] env[65370]: DEBUG oslo_service.backend._eventlet.service [None req-7b101f6e-9227-4428-a0f2-ad6ee2bde4d7 None None] SECURITYGROUP.permitted_ethertypes = [] {{(pid=65370) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.788324] env[65370]: DEBUG oslo_service.backend._eventlet.service [None req-7b101f6e-9227-4428-a0f2-ad6ee2bde4d7 None None] experimental.ipv6_pd_enabled = False {{(pid=65370) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.788477] env[65370]: DEBUG oslo_service.backend._eventlet.service [None req-7b101f6e-9227-4428-a0f2-ad6ee2bde4d7 None None] ml2.extension_drivers = ['port_security'] {{(pid=65370) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.788613] env[65370]: DEBUG oslo_service.backend._eventlet.service [None req-7b101f6e-9227-4428-a0f2-ad6ee2bde4d7 None None] ml2.external_network_type = None {{(pid=65370) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.788755] env[65370]: DEBUG oslo_service.backend._eventlet.service [None req-7b101f6e-9227-4428-a0f2-ad6ee2bde4d7 None None] ml2.mechanism_drivers = ['nsxv3', 'openvswitch', 'logger'] {{(pid=65370) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.788893] env[65370]: DEBUG oslo_service.backend._eventlet.service [None req-7b101f6e-9227-4428-a0f2-ad6ee2bde4d7 None None] ml2.overlay_ip_version = 4 {{(pid=65370) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.789038] env[65370]: DEBUG oslo_service.backend._eventlet.service [None req-7b101f6e-9227-4428-a0f2-ad6ee2bde4d7 None None] ml2.path_mtu = 8950 {{(pid=65370) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.789178] env[65370]: DEBUG oslo_service.backend._eventlet.service [None req-7b101f6e-9227-4428-a0f2-ad6ee2bde4d7 None None] ml2.physical_network_mtus = {} {{(pid=65370) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.789318] env[65370]: DEBUG oslo_service.backend._eventlet.service [None req-7b101f6e-9227-4428-a0f2-ad6ee2bde4d7 None None] ml2.tenant_network_types = ['vlan'] {{(pid=65370) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.789454] env[65370]: DEBUG oslo_service.backend._eventlet.service [None req-7b101f6e-9227-4428-a0f2-ad6ee2bde4d7 None None] ml2.tunnelled_network_rp_name = rp_tunnelled {{(pid=65370) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.789596] env[65370]: DEBUG oslo_service.backend._eventlet.service [None req-7b101f6e-9227-4428-a0f2-ad6ee2bde4d7 None None] ml2.type_drivers = ['vlan'] {{(pid=65370) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.789736] env[65370]: DEBUG oslo_service.backend._eventlet.service [None req-7b101f6e-9227-4428-a0f2-ad6ee2bde4d7 None None] AGENT_CLI.neutron_port_id = [] {{(pid=65370) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.789866] env[65370]: DEBUG oslo_service.backend._eventlet.service [None req-7b101f6e-9227-4428-a0f2-ad6ee2bde4d7 None None] AGENT_CLI.neutron_qos_policy_id = [] {{(pid=65370) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.789992] env[65370]: DEBUG oslo_service.backend._eventlet.service [None req-7b101f6e-9227-4428-a0f2-ad6ee2bde4d7 None None] AGENT_CLI.neutron_security_group_id = [] {{(pid=65370) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.790154] env[65370]: DEBUG oslo_service.backend._eventlet.service [None req-7b101f6e-9227-4428-a0f2-ad6ee2bde4d7 None None] NSXV3.nsxv3_concurrent_requests = 40 {{(pid=65370) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.790293] env[65370]: DEBUG oslo_service.backend._eventlet.service [None req-7b101f6e-9227-4428-a0f2-ad6ee2bde4d7 None None] NSXV3.nsxv3_connection_retry_count = 2 {{(pid=65370) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.790427] env[65370]: DEBUG oslo_service.backend._eventlet.service [None req-7b101f6e-9227-4428-a0f2-ad6ee2bde4d7 None None] NSXV3.nsxv3_connection_retry_sleep = 2 {{(pid=65370) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.790560] env[65370]: DEBUG oslo_service.backend._eventlet.service [None req-7b101f6e-9227-4428-a0f2-ad6ee2bde4d7 None None] NSXV3.nsxv3_default_policy_infrastructure_rules = True {{(pid=65370) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.790693] env[65370]: DEBUG oslo_service.backend._eventlet.service [None req-7b101f6e-9227-4428-a0f2-ad6ee2bde4d7 None None] NSXV3.nsxv3_dfw_connectivity_strategy = NONE {{(pid=65370) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.790827] env[65370]: DEBUG oslo_service.backend._eventlet.service [None req-7b101f6e-9227-4428-a0f2-ad6ee2bde4d7 None None] NSXV3.nsxv3_ip_discovery_switching_profile = nsx-default-ip-discovery-vlan-profile {{(pid=65370) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.791022] env[65370]: DEBUG oslo_service.backend._eventlet.service [None req-7b101f6e-9227-4428-a0f2-ad6ee2bde4d7 None None] NSXV3.nsxv3_login_hostname = nsxt.osci.c.eu-de-1.cloud.sap {{(pid=65370) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.791167] env[65370]: DEBUG oslo_service.backend._eventlet.service [None req-7b101f6e-9227-4428-a0f2-ad6ee2bde4d7 None None] NSXV3.nsxv3_login_password = **** {{(pid=65370) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.791306] env[65370]: DEBUG oslo_service.backend._eventlet.service [None req-7b101f6e-9227-4428-a0f2-ad6ee2bde4d7 None None] NSXV3.nsxv3_login_port = 443 {{(pid=65370) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.791440] env[65370]: DEBUG oslo_service.backend._eventlet.service [None req-7b101f6e-9227-4428-a0f2-ad6ee2bde4d7 None None] NSXV3.nsxv3_login_user = admin {{(pid=65370) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.791585] env[65370]: DEBUG oslo_service.backend._eventlet.service [None req-7b101f6e-9227-4428-a0f2-ad6ee2bde4d7 None None] NSXV3.nsxv3_managed_hosts = [] {{(pid=65370) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.791727] env[65370]: DEBUG oslo_service.backend._eventlet.service [None req-7b101f6e-9227-4428-a0f2-ad6ee2bde4d7 None None] NSXV3.nsxv3_max_records_per_query = 200 {{(pid=65370) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.791861] env[65370]: DEBUG oslo_service.backend._eventlet.service [None req-7b101f6e-9227-4428-a0f2-ad6ee2bde4d7 None None] NSXV3.nsxv3_operation_retry_count = 3 {{(pid=65370) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.791989] env[65370]: DEBUG oslo_service.backend._eventlet.service [None req-7b101f6e-9227-4428-a0f2-ad6ee2bde4d7 None None] NSXV3.nsxv3_operation_retry_sleep = 5 {{(pid=65370) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.792139] env[65370]: DEBUG oslo_service.backend._eventlet.service [None req-7b101f6e-9227-4428-a0f2-ad6ee2bde4d7 None None] NSXV3.nsxv3_realization_timeout = 300 {{(pid=65370) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.792277] env[65370]: DEBUG oslo_service.backend._eventlet.service [None req-7b101f6e-9227-4428-a0f2-ad6ee2bde4d7 None None] NSXV3.nsxv3_remove_orphan_ports_after = 2.0 {{(pid=65370) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.792415] env[65370]: DEBUG oslo_service.backend._eventlet.service [None req-7b101f6e-9227-4428-a0f2-ad6ee2bde4d7 None None] NSXV3.nsxv3_request_timeout = 60 {{(pid=65370) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.792551] env[65370]: DEBUG oslo_service.backend._eventlet.service [None req-7b101f6e-9227-4428-a0f2-ad6ee2bde4d7 None None] NSXV3.nsxv3_requests_per_second = 80 {{(pid=65370) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.792681] env[65370]: DEBUG oslo_service.backend._eventlet.service [None req-7b101f6e-9227-4428-a0f2-ad6ee2bde4d7 None None] NSXV3.nsxv3_requests_per_second_timeout = 7 {{(pid=65370) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.792816] env[65370]: DEBUG oslo_service.backend._eventlet.service [None req-7b101f6e-9227-4428-a0f2-ad6ee2bde4d7 None None] NSXV3.nsxv3_spoof_guard_switching_profile = nsx-default-spoof-guard-vif-profile {{(pid=65370) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.792953] env[65370]: DEBUG oslo_service.backend._eventlet.service [None req-7b101f6e-9227-4428-a0f2-ad6ee2bde4d7 None None] NSXV3.nsxv3_suppress_ssl_warnings = True {{(pid=65370) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.793095] env[65370]: DEBUG oslo_service.backend._eventlet.service [None req-7b101f6e-9227-4428-a0f2-ad6ee2bde4d7 None None] NSXV3.nsxv3_transport_zone_id_cache_time = 86400 {{(pid=65370) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.793232] env[65370]: DEBUG oslo_service.backend._eventlet.service [None req-7b101f6e-9227-4428-a0f2-ad6ee2bde4d7 None None] NSXV3.nsxv3_transport_zone_name = nsx-vlan-transportzone {{(pid=65370) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.793413] env[65370]: DEBUG oslo_service.backend._eventlet.service [None req-7b101f6e-9227-4428-a0f2-ad6ee2bde4d7 None None] vsphere.vsphere_login_hostname = vc-l-01a.corp.local {{(pid=65370) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.793556] env[65370]: DEBUG oslo_service.backend._eventlet.service [None req-7b101f6e-9227-4428-a0f2-ad6ee2bde4d7 None None] vsphere.vsphere_login_password = VMware1! {{(pid=65370) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.793691] env[65370]: DEBUG oslo_service.backend._eventlet.service [None req-7b101f6e-9227-4428-a0f2-ad6ee2bde4d7 None None] vsphere.vsphere_login_username = administrator@vsphere.local {{(pid=65370) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.793821] env[65370]: DEBUG oslo_service.backend._eventlet.service [None req-7b101f6e-9227-4428-a0f2-ad6ee2bde4d7 None None] vsphere.vsphere_suppress_ssl_wornings = True {{(pid=65370) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.793954] env[65370]: DEBUG oslo_service.backend._eventlet.service [None req-7b101f6e-9227-4428-a0f2-ad6ee2bde4d7 None None] nova.auth_section = None {{(pid=65370) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.794110] env[65370]: DEBUG oslo_service.backend._eventlet.service [None req-7b101f6e-9227-4428-a0f2-ad6ee2bde4d7 None None] nova.auth_type = password {{(pid=65370) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.794248] env[65370]: DEBUG oslo_service.backend._eventlet.service [None req-7b101f6e-9227-4428-a0f2-ad6ee2bde4d7 None None] nova.cafile = /opt/stack/data/ca-bundle.pem {{(pid=65370) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.794375] env[65370]: DEBUG oslo_service.backend._eventlet.service [None req-7b101f6e-9227-4428-a0f2-ad6ee2bde4d7 None None] nova.certfile = None {{(pid=65370) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.794526] env[65370]: DEBUG oslo_service.backend._eventlet.service [None req-7b101f6e-9227-4428-a0f2-ad6ee2bde4d7 None None] nova.collect_timing = False {{(pid=65370) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.794669] env[65370]: DEBUG oslo_service.backend._eventlet.service [None req-7b101f6e-9227-4428-a0f2-ad6ee2bde4d7 None None] nova.endpoint_type = public {{(pid=65370) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.794799] env[65370]: DEBUG oslo_service.backend._eventlet.service [None req-7b101f6e-9227-4428-a0f2-ad6ee2bde4d7 None None] nova.insecure = False {{(pid=65370) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.794925] env[65370]: DEBUG oslo_service.backend._eventlet.service [None req-7b101f6e-9227-4428-a0f2-ad6ee2bde4d7 None None] nova.keyfile = None {{(pid=65370) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.795071] env[65370]: DEBUG oslo_service.backend._eventlet.service [None req-7b101f6e-9227-4428-a0f2-ad6ee2bde4d7 None None] nova.region_name = RegionOne {{(pid=65370) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.795201] env[65370]: DEBUG oslo_service.backend._eventlet.service [None req-7b101f6e-9227-4428-a0f2-ad6ee2bde4d7 None None] nova.split_loggers = False {{(pid=65370) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.795326] env[65370]: DEBUG oslo_service.backend._eventlet.service [None req-7b101f6e-9227-4428-a0f2-ad6ee2bde4d7 None None] nova.timeout = None {{(pid=65370) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.795458] env[65370]: DEBUG oslo_service.backend._eventlet.service [None req-7b101f6e-9227-4428-a0f2-ad6ee2bde4d7 None None] placement.auth_section = None {{(pid=65370) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.795618] env[65370]: DEBUG oslo_service.backend._eventlet.service [None req-7b101f6e-9227-4428-a0f2-ad6ee2bde4d7 None None] placement.auth_type = password {{(pid=65370) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.795760] env[65370]: DEBUG oslo_service.backend._eventlet.service [None req-7b101f6e-9227-4428-a0f2-ad6ee2bde4d7 None None] placement.cafile = /opt/stack/data/ca-bundle.pem {{(pid=65370) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.795889] env[65370]: DEBUG oslo_service.backend._eventlet.service [None req-7b101f6e-9227-4428-a0f2-ad6ee2bde4d7 None None] placement.certfile = None {{(pid=65370) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.796028] env[65370]: DEBUG oslo_service.backend._eventlet.service [None req-7b101f6e-9227-4428-a0f2-ad6ee2bde4d7 None None] placement.collect_timing = False {{(pid=65370) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.796169] env[65370]: DEBUG oslo_service.backend._eventlet.service [None req-7b101f6e-9227-4428-a0f2-ad6ee2bde4d7 None None] placement.endpoint_type = public {{(pid=65370) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.796300] env[65370]: DEBUG oslo_service.backend._eventlet.service [None req-7b101f6e-9227-4428-a0f2-ad6ee2bde4d7 None None] placement.insecure = False {{(pid=65370) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.796425] env[65370]: DEBUG oslo_service.backend._eventlet.service [None req-7b101f6e-9227-4428-a0f2-ad6ee2bde4d7 None None] placement.keyfile = None {{(pid=65370) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.796551] env[65370]: DEBUG oslo_service.backend._eventlet.service [None req-7b101f6e-9227-4428-a0f2-ad6ee2bde4d7 None None] placement.region_name = None {{(pid=65370) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.796678] env[65370]: DEBUG oslo_service.backend._eventlet.service [None req-7b101f6e-9227-4428-a0f2-ad6ee2bde4d7 None None] placement.split_loggers = False {{(pid=65370) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.796800] env[65370]: DEBUG oslo_service.backend._eventlet.service [None req-7b101f6e-9227-4428-a0f2-ad6ee2bde4d7 None None] placement.timeout = None {{(pid=65370) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.796930] env[65370]: DEBUG oslo_service.backend._eventlet.service [None req-7b101f6e-9227-4428-a0f2-ad6ee2bde4d7 None None] ironic.auth_section = None {{(pid=65370) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.797068] env[65370]: DEBUG oslo_service.backend._eventlet.service [None req-7b101f6e-9227-4428-a0f2-ad6ee2bde4d7 None None] ironic.auth_type = None {{(pid=65370) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.797193] env[65370]: DEBUG oslo_service.backend._eventlet.service [None req-7b101f6e-9227-4428-a0f2-ad6ee2bde4d7 None None] ironic.cafile = None {{(pid=65370) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.797313] env[65370]: DEBUG oslo_service.backend._eventlet.service [None req-7b101f6e-9227-4428-a0f2-ad6ee2bde4d7 None None] ironic.certfile = None {{(pid=65370) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.797436] env[65370]: DEBUG oslo_service.backend._eventlet.service [None req-7b101f6e-9227-4428-a0f2-ad6ee2bde4d7 None None] ironic.collect_timing = False {{(pid=65370) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.797561] env[65370]: DEBUG oslo_service.backend._eventlet.service [None req-7b101f6e-9227-4428-a0f2-ad6ee2bde4d7 None None] ironic.connect_retries = None {{(pid=65370) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.797691] env[65370]: DEBUG oslo_service.backend._eventlet.service [None req-7b101f6e-9227-4428-a0f2-ad6ee2bde4d7 None None] ironic.connect_retry_delay = None {{(pid=65370) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.797895] env[65370]: DEBUG oslo_service.backend._eventlet.service [None req-7b101f6e-9227-4428-a0f2-ad6ee2bde4d7 None None] ironic.enable_notifications = False {{(pid=65370) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.798105] env[65370]: DEBUG oslo_service.backend._eventlet.service [None req-7b101f6e-9227-4428-a0f2-ad6ee2bde4d7 None None] ironic.endpoint_override = None {{(pid=65370) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.798259] env[65370]: DEBUG oslo_service.backend._eventlet.service [None req-7b101f6e-9227-4428-a0f2-ad6ee2bde4d7 None None] ironic.insecure = False {{(pid=65370) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.798391] env[65370]: DEBUG oslo_service.backend._eventlet.service [None req-7b101f6e-9227-4428-a0f2-ad6ee2bde4d7 None None] ironic.interface = None {{(pid=65370) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.798521] env[65370]: DEBUG oslo_service.backend._eventlet.service [None req-7b101f6e-9227-4428-a0f2-ad6ee2bde4d7 None None] ironic.keyfile = None {{(pid=65370) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.798655] env[65370]: DEBUG oslo_service.backend._eventlet.service [None req-7b101f6e-9227-4428-a0f2-ad6ee2bde4d7 None None] ironic.max_version = None {{(pid=65370) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.798783] env[65370]: DEBUG oslo_service.backend._eventlet.service [None req-7b101f6e-9227-4428-a0f2-ad6ee2bde4d7 None None] ironic.min_version = None {{(pid=65370) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.798912] env[65370]: DEBUG oslo_service.backend._eventlet.service [None req-7b101f6e-9227-4428-a0f2-ad6ee2bde4d7 None None] ironic.region_name = None {{(pid=65370) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.799051] env[65370]: DEBUG oslo_service.backend._eventlet.service [None req-7b101f6e-9227-4428-a0f2-ad6ee2bde4d7 None None] ironic.retriable_status_codes = None {{(pid=65370) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.799182] env[65370]: DEBUG oslo_service.backend._eventlet.service [None req-7b101f6e-9227-4428-a0f2-ad6ee2bde4d7 None None] ironic.service_name = None {{(pid=65370) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.799308] env[65370]: DEBUG oslo_service.backend._eventlet.service [None req-7b101f6e-9227-4428-a0f2-ad6ee2bde4d7 None None] ironic.service_type = None {{(pid=65370) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.799436] env[65370]: DEBUG oslo_service.backend._eventlet.service [None req-7b101f6e-9227-4428-a0f2-ad6ee2bde4d7 None None] ironic.split_loggers = False {{(pid=65370) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.799563] env[65370]: DEBUG oslo_service.backend._eventlet.service [None req-7b101f6e-9227-4428-a0f2-ad6ee2bde4d7 None None] ironic.status_code_retries = None {{(pid=65370) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.799689] env[65370]: DEBUG oslo_service.backend._eventlet.service [None req-7b101f6e-9227-4428-a0f2-ad6ee2bde4d7 None None] ironic.status_code_retry_delay = None {{(pid=65370) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.799814] env[65370]: DEBUG oslo_service.backend._eventlet.service [None req-7b101f6e-9227-4428-a0f2-ad6ee2bde4d7 None None] ironic.timeout = None {{(pid=65370) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.799941] env[65370]: DEBUG oslo_service.backend._eventlet.service [None req-7b101f6e-9227-4428-a0f2-ad6ee2bde4d7 None None] ironic.valid_interfaces = None {{(pid=65370) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.800077] env[65370]: DEBUG oslo_service.backend._eventlet.service [None req-7b101f6e-9227-4428-a0f2-ad6ee2bde4d7 None None] ironic.version = None {{(pid=65370) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.800216] env[65370]: DEBUG oslo_service.backend._eventlet.service [None req-7b101f6e-9227-4428-a0f2-ad6ee2bde4d7 None None] cli_script.dry_run = False {{(pid=65370) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.800357] env[65370]: DEBUG oslo_service.backend._eventlet.service [None req-7b101f6e-9227-4428-a0f2-ad6ee2bde4d7 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=65370) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.800488] env[65370]: DEBUG oslo_service.backend._eventlet.service [None req-7b101f6e-9227-4428-a0f2-ad6ee2bde4d7 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=65370) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.800622] env[65370]: DEBUG oslo_service.backend._eventlet.service [None req-7b101f6e-9227-4428-a0f2-ad6ee2bde4d7 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=65370) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.800751] env[65370]: DEBUG oslo_service.backend._eventlet.service [None req-7b101f6e-9227-4428-a0f2-ad6ee2bde4d7 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=65370) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.800878] env[65370]: DEBUG oslo_service.backend._eventlet.service [None req-7b101f6e-9227-4428-a0f2-ad6ee2bde4d7 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=65370) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.801009] env[65370]: DEBUG oslo_service.backend._eventlet.service [None req-7b101f6e-9227-4428-a0f2-ad6ee2bde4d7 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=65370) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.801222] env[65370]: DEBUG oslo_service.backend._eventlet.service [None req-7b101f6e-9227-4428-a0f2-ad6ee2bde4d7 None None] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=65370) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.801377] env[65370]: DEBUG oslo_service.backend._eventlet.service [None req-7b101f6e-9227-4428-a0f2-ad6ee2bde4d7 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=65370) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.801511] env[65370]: DEBUG oslo_service.backend._eventlet.service [None req-7b101f6e-9227-4428-a0f2-ad6ee2bde4d7 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=65370) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.801652] env[65370]: DEBUG oslo_service.backend._eventlet.service [None req-7b101f6e-9227-4428-a0f2-ad6ee2bde4d7 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=65370) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.801779] env[65370]: DEBUG oslo_service.backend._eventlet.service [None req-7b101f6e-9227-4428-a0f2-ad6ee2bde4d7 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=65370) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.801915] env[65370]: DEBUG oslo_service.backend._eventlet.service [None req-7b101f6e-9227-4428-a0f2-ad6ee2bde4d7 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=65370) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.802058] env[65370]: DEBUG oslo_service.backend._eventlet.service [None req-7b101f6e-9227-4428-a0f2-ad6ee2bde4d7 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=65370) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.802195] env[65370]: DEBUG oslo_service.backend._eventlet.service [None req-7b101f6e-9227-4428-a0f2-ad6ee2bde4d7 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=65370) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.802328] env[65370]: DEBUG oslo_service.backend._eventlet.service [None req-7b101f6e-9227-4428-a0f2-ad6ee2bde4d7 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=65370) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.802468] env[65370]: DEBUG oslo_service.backend._eventlet.service [None req-7b101f6e-9227-4428-a0f2-ad6ee2bde4d7 None None] oslo_messaging_rabbit.processname = neutron-nsxv3-agent {{(pid=65370) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.802604] env[65370]: DEBUG oslo_service.backend._eventlet.service [None req-7b101f6e-9227-4428-a0f2-ad6ee2bde4d7 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=65370) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.802736] env[65370]: DEBUG oslo_service.backend._eventlet.service [None req-7b101f6e-9227-4428-a0f2-ad6ee2bde4d7 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=65370) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.802874] env[65370]: DEBUG oslo_service.backend._eventlet.service [None req-7b101f6e-9227-4428-a0f2-ad6ee2bde4d7 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=65370) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.803011] env[65370]: DEBUG oslo_service.backend._eventlet.service [None req-7b101f6e-9227-4428-a0f2-ad6ee2bde4d7 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=65370) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.803146] env[65370]: DEBUG oslo_service.backend._eventlet.service [None req-7b101f6e-9227-4428-a0f2-ad6ee2bde4d7 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=65370) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.803272] env[65370]: DEBUG oslo_service.backend._eventlet.service [None req-7b101f6e-9227-4428-a0f2-ad6ee2bde4d7 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=65370) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.803401] env[65370]: DEBUG oslo_service.backend._eventlet.service [None req-7b101f6e-9227-4428-a0f2-ad6ee2bde4d7 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=65370) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.803530] env[65370]: DEBUG oslo_service.backend._eventlet.service [None req-7b101f6e-9227-4428-a0f2-ad6ee2bde4d7 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=65370) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.803658] env[65370]: DEBUG oslo_service.backend._eventlet.service [None req-7b101f6e-9227-4428-a0f2-ad6ee2bde4d7 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=65370) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.803787] env[65370]: DEBUG oslo_service.backend._eventlet.service [None req-7b101f6e-9227-4428-a0f2-ad6ee2bde4d7 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=65370) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.803912] env[65370]: DEBUG oslo_service.backend._eventlet.service [None req-7b101f6e-9227-4428-a0f2-ad6ee2bde4d7 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=65370) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.804048] env[65370]: DEBUG oslo_service.backend._eventlet.service [None req-7b101f6e-9227-4428-a0f2-ad6ee2bde4d7 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=65370) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.804180] env[65370]: DEBUG oslo_service.backend._eventlet.service [None req-7b101f6e-9227-4428-a0f2-ad6ee2bde4d7 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=65370) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.804303] env[65370]: DEBUG oslo_service.backend._eventlet.service [None req-7b101f6e-9227-4428-a0f2-ad6ee2bde4d7 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=65370) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.804461] env[65370]: DEBUG oslo_service.backend._eventlet.service [None req-7b101f6e-9227-4428-a0f2-ad6ee2bde4d7 None None] oslo_messaging_rabbit.ssl = False {{(pid=65370) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.804600] env[65370]: DEBUG oslo_service.backend._eventlet.service [None req-7b101f6e-9227-4428-a0f2-ad6ee2bde4d7 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=65370) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.804734] env[65370]: DEBUG oslo_service.backend._eventlet.service [None req-7b101f6e-9227-4428-a0f2-ad6ee2bde4d7 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=65370) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.804864] env[65370]: DEBUG oslo_service.backend._eventlet.service [None req-7b101f6e-9227-4428-a0f2-ad6ee2bde4d7 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=65370) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.804999] env[65370]: DEBUG oslo_service.backend._eventlet.service [None req-7b101f6e-9227-4428-a0f2-ad6ee2bde4d7 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=65370) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.805149] env[65370]: DEBUG oslo_service.backend._eventlet.service [None req-7b101f6e-9227-4428-a0f2-ad6ee2bde4d7 None None] oslo_messaging_rabbit.ssl_version = {{(pid=65370) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.805279] env[65370]: DEBUG oslo_service.backend._eventlet.service [None req-7b101f6e-9227-4428-a0f2-ad6ee2bde4d7 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=65370) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.805418] env[65370]: DEBUG oslo_service.backend._eventlet.service [None req-7b101f6e-9227-4428-a0f2-ad6ee2bde4d7 None None] oslo_messaging_notifications.driver = [] {{(pid=65370) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.805579] env[65370]: DEBUG oslo_service.backend._eventlet.service [None req-7b101f6e-9227-4428-a0f2-ad6ee2bde4d7 None None] oslo_messaging_notifications.retry = -1 {{(pid=65370) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.805738] env[65370]: DEBUG oslo_service.backend._eventlet.service [None req-7b101f6e-9227-4428-a0f2-ad6ee2bde4d7 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=65370) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.805871] env[65370]: DEBUG oslo_service.backend._eventlet.service [None req-7b101f6e-9227-4428-a0f2-ad6ee2bde4d7 None None] oslo_messaging_notifications.transport_url = **** {{(pid=65370) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.805972] env[65370]: DEBUG oslo_service.backend._eventlet.service [None req-7b101f6e-9227-4428-a0f2-ad6ee2bde4d7 None None] ******************************************************************************** {{(pid=65370) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2828}} [ 529.807075] env[65370]: DEBUG neutron.agent.securitygroups_rpc [None req-22548ca9-c949-4428-b53c-fd85bd762917 None None] Init firewall settings (driver=nsxv3) {{(pid=65370) init_firewall /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:137}} [ 529.808342] env[65370]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.extensions.firewall [None req-22548ca9-c949-4428-b53c-fd85bd762917 None None] Initializing NSXv3SecurityGroupsDriver dummy driver. {{(pid=65370) __init__ /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/extensions/firewall.py:16}} [ 529.808570] env[65370]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-22548ca9-c949-4428-b53c-fd85bd762917 None None] RPC agent_id: nsxm-l-01a.corp.local [ 529.810730] env[65370]: DEBUG dogpile.cache.region [None req-22548ca9-c949-4428-b53c-fd85bd762917 None None] No value present for key: 'zone-id' {{(pid=65370) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 529.810855] env[65370]: DEBUG dogpile.lock [None req-22548ca9-c949-4428-b53c-fd85bd762917 None None] NeedRegenerationException {{(pid=65370) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 529.810950] env[65370]: DEBUG dogpile.lock [None req-22548ca9-c949-4428-b53c-fd85bd762917 None None] no value, waiting for create lock {{(pid=65370) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 529.811050] env[65370]: DEBUG dogpile.lock [None req-22548ca9-c949-4428-b53c-fd85bd762917 None None] value creation lock acquired {{(pid=65370) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 529.811142] env[65370]: DEBUG dogpile.cache.region [None req-22548ca9-c949-4428-b53c-fd85bd762917 None None] No value present for key: 'zone-id' {{(pid=65370) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 529.811224] env[65370]: DEBUG dogpile.lock [None req-22548ca9-c949-4428-b53c-fd85bd762917 None None] Calling creation function for not-yet-present value {{(pid=65370) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 529.811342] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-22548ca9-c949-4428-b53c-fd85bd762917 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 529.831817] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-22548ca9-c949-4428-b53c-fd85bd762917 None None] Session token - acquiring [ 529.833390] env[65370]: DEBUG networking_nsxv3.common.locking [None req-22548ca9-c949-4428-b53c-fd85bd762917 None None] Lock https://nsxt.osci.c.eu-de-1.cloud.sap:443 taken with stack trace [, , , , , , , , , , , , , , , , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 529.833588] env[65370]: DEBUG oslo_concurrency.lockutils [None req-22548ca9-c949-4428-b53c-fd85bd762917 None None] Acquiring lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 529.833656] env[65370]: DEBUG oslo_concurrency.lockutils [None req-22548ca9-c949-4428-b53c-fd85bd762917 None None] Acquired lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 529.834072] env[65370]: DEBUG oslo_concurrency.lockutils [None req-22548ca9-c949-4428-b53c-fd85bd762917 None None] Acquired external semaphore "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 529.845584] env[65370]: DEBUG oslo_concurrency.lockutils [None req-22548ca9-c949-4428-b53c-fd85bd762917 None None] Releasing lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 530.141630] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-22548ca9-c949-4428-b53c-fd85bd762917 None None] Session token - acquired, connected to NSX-T 4.1.2.0.0.22589037 [ 530.166391] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-22548ca9-c949-4428-b53c-fd85bd762917 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 530.166572] env[65370]: DEBUG dogpile.cache.region [None req-22548ca9-c949-4428-b53c-fd85bd762917 None None] Cache value generated in 0.355 seconds for key(s): 'zone-id' {{(pid=65370) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 530.166636] env[65370]: DEBUG dogpile.lock [None req-22548ca9-c949-4428-b53c-fd85bd762917 None None] Released creation lock {{(pid=65370) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 530.166755] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-22548ca9-c949-4428-b53c-fd85bd762917 None None] Activating Policy API Provider. [ 530.166917] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-22548ca9-c949-4428-b53c-fd85bd762917 None None] Looking for the default Infrastructure Rules. [ 530.243876] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-22548ca9-c949-4428-b53c-fd85bd762917 None None] Looking for the Default Layer3 Logged Drop Section. [ 530.264138] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [None req-22548ca9-c949-4428-b53c-fd85bd762917 None None] Detected NSX-T (4, 1, 2, 0, 0, 22589037) version. [ 530.264614] env[65370]: DEBUG networking_nsxv3.common.locking [None req-22548ca9-c949-4428-b53c-fd85bd762917 None None] Lock all taken with stack trace [, , , , , , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 530.264781] env[65370]: DEBUG oslo_concurrency.lockutils [None req-22548ca9-c949-4428-b53c-fd85bd762917 None None] Acquiring lock "all" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 530.264878] env[65370]: DEBUG oslo_concurrency.lockutils [None req-22548ca9-c949-4428-b53c-fd85bd762917 None None] Acquired lock "all" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 530.265178] env[65370]: DEBUG oslo_concurrency.lockutils [None req-22548ca9-c949-4428-b53c-fd85bd762917 None None] Acquired external semaphore "all" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 530.265557] env[65370]: DEBUG networking_nsxv3.api.rpc [None req-22548ca9-c949-4428-b53c-fd85bd762917 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_ports_with_revisions called with arguments (1000, 0) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 530.780110] env[65370]: DEBUG networking_nsxv3.api.rpc [None req-22548ca9-c949-4428-b53c-fd85bd762917 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_groups_with_revisions called with arguments (1000, 0) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 531.282532] env[65370]: DEBUG networking_nsxv3.api.rpc [None req-22548ca9-c949-4428-b53c-fd85bd762917 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_qos_policies_with_revisions called with arguments (1000, 0) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 531.785082] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [None req-22548ca9-c949-4428-b53c-fd85bd762917 None None] Inventory metadata is going to be refreshed. [ 531.785514] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-22548ca9-c949-4428-b53c-fd85bd762917 None None] [Policy] Fetching Policy NSX-T metadata for Type:Segment. [ 532.656030] env[65370]: DEBUG networking_nsxv3.common.locking [None req-22548ca9-c949-4428-b53c-fd85bd762917 None None] Lock Segment taken with stack trace [, , , , , , , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 532.656346] env[65370]: DEBUG oslo_concurrency.lockutils [None req-22548ca9-c949-4428-b53c-fd85bd762917 None None] Acquiring lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 532.656346] env[65370]: DEBUG oslo_concurrency.lockutils [None req-22548ca9-c949-4428-b53c-fd85bd762917 None None] Acquired lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 532.656633] env[65370]: DEBUG oslo_concurrency.lockutils [None req-22548ca9-c949-4428-b53c-fd85bd762917 None None] Acquired external semaphore "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 532.667417] env[65370]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider [None req-22548ca9-c949-4428-b53c-fd85bd762917 None None] Duplicate resource with OS_ID: 992 ID: cl2-zone-992 [ 532.668304] env[65370]: DEBUG oslo_concurrency.lockutils [None req-22548ca9-c949-4428-b53c-fd85bd762917 None None] Releasing lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 532.669148] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-22548ca9-c949-4428-b53c-fd85bd762917 None None] [Policy] Fetching Policy NSX-T metadata for Type:SegmentPort. [ 532.689719] env[65370]: DEBUG networking_nsxv3.common.locking [None req-22548ca9-c949-4428-b53c-fd85bd762917 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 532.689956] env[65370]: DEBUG oslo_concurrency.lockutils [None req-22548ca9-c949-4428-b53c-fd85bd762917 None None] Acquiring lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 532.689956] env[65370]: DEBUG oslo_concurrency.lockutils [None req-22548ca9-c949-4428-b53c-fd85bd762917 None None] Acquired lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 532.690278] env[65370]: DEBUG oslo_concurrency.lockutils [None req-22548ca9-c949-4428-b53c-fd85bd762917 None None] Acquired external semaphore "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 532.690402] env[65370]: DEBUG oslo_concurrency.lockutils [None req-22548ca9-c949-4428-b53c-fd85bd762917 None None] Releasing lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 532.690554] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-22548ca9-c949-4428-b53c-fd85bd762917 None None] [Policy] The number of outdated resources for Type:SegmentPort Is:0. [ 532.690748] env[65370]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-22548ca9-c949-4428-b53c-fd85bd762917 None None] Outdated resources of Type:SegmentPort Are:set() {{(pid=65370) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 532.690844] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-22548ca9-c949-4428-b53c-fd85bd762917 None None] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules). [ 532.711133] env[65370]: DEBUG networking_nsxv3.common.locking [None req-22548ca9-c949-4428-b53c-fd85bd762917 None None] Lock Security Group (Rules) taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 532.711388] env[65370]: DEBUG oslo_concurrency.lockutils [None req-22548ca9-c949-4428-b53c-fd85bd762917 None None] Acquiring lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 532.711388] env[65370]: DEBUG oslo_concurrency.lockutils [None req-22548ca9-c949-4428-b53c-fd85bd762917 None None] Acquired lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 532.711684] env[65370]: DEBUG oslo_concurrency.lockutils [None req-22548ca9-c949-4428-b53c-fd85bd762917 None None] Acquired external semaphore "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 532.711891] env[65370]: DEBUG oslo_concurrency.lockutils [None req-22548ca9-c949-4428-b53c-fd85bd762917 None None] Releasing lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 532.712049] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-22548ca9-c949-4428-b53c-fd85bd762917 None None] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules Remote IP Prefix). [ 532.730641] env[65370]: DEBUG networking_nsxv3.common.locking [None req-22548ca9-c949-4428-b53c-fd85bd762917 None None] Lock Security Group (Rules Remote IP Prefix) taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 532.730873] env[65370]: DEBUG oslo_concurrency.lockutils [None req-22548ca9-c949-4428-b53c-fd85bd762917 None None] Acquiring lock "Security Group (Rules Remote IP Prefix)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 532.730915] env[65370]: DEBUG oslo_concurrency.lockutils [None req-22548ca9-c949-4428-b53c-fd85bd762917 None None] Acquired lock "Security Group (Rules Remote IP Prefix)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 532.731190] env[65370]: DEBUG oslo_concurrency.lockutils [None req-22548ca9-c949-4428-b53c-fd85bd762917 None None] Acquired external semaphore "Security Group (Rules Remote IP Prefix)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 532.731329] env[65370]: DEBUG oslo_concurrency.lockutils [None req-22548ca9-c949-4428-b53c-fd85bd762917 None None] Releasing lock "Security Group (Rules Remote IP Prefix)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 532.731467] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-22548ca9-c949-4428-b53c-fd85bd762917 None None] [Policy] Fetching Policy NSX-T metadata for Type:Address Group. [ 532.750907] env[65370]: DEBUG networking_nsxv3.common.locking [None req-22548ca9-c949-4428-b53c-fd85bd762917 None None] Lock Address Group taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 532.751158] env[65370]: DEBUG oslo_concurrency.lockutils [None req-22548ca9-c949-4428-b53c-fd85bd762917 None None] Acquiring lock "Address Group" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 532.751158] env[65370]: DEBUG oslo_concurrency.lockutils [None req-22548ca9-c949-4428-b53c-fd85bd762917 None None] Acquired lock "Address Group" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 532.751455] env[65370]: DEBUG oslo_concurrency.lockutils [None req-22548ca9-c949-4428-b53c-fd85bd762917 None None] Acquired external semaphore "Address Group" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 532.751595] env[65370]: DEBUG oslo_concurrency.lockutils [None req-22548ca9-c949-4428-b53c-fd85bd762917 None None] Releasing lock "Address Group" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 532.751740] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-22548ca9-c949-4428-b53c-fd85bd762917 None None] [Policy] The number of outdated resources for Type:Security Group (Rules) Is:0. [ 532.751840] env[65370]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-22548ca9-c949-4428-b53c-fd85bd762917 None None] Outdated resources of Type:Security Group (Rules) Are:set() {{(pid=65370) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 532.751938] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-22548ca9-c949-4428-b53c-fd85bd762917 None None] [Policy] Fetching Policy NSX-T metadata for Type:Segment QoS. [ 532.770171] env[65370]: DEBUG networking_nsxv3.common.locking [None req-22548ca9-c949-4428-b53c-fd85bd762917 None None] Lock Segment QoS taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 532.770388] env[65370]: DEBUG oslo_concurrency.lockutils [None req-22548ca9-c949-4428-b53c-fd85bd762917 None None] Acquiring lock "Segment QoS" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 532.770447] env[65370]: DEBUG oslo_concurrency.lockutils [None req-22548ca9-c949-4428-b53c-fd85bd762917 None None] Acquired lock "Segment QoS" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 532.770709] env[65370]: DEBUG oslo_concurrency.lockutils [None req-22548ca9-c949-4428-b53c-fd85bd762917 None None] Acquired external semaphore "Segment QoS" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 532.770820] env[65370]: DEBUG oslo_concurrency.lockutils [None req-22548ca9-c949-4428-b53c-fd85bd762917 None None] Releasing lock "Segment QoS" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 532.770958] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-22548ca9-c949-4428-b53c-fd85bd762917 None None] [Policy] The number of outdated resources for Type:Segment QoS Is:0. [ 532.771067] env[65370]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-22548ca9-c949-4428-b53c-fd85bd762917 None None] Outdated resources of Type:Segment QoS Are:set() {{(pid=65370) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 532.771170] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-22548ca9-c949-4428-b53c-fd85bd762917 None None] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Members). [ 532.800370] env[65370]: DEBUG networking_nsxv3.common.locking [None req-22548ca9-c949-4428-b53c-fd85bd762917 None None] Lock Security Group (Members) taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 532.800806] env[65370]: DEBUG oslo_concurrency.lockutils [None req-22548ca9-c949-4428-b53c-fd85bd762917 None None] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 532.800806] env[65370]: DEBUG oslo_concurrency.lockutils [None req-22548ca9-c949-4428-b53c-fd85bd762917 None None] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 532.801088] env[65370]: DEBUG oslo_concurrency.lockutils [None req-22548ca9-c949-4428-b53c-fd85bd762917 None None] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 532.801187] env[65370]: DEBUG oslo_concurrency.lockutils [None req-22548ca9-c949-4428-b53c-fd85bd762917 None None] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 532.801340] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-22548ca9-c949-4428-b53c-fd85bd762917 None None] [Policy] The number of outdated resources for Type:Security Group (Members) Is:0. [ 532.801444] env[65370]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-22548ca9-c949-4428-b53c-fd85bd762917 None None] Outdated resources of Type:Security Group (Members) Are:set() {{(pid=65370) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 532.801542] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [None req-22548ca9-c949-4428-b53c-fd85bd762917 None None] Inventory metadata have been refreshed. [ 532.801632] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [None req-22548ca9-c949-4428-b53c-fd85bd762917 None None] Dryrun:True. Metadata refresh completed. [ 532.801745] env[65370]: DEBUG oslo_concurrency.lockutils [None req-22548ca9-c949-4428-b53c-fd85bd762917 None None] Releasing lock "all" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 532.803957] env[65370]: INFO neutron.agent.agent_extensions_manager [None req-22548ca9-c949-4428-b53c-fd85bd762917 None None] Loaded agent extensions: [] [ 532.804925] env[65370]: DEBUG neutron_lib.callbacks.manager [None req-22548ca9-c949-4428-b53c-fd85bd762917 None None] Publish callbacks [] for NSXv3 Agent (None), after_init {{(pid=65370) _notify_loop /opt/stack/data/venv/lib/python3.10/site-packages/neutron_lib/callbacks/manager.py:184}} [ 532.853078] env[65370]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-22548ca9-c949-4428-b53c-fd85bd762917 None None] NSXv3 Agent Agent RPC Daemon Started! [ 532.853289] env[65370]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-22548ca9-c949-4428-b53c-fd85bd762917 None None] NSXv3 Agent Agent loop - iteration:0 started [ 532.853289] env[65370]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-22548ca9-c949-4428-b53c-fd85bd762917 None None] NSXv3 Agent Agent out of sync with plugin! [ 537.805672] env[65370]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 537.805989] env[65370]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 542.807365] env[65370]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 542.807365] env[65370]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 542.807886] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock all taken with stack trace [, , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 542.808040] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "all" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 542.808115] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "all" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 542.808496] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "all" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 542.808694] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_ports_with_revisions called with arguments (1000, 0) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 543.310856] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_groups_with_revisions called with arguments (1000, 0) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 543.812966] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_qos_policies_with_revisions called with arguments (1000, 0) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 544.315331] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Inventory metadata is going to be refreshed. [ 544.315551] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Segment. [ 545.078558] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 545.079020] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 545.079020] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 545.079020] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 545.089775] env[65370]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider [-] Duplicate resource with OS_ID: 992 ID: cl2-zone-992 [ 545.090624] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 545.091504] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:SegmentPort. [ 545.107574] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 545.107761] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 545.107856] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 545.107986] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 545.108086] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 545.108196] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:SegmentPort Is:0. [ 545.108267] env[65370]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:SegmentPort Are:set() {{(pid=65370) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 545.108339] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules). [ 545.128509] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 545.128713] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 545.128752] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 545.128995] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 545.129119] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 545.129230] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules Remote IP Prefix). [ 545.149321] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules Remote IP Prefix) taken with stack trace [, , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 545.149511] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules Remote IP Prefix)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 545.149569] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules Remote IP Prefix)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 545.149743] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules Remote IP Prefix)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 545.149851] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules Remote IP Prefix)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 545.149957] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Address Group. [ 545.169077] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Address Group taken with stack trace [, , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 545.169264] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Address Group" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 545.169302] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Address Group" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 545.169492] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Address Group" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 545.169604] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Address Group" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 545.169716] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Security Group (Rules) Is:0. [ 545.169787] env[65370]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Security Group (Rules) Are:set() {{(pid=65370) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 545.169853] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Segment QoS. [ 545.186600] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Segment QoS taken with stack trace [, , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 545.186797] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment QoS" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 545.186861] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment QoS" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 545.187021] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment QoS" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 545.187107] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment QoS" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 545.187211] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Segment QoS Is:0. [ 545.187282] env[65370]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Segment QoS Are:set() {{(pid=65370) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 545.187352] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Members). [ 545.205880] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 545.206108] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 545.206108] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 545.206274] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 545.206377] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 545.206491] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Security Group (Members) Is:0. [ 545.206554] env[65370]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Security Group (Members) Are:set() {{(pid=65370) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 545.206621] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Inventory metadata have been refreshed. [ 545.206681] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 0/0 resources of Type:Ports [ 545.206853] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 0/0 resources of Type:Security Group Rules [ 545.206928] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 0/0 resources of Type:Security Group Members [ 545.206985] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 0/0 resources of Type:QoS [ 545.207326] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Items outdated since last Agent sanitize:0 [ 545.207326] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Sanitizing provider based on age cycles [ 545.207468] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules Remote IP Prefix). [ 545.226050] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules Remote IP Prefix) taken with stack trace [, , , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 545.226247] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules Remote IP Prefix)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 545.226287] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules Remote IP Prefix)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 545.226469] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules Remote IP Prefix)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 545.226572] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules Remote IP Prefix)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 545.226679] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Address Group. [ 545.245921] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Address Group taken with stack trace [, , , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 545.246127] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Address Group" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 545.246245] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Address Group" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 545.246523] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Address Group" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 545.246697] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Address Group" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 545.283564] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "all" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 547.564361] env[65370]: INFO networking_nsxv3.common.synchronization [None req-7c9e961c-f21e-48f7-9766-4074c34d15ae demo admin] Enqueued Resource ID: 2669b649-46ba-4138-bc32-87ef16e6848c with Priority: HIGHEST for action security_group_rules [ 547.565077] env[65370]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2669b649-46ba-4138-bc32-87ef16e6848c with Priority: HIGHEST for action security_group_rules [ 547.565271] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock rules-2669b649-46ba-4138-bc32-87ef16e6848c taken with stack trace [, , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 547.565424] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-2669b649-46ba-4138-bc32-87ef16e6848c" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 547.565543] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-2669b649-46ba-4138-bc32-87ef16e6848c" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 547.565745] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-2669b649-46ba-4138-bc32-87ef16e6848c" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 547.565827] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('2669b649-46ba-4138-bc32-87ef16e6848c',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 548.091593] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 548.091843] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 548.091843] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 548.092140] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 548.092321] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 548.092494] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 2669b649-46ba-4138-bc32-87ef16e6848c already deleted. [ 548.092676] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-2669b649-46ba-4138-bc32-87ef16e6848c" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 552.566049] env[65370]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 552.566483] env[65370]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 557.567490] env[65370]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 557.567766] env[65370]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 562.568892] env[65370]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 562.569255] env[65370]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 567.569840] env[65370]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 567.570312] env[65370]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 571.571347] env[65370]: INFO networking_nsxv3.common.synchronization [None req-d07c22a3-6c26-4c07-a54e-0a346338d00e None None] Enqueued Resource ID: 61f2f1b8-b4ae-4cdf-b87b-df3aeba51893 with Priority: HIGHEST for action port [ 571.571635] env[65370]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 61f2f1b8-b4ae-4cdf-b87b-df3aeba51893 with Priority: HIGHEST for action port [ 571.572072] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock port-61f2f1b8-b4ae-4cdf-b87b-df3aeba51893 taken with stack trace [, , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 571.572408] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-61f2f1b8-b4ae-4cdf-b87b-df3aeba51893" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 571.572408] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-61f2f1b8-b4ae-4cdf-b87b-df3aeba51893" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 571.572546] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-61f2f1b8-b4ae-4cdf-b87b-df3aeba51893" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 571.572630] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('61f2f1b8-b4ae-4cdf-b87b-df3aeba51893',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 571.742593] env[65370]: INFO networking_nsxv3.common.synchronization [None req-7a673c84-89a5-4ad8-9f8b-1ee025dcefad None None] Enqueued Resource ID: 6df2d634-f667-49d8-8c2d-3aa1507bdebd with Priority: HIGHEST for action port [ 571.743137] env[65370]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6df2d634-f667-49d8-8c2d-3aa1507bdebd with Priority: HIGHEST for action port [ 571.743378] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock port-6df2d634-f667-49d8-8c2d-3aa1507bdebd taken with stack trace [, , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 571.743552] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-6df2d634-f667-49d8-8c2d-3aa1507bdebd" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 571.743598] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-6df2d634-f667-49d8-8c2d-3aa1507bdebd" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 571.743918] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-6df2d634-f667-49d8-8c2d-3aa1507bdebd" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 571.743918] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6df2d634-f667-49d8-8c2d-3aa1507bdebd',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 572.074873] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 61f2f1b8-b4ae-4cdf-b87b-df3aeba51893 [ 572.075169] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 572.075347] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 572.075477] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 572.075729] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 572.075859] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 572.075982] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:61f2f1b8-b4ae-4cdf-b87b-df3aeba51893 already deleted. [ 572.076108] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-61f2f1b8-b4ae-4cdf-b87b-df3aeba51893" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 572.246805] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 6df2d634-f667-49d8-8c2d-3aa1507bdebd [ 572.247113] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 572.247254] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 572.247316] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 572.247529] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 572.247622] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 572.247716] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:6df2d634-f667-49d8-8c2d-3aa1507bdebd already deleted. [ 572.247797] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-6df2d634-f667-49d8-8c2d-3aa1507bdebd" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 573.777817] env[65370]: INFO networking_nsxv3.common.synchronization [None req-ccef098a-8123-47c6-9602-ca7293c6c550 None None] Enqueued Resource ID: 3fd68742-fa94-4456-891f-1a0baaf1a058 with Priority: HIGHEST for action port [ 573.778182] env[65370]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3fd68742-fa94-4456-891f-1a0baaf1a058 with Priority: HIGHEST for action port [ 573.778649] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock port-3fd68742-fa94-4456-891f-1a0baaf1a058 taken with stack trace [, , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 573.778741] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-3fd68742-fa94-4456-891f-1a0baaf1a058" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 573.778863] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-3fd68742-fa94-4456-891f-1a0baaf1a058" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 573.781176] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-3fd68742-fa94-4456-891f-1a0baaf1a058" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 573.781176] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3fd68742-fa94-4456-891f-1a0baaf1a058',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 574.281421] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 3fd68742-fa94-4456-891f-1a0baaf1a058 [ 574.281653] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 574.281796] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 574.281932] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 574.282095] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 574.282193] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 574.282276] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:3fd68742-fa94-4456-891f-1a0baaf1a058 already deleted. [ 574.282359] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-3fd68742-fa94-4456-891f-1a0baaf1a058" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 574.644093] env[65370]: INFO networking_nsxv3.common.synchronization [None req-140fa5af-802f-4455-8b6d-d4395b519975 None None] Enqueued Resource ID: c98fc30b-4511-4db2-b36e-a18cddd265b2 with Priority: HIGHEST for action port [ 574.644874] env[65370]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c98fc30b-4511-4db2-b36e-a18cddd265b2 with Priority: HIGHEST for action port [ 574.646248] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock port-c98fc30b-4511-4db2-b36e-a18cddd265b2 taken with stack trace [, , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 574.646248] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-c98fc30b-4511-4db2-b36e-a18cddd265b2" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 574.646248] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-c98fc30b-4511-4db2-b36e-a18cddd265b2" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 574.647616] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-c98fc30b-4511-4db2-b36e-a18cddd265b2" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 574.647616] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c98fc30b-4511-4db2-b36e-a18cddd265b2',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 575.149532] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port c98fc30b-4511-4db2-b36e-a18cddd265b2 [ 575.149855] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 575.150075] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 575.150075] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 575.150223] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 575.150274] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 575.150378] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:c98fc30b-4511-4db2-b36e-a18cddd265b2 already deleted. [ 575.150458] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-c98fc30b-4511-4db2-b36e-a18cddd265b2" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 579.337736] env[65370]: INFO networking_nsxv3.common.synchronization [None req-d8859d04-7649-4cb4-b7f3-1f034645f45c None None] Enqueued Resource ID: 7308befd-3761-4aac-8a0d-ee1a0248173d with Priority: HIGHEST for action port [ 579.338343] env[65370]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7308befd-3761-4aac-8a0d-ee1a0248173d with Priority: HIGHEST for action port [ 579.338735] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock port-7308befd-3761-4aac-8a0d-ee1a0248173d taken with stack trace [, , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 579.338964] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-7308befd-3761-4aac-8a0d-ee1a0248173d" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 579.339008] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-7308befd-3761-4aac-8a0d-ee1a0248173d" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 579.339762] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-7308befd-3761-4aac-8a0d-ee1a0248173d" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 579.339762] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7308befd-3761-4aac-8a0d-ee1a0248173d',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 579.415162] env[65370]: INFO networking_nsxv3.common.synchronization [None req-e9b02c93-ed13-487d-ba0c-07285e83bed7 None None] Enqueued Resource ID: 14b84f1c-6362-44fd-a435-9a801d118237 with Priority: HIGHEST for action port [ 579.415162] env[65370]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 14b84f1c-6362-44fd-a435-9a801d118237 with Priority: HIGHEST for action port [ 579.415654] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock port-14b84f1c-6362-44fd-a435-9a801d118237 taken with stack trace [, , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 579.416127] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-14b84f1c-6362-44fd-a435-9a801d118237" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 579.416127] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-14b84f1c-6362-44fd-a435-9a801d118237" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 579.416271] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-14b84f1c-6362-44fd-a435-9a801d118237" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 579.416446] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('14b84f1c-6362-44fd-a435-9a801d118237',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 579.842088] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 7308befd-3761-4aac-8a0d-ee1a0248173d [ 579.842331] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 579.842489] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 579.842565] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 579.842781] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 579.842985] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 579.842985] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:7308befd-3761-4aac-8a0d-ee1a0248173d already deleted. [ 579.843109] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-7308befd-3761-4aac-8a0d-ee1a0248173d" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 579.918772] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 14b84f1c-6362-44fd-a435-9a801d118237 [ 579.919163] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 579.919312] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 579.919381] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 579.919712] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 579.919875] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 579.919980] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:14b84f1c-6362-44fd-a435-9a801d118237 already deleted. [ 579.920079] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-14b84f1c-6362-44fd-a435-9a801d118237" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 580.353058] env[65370]: INFO networking_nsxv3.common.synchronization [None req-beb9cc64-f5af-4ee2-af4f-18908fa6f50c None None] Enqueued Resource ID: 29472257-d564-4672-846c-a4d96be113a1 with Priority: HIGHEST for action port [ 580.353359] env[65370]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 29472257-d564-4672-846c-a4d96be113a1 with Priority: HIGHEST for action port [ 580.353895] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock port-29472257-d564-4672-846c-a4d96be113a1 taken with stack trace [, , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 580.354030] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-29472257-d564-4672-846c-a4d96be113a1" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 580.354095] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-29472257-d564-4672-846c-a4d96be113a1" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 580.354337] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-29472257-d564-4672-846c-a4d96be113a1" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 580.354417] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('29472257-d564-4672-846c-a4d96be113a1',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 580.858324] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 29472257-d564-4672-846c-a4d96be113a1 [ 580.858598] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 580.858805] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 580.858805] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 580.859031] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 580.859128] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 580.859241] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:29472257-d564-4672-846c-a4d96be113a1 already deleted. [ 580.859335] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-29472257-d564-4672-846c-a4d96be113a1" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 581.844071] env[65370]: INFO networking_nsxv3.common.synchronization [None req-35f0c340-5bb5-49b3-a96a-8f2bc1c8f804 None None] Enqueued Resource ID: 3e36114c-5d7d-4e37-9190-9a4e94f7c2c1 with Priority: HIGHEST for action port [ 581.845293] env[65370]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3e36114c-5d7d-4e37-9190-9a4e94f7c2c1 with Priority: HIGHEST for action port [ 581.845503] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock port-3e36114c-5d7d-4e37-9190-9a4e94f7c2c1 taken with stack trace [, , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 581.845653] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-3e36114c-5d7d-4e37-9190-9a4e94f7c2c1" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 581.845723] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-3e36114c-5d7d-4e37-9190-9a4e94f7c2c1" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 581.845962] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-3e36114c-5d7d-4e37-9190-9a4e94f7c2c1" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 581.850311] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3e36114c-5d7d-4e37-9190-9a4e94f7c2c1',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 582.354410] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 3e36114c-5d7d-4e37-9190-9a4e94f7c2c1 [ 582.356298] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 582.356298] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 582.356298] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 582.356298] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 582.356298] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 582.356298] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:3e36114c-5d7d-4e37-9190-9a4e94f7c2c1 already deleted. [ 582.356298] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-3e36114c-5d7d-4e37-9190-9a4e94f7c2c1" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 582.462302] env[65370]: INFO networking_nsxv3.common.synchronization [None req-22015353-71eb-4c63-9097-89957232a79d None None] Enqueued Resource ID: 4e5c861d-ec96-475c-b1bd-2e760a351513 with Priority: HIGHEST for action port [ 582.462562] env[65370]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4e5c861d-ec96-475c-b1bd-2e760a351513 with Priority: HIGHEST for action port [ 582.463246] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock port-4e5c861d-ec96-475c-b1bd-2e760a351513 taken with stack trace [, , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 582.463246] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-4e5c861d-ec96-475c-b1bd-2e760a351513" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 582.463412] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-4e5c861d-ec96-475c-b1bd-2e760a351513" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 582.464048] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-4e5c861d-ec96-475c-b1bd-2e760a351513" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 582.464048] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4e5c861d-ec96-475c-b1bd-2e760a351513',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 582.968344] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 4e5c861d-ec96-475c-b1bd-2e760a351513 [ 582.968634] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 582.968704] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 582.968799] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 582.968993] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 582.969101] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 582.969197] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:4e5c861d-ec96-475c-b1bd-2e760a351513 already deleted. [ 582.969275] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-4e5c861d-ec96-475c-b1bd-2e760a351513" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 584.028431] env[65370]: INFO networking_nsxv3.common.synchronization [None req-acdc6a73-e4b8-447f-ba0e-1c718b8e5a05 None None] Enqueued Resource ID: aa419c74-3c60-4b67-b2fe-28d5862f2aa5 with Priority: HIGHEST for action port [ 584.028741] env[65370]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: aa419c74-3c60-4b67-b2fe-28d5862f2aa5 with Priority: HIGHEST for action port [ 584.029292] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock port-aa419c74-3c60-4b67-b2fe-28d5862f2aa5 taken with stack trace [, , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 584.029403] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-aa419c74-3c60-4b67-b2fe-28d5862f2aa5" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 584.029475] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-aa419c74-3c60-4b67-b2fe-28d5862f2aa5" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 584.029717] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-aa419c74-3c60-4b67-b2fe-28d5862f2aa5" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 584.029798] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('aa419c74-3c60-4b67-b2fe-28d5862f2aa5',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 584.449565] env[65370]: INFO networking_nsxv3.common.synchronization [None req-00e63c6f-b7fa-4800-b032-4b039ddb9d66 None None] Enqueued Resource ID: 47c56c27-36c6-4ce7-ad8f-90ebfc681dae with Priority: HIGHEST for action port [ 584.449565] env[65370]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 47c56c27-36c6-4ce7-ad8f-90ebfc681dae with Priority: HIGHEST for action port [ 584.449968] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock port-47c56c27-36c6-4ce7-ad8f-90ebfc681dae taken with stack trace [, , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 584.450120] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-47c56c27-36c6-4ce7-ad8f-90ebfc681dae" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 584.450247] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-47c56c27-36c6-4ce7-ad8f-90ebfc681dae" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 584.450627] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-47c56c27-36c6-4ce7-ad8f-90ebfc681dae" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 584.450627] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('47c56c27-36c6-4ce7-ad8f-90ebfc681dae',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 584.531919] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port aa419c74-3c60-4b67-b2fe-28d5862f2aa5 [ 584.532166] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 584.533149] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 584.533149] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 584.533326] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 584.533326] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 584.534146] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:aa419c74-3c60-4b67-b2fe-28d5862f2aa5 already deleted. [ 584.534146] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-aa419c74-3c60-4b67-b2fe-28d5862f2aa5" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 584.567695] env[65370]: INFO networking_nsxv3.common.synchronization [None req-b38c06fd-53c8-4675-a419-a3c16b011e25 None None] Enqueued Resource ID: bdd18c60-82af-401b-8a39-b5ed090b51b5 with Priority: HIGHEST for action port [ 584.572150] env[65370]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bdd18c60-82af-401b-8a39-b5ed090b51b5 with Priority: HIGHEST for action port [ 584.572621] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock port-bdd18c60-82af-401b-8a39-b5ed090b51b5 taken with stack trace [, , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 584.572768] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-bdd18c60-82af-401b-8a39-b5ed090b51b5" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 584.572883] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-bdd18c60-82af-401b-8a39-b5ed090b51b5" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 584.573215] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-bdd18c60-82af-401b-8a39-b5ed090b51b5" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 584.574498] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('bdd18c60-82af-401b-8a39-b5ed090b51b5',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 584.956108] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 47c56c27-36c6-4ce7-ad8f-90ebfc681dae [ 584.956203] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 584.956320] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 584.956394] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 584.956597] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 584.956688] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 584.956783] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:47c56c27-36c6-4ce7-ad8f-90ebfc681dae already deleted. [ 584.957121] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-47c56c27-36c6-4ce7-ad8f-90ebfc681dae" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 585.077584] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port bdd18c60-82af-401b-8a39-b5ed090b51b5 [ 585.077584] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 585.077584] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 585.077584] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 585.077584] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 585.077584] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 585.077584] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:bdd18c60-82af-401b-8a39-b5ed090b51b5 already deleted. [ 585.077584] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-bdd18c60-82af-401b-8a39-b5ed090b51b5" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 586.174834] env[65370]: INFO networking_nsxv3.common.synchronization [req-37793e8a-21f5-4356-9bfc-910d4fd58f39 req-91ec376c-604a-440b-94f7-137d33a42d5a tempest-ImagesNegativeTestJSON-2112195763 tempest-ImagesNegativeTestJSON-2112195763-project-member] Enqueued Resource ID: 7c93cef4-117c-4bf3-aaf5-07dadeb90a88 with Priority: HIGHEST for action security_group_members [ 586.174834] env[65370]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7c93cef4-117c-4bf3-aaf5-07dadeb90a88 with Priority: HIGHEST for action security_group_members [ 586.174834] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock member-7c93cef4-117c-4bf3-aaf5-07dadeb90a88 taken with stack trace [, , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 586.174834] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7c93cef4-117c-4bf3-aaf5-07dadeb90a88" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 586.175317] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7c93cef4-117c-4bf3-aaf5-07dadeb90a88" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 586.177532] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7c93cef4-117c-4bf3-aaf5-07dadeb90a88" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 586.177719] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 586.177827] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 586.177889] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 586.178064] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 586.178150] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 586.178242] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7c93cef4-117c-4bf3-aaf5-07dadeb90a88',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 586.681091] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 586.683405] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 586.683405] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 586.683405] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 586.683405] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 586.683405] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 586.683405] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 586.683405] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 586.684024] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 586.684024] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 586.684304] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7c93cef4-117c-4bf3-aaf5-07dadeb90a88 already deleted. [ 586.684556] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7c93cef4-117c-4bf3-aaf5-07dadeb90a88" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 586.985261] env[65370]: DEBUG networking_nsxv3.common.locking [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Lock network-722 taken with stack trace [, , , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 586.985261] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquiring lock "network-722" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 586.985508] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquired lock "network-722" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 586.985625] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquired external semaphore "network-722" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 586.985989] env[65370]: DEBUG networking_nsxv3.common.locking [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 586.986194] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquiring lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 586.986350] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquired lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 586.986545] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquired external semaphore "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 586.986682] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Releasing lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 586.986976] env[65370]: DEBUG dogpile.cache.region [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] No value present for key: 'zone-id' {{(pid=65370) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 586.987106] env[65370]: DEBUG dogpile.lock [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] NeedRegenerationException {{(pid=65370) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 586.987270] env[65370]: DEBUG dogpile.lock [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] no value, waiting for create lock {{(pid=65370) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 586.987400] env[65370]: DEBUG dogpile.lock [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] value creation lock acquired {{(pid=65370) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 586.987400] env[65370]: DEBUG dogpile.cache.region [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] No value present for key: 'zone-id' {{(pid=65370) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 586.987502] env[65370]: DEBUG dogpile.lock [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Calling creation function for not-yet-present value {{(pid=65370) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 586.987612] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 587.009984] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 587.010200] env[65370]: DEBUG dogpile.cache.region [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=65370) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 587.010314] env[65370]: DEBUG dogpile.lock [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Released creation lock {{(pid=65370) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 587.010505] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Releasing lock "network-722" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 587.010778] env[65370]: DEBUG networking_nsxv3.common.locking [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Lock port-445bf3d0-8b0b-498f-8a39-afafb64b6f87 taken with stack trace [, , , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 587.010950] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquiring lock "port-445bf3d0-8b0b-498f-8a39-afafb64b6f87" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 587.011079] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquired lock "port-445bf3d0-8b0b-498f-8a39-afafb64b6f87" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 587.011405] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquired external semaphore "port-445bf3d0-8b0b-498f-8a39-afafb64b6f87" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 587.011541] env[65370]: DEBUG networking_nsxv3.api.rpc [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('445bf3d0-8b0b-498f-8a39-afafb64b6f87',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 587.383224] env[65370]: INFO networking_nsxv3.common.synchronization [None req-04a3edba-1e58-4445-8fb9-5bf884003c80 None None] Enqueued Resource ID: 60774565-b684-4e27-9443-3b206806f467 with Priority: HIGHEST for action port [ 587.383778] env[65370]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 60774565-b684-4e27-9443-3b206806f467 with Priority: HIGHEST for action port [ 587.384114] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock port-60774565-b684-4e27-9443-3b206806f467 taken with stack trace [, , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 587.384268] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-60774565-b684-4e27-9443-3b206806f467" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 587.384370] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-60774565-b684-4e27-9443-3b206806f467" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 587.384843] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-60774565-b684-4e27-9443-3b206806f467" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 587.384964] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('60774565-b684-4e27-9443-3b206806f467',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 587.515751] env[65370]: DEBUG networking_nsxv3.common.locking [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 587.515751] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquiring lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 587.515751] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquired lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 587.515751] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquired external semaphore "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 587.515751] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Releasing lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 587.516100] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Segment Port 445bf3d0-8b0b-498f-8a39-afafb64b6f87 not found, creating... [ 587.516100] env[65370]: DEBUG networking_nsxv3.common.locking [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 587.516299] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquiring lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 587.516427] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquired lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 587.516688] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquired external semaphore "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 587.516838] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Releasing lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 587.518488] env[65370]: DEBUG networking_nsxv3.common.locking [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 587.518488] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquiring lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 587.518488] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquired lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 587.518488] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquired external semaphore "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 587.518488] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Releasing lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 587.518488] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Resource: SegmentPort with ID: 445bf3d0-8b0b-498f-8a39-afafb64b6f87 is going to be created. [ 587.558843] env[65370]: DEBUG networking_nsxv3.common.locking [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 587.559508] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquiring lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 587.559508] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquired lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 587.559508] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquired external semaphore "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 587.559685] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Releasing lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 587.559889] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Releasing lock "port-445bf3d0-8b0b-498f-8a39-afafb64b6f87" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 587.630821] env[65370]: INFO networking_nsxv3.common.synchronization [None req-8cf3f5c8-5fb0-494a-b703-ce69677e6737 None None] Enqueued Resource ID: 3c847c9f-f50b-41ee-9485-708936e9259c with Priority: HIGHEST for action port [ 587.631368] env[65370]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3c847c9f-f50b-41ee-9485-708936e9259c with Priority: HIGHEST for action port [ 587.631956] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock port-3c847c9f-f50b-41ee-9485-708936e9259c taken with stack trace [, , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 587.631956] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-3c847c9f-f50b-41ee-9485-708936e9259c" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 587.631956] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-3c847c9f-f50b-41ee-9485-708936e9259c" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 587.634467] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-3c847c9f-f50b-41ee-9485-708936e9259c" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 587.634467] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3c847c9f-f50b-41ee-9485-708936e9259c',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 587.886757] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 60774565-b684-4e27-9443-3b206806f467 [ 587.887087] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 587.887240] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 587.887309] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 587.887523] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 587.887617] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 587.887723] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:60774565-b684-4e27-9443-3b206806f467 already deleted. [ 587.887796] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-60774565-b684-4e27-9443-3b206806f467" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 588.136421] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 3c847c9f-f50b-41ee-9485-708936e9259c [ 588.136627] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 588.136820] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 588.136919] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 588.137255] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 588.137387] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 588.137512] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:3c847c9f-f50b-41ee-9485-708936e9259c already deleted. [ 588.137601] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-3c847c9f-f50b-41ee-9485-708936e9259c" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 588.318288] env[65370]: INFO networking_nsxv3.common.synchronization [req-37793e8a-21f5-4356-9bfc-910d4fd58f39 req-edcc4559-b16e-4935-ad19-8c552a68bb32 service nova] Enqueued Resource ID: 7c93cef4-117c-4bf3-aaf5-07dadeb90a88 with Priority: HIGHEST for action security_group_rules [ 588.318465] env[65370]: INFO networking_nsxv3.common.synchronization [req-37793e8a-21f5-4356-9bfc-910d4fd58f39 req-edcc4559-b16e-4935-ad19-8c552a68bb32 service nova] Enqueued Resource ID: 7c93cef4-117c-4bf3-aaf5-07dadeb90a88 with Priority: HIGHEST for action security_group_members [ 588.318604] env[65370]: INFO networking_nsxv3.common.synchronization [req-37793e8a-21f5-4356-9bfc-910d4fd58f39 req-edcc4559-b16e-4935-ad19-8c552a68bb32 service nova] Enqueued Resource ID: 445bf3d0-8b0b-498f-8a39-afafb64b6f87 with Priority: HIGHEST for action port [ 588.319106] env[65370]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7c93cef4-117c-4bf3-aaf5-07dadeb90a88 with Priority: HIGHEST for action security_group_rules [ 588.319240] env[65370]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7c93cef4-117c-4bf3-aaf5-07dadeb90a88 with Priority: HIGHEST for action security_group_members [ 588.319335] env[65370]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 445bf3d0-8b0b-498f-8a39-afafb64b6f87 with Priority: HIGHEST for action port [ 588.319591] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock rules-7c93cef4-117c-4bf3-aaf5-07dadeb90a88 taken with stack trace [, , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 588.319721] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-7c93cef4-117c-4bf3-aaf5-07dadeb90a88" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 588.319778] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-7c93cef4-117c-4bf3-aaf5-07dadeb90a88" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 588.320016] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-7c93cef4-117c-4bf3-aaf5-07dadeb90a88" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 588.322327] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('7c93cef4-117c-4bf3-aaf5-07dadeb90a88',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 588.324045] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock member-7c93cef4-117c-4bf3-aaf5-07dadeb90a88 taken with stack trace [, , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 588.324173] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7c93cef4-117c-4bf3-aaf5-07dadeb90a88" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 588.326031] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7c93cef4-117c-4bf3-aaf5-07dadeb90a88" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 588.326331] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7c93cef4-117c-4bf3-aaf5-07dadeb90a88" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 588.326493] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 588.327096] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 588.327096] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 588.327096] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 588.327096] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 588.327096] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7c93cef4-117c-4bf3-aaf5-07dadeb90a88',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 588.328149] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock port-445bf3d0-8b0b-498f-8a39-afafb64b6f87 taken with stack trace [, , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 588.328267] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-445bf3d0-8b0b-498f-8a39-afafb64b6f87" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 588.328325] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-445bf3d0-8b0b-498f-8a39-afafb64b6f87" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 588.328474] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-445bf3d0-8b0b-498f-8a39-afafb64b6f87" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 588.328709] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('445bf3d0-8b0b-498f-8a39-afafb64b6f87',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 588.833609] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock member-7c93cef4-117c-4bf3-aaf5-07dadeb90a88 taken with stack trace [, , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 588.833609] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7c93cef4-117c-4bf3-aaf5-07dadeb90a88" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 588.842025] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('7c93cef4-117c-4bf3-aaf5-07dadeb90a88',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 588.843241] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 445bf3d0-8b0b-498f-8a39-afafb64b6f87 with status ACTIVE [ 588.843241] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 588.843241] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 588.843241] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 588.843482] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 588.843482] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 588.843862] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 588.843862] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 588.843862] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 588.844129] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 588.844277] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 588.844369] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 588.844504] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 588.844559] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 588.844731] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 588.844935] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 588.844935] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 445bf3d0-8b0b-498f-8a39-afafb64b6f87 is going to be updated. [ 588.870175] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 588.870175] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 588.870175] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 588.870175] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 588.870175] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 588.870175] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-445bf3d0-8b0b-498f-8a39-afafb64b6f87" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 589.348007] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('7c93cef4-117c-4bf3-aaf5-07dadeb90a88',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 589.424165] env[65370]: INFO networking_nsxv3.common.synchronization [req-6e5e5e7d-7ddc-4e66-95f6-0cd9c4865ecd req-a4fcb9ab-2b21-46c3-b134-1ada53713037 tempest-DeleteServersAdminTestJSON-1719358462 tempest-DeleteServersAdminTestJSON-1719358462-project-member] Enqueued Resource ID: d1777ef4-6140-42f0-bcd4-a267f85cb990 with Priority: HIGHEST for action security_group_members [ 589.424728] env[65370]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d1777ef4-6140-42f0-bcd4-a267f85cb990 with Priority: HIGHEST for action security_group_members [ 589.425130] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock member-d1777ef4-6140-42f0-bcd4-a267f85cb990 taken with stack trace [, , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 589.425274] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d1777ef4-6140-42f0-bcd4-a267f85cb990" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 589.425366] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d1777ef4-6140-42f0-bcd4-a267f85cb990" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 589.425618] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d1777ef4-6140-42f0-bcd4-a267f85cb990" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 589.425787] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 589.425892] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 589.425980] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 589.426124] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 589.426206] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 589.426299] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d1777ef4-6140-42f0-bcd4-a267f85cb990',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 589.853136] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 589.853136] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 589.853136] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 589.853136] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 589.853136] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 589.853136] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7c93cef4-117c-4bf3-aaf5-07dadeb90a88 is going to be created. [ 589.928847] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 589.929507] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 589.929715] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 589.930091] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 589.930491] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 589.930813] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 589.931048] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 589.931364] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 589.931664] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 589.931843] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 589.932027] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d1777ef4-6140-42f0-bcd4-a267f85cb990 already deleted. [ 589.932322] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d1777ef4-6140-42f0-bcd4-a267f85cb990" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 589.934315] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 589.934613] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 589.934891] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 589.935194] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 589.935717] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 589.950227] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7c93cef4-117c-4bf3-aaf5-07dadeb90a88 in Status: UNINITIALIZED for 2s [ 590.233377] env[65370]: INFO networking_nsxv3.common.synchronization [None req-1c4bc4e5-ba8f-4de0-9c71-0455f1884ad2 tempest-VolumesAssistedSnapshotsTest-1217946812 tempest-VolumesAssistedSnapshotsTest-1217946812-project-member] Enqueued Resource ID: ade9055b-2ef9-426f-9386-65654700ee06 with Priority: HIGHEST for action security_group_rules [ 590.233377] env[65370]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ade9055b-2ef9-426f-9386-65654700ee06 with Priority: HIGHEST for action security_group_rules [ 590.233377] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock rules-ade9055b-2ef9-426f-9386-65654700ee06 taken with stack trace [, , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 590.233377] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-ade9055b-2ef9-426f-9386-65654700ee06" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 590.233377] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-ade9055b-2ef9-426f-9386-65654700ee06" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 590.233377] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-ade9055b-2ef9-426f-9386-65654700ee06" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 590.233377] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('ade9055b-2ef9-426f-9386-65654700ee06',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 590.384197] env[65370]: DEBUG networking_nsxv3.common.locking [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Lock network-449 taken with stack trace [, , , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 590.384325] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquiring lock "network-449" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 590.384438] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquired lock "network-449" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 590.384876] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquired external semaphore "network-449" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 590.385617] env[65370]: DEBUG networking_nsxv3.common.locking [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 590.385822] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquiring lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 590.385940] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquired lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 590.386341] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquired external semaphore "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 590.386341] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Releasing lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 590.386494] env[65370]: DEBUG dogpile.cache.region [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] No value present for key: 'zone-id' {{(pid=65370) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 590.386583] env[65370]: DEBUG dogpile.lock [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] NeedRegenerationException {{(pid=65370) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 590.386789] env[65370]: DEBUG dogpile.lock [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] no value, waiting for create lock {{(pid=65370) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 590.386846] env[65370]: DEBUG dogpile.lock [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] value creation lock acquired {{(pid=65370) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 590.387047] env[65370]: DEBUG dogpile.cache.region [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] No value present for key: 'zone-id' {{(pid=65370) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 590.387047] env[65370]: DEBUG dogpile.lock [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Calling creation function for not-yet-present value {{(pid=65370) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 590.387142] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 590.410742] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 590.410742] env[65370]: DEBUG dogpile.cache.region [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=65370) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 590.410742] env[65370]: DEBUG dogpile.lock [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Released creation lock {{(pid=65370) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 590.410877] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Releasing lock "network-449" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 590.411284] env[65370]: DEBUG networking_nsxv3.common.locking [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Lock port-1fd51580-9c87-4959-b8aa-2ddb9ad6e398 taken with stack trace [, , , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 590.411461] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquiring lock "port-1fd51580-9c87-4959-b8aa-2ddb9ad6e398" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 590.411644] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquired lock "port-1fd51580-9c87-4959-b8aa-2ddb9ad6e398" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 590.411909] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquired external semaphore "port-1fd51580-9c87-4959-b8aa-2ddb9ad6e398" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 590.411991] env[65370]: DEBUG networking_nsxv3.api.rpc [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1fd51580-9c87-4959-b8aa-2ddb9ad6e398',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 590.684691] env[65370]: INFO networking_nsxv3.common.synchronization [None req-acd7f74c-da3c-45cb-a52a-cfbedc150cd8 None None] Enqueued Resource ID: 0fab88ae-53fe-446a-bdef-85f4680e824b with Priority: HIGHEST for action port [ 590.685376] env[65370]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0fab88ae-53fe-446a-bdef-85f4680e824b with Priority: HIGHEST for action port [ 590.685763] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock port-0fab88ae-53fe-446a-bdef-85f4680e824b taken with stack trace [, , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 590.685926] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-0fab88ae-53fe-446a-bdef-85f4680e824b" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 590.686031] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-0fab88ae-53fe-446a-bdef-85f4680e824b" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 590.686347] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-0fab88ae-53fe-446a-bdef-85f4680e824b" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 590.686458] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0fab88ae-53fe-446a-bdef-85f4680e824b',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 590.756609] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 590.756789] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 590.756854] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 590.757083] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 590.757174] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 590.757271] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: ade9055b-2ef9-426f-9386-65654700ee06 already deleted. [ 590.757357] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-ade9055b-2ef9-426f-9386-65654700ee06" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 590.915401] env[65370]: DEBUG networking_nsxv3.common.locking [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 590.915829] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquiring lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 590.915892] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquired lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 590.916161] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquired external semaphore "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 590.916301] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Releasing lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 590.916445] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Segment Port 1fd51580-9c87-4959-b8aa-2ddb9ad6e398 not found, creating... [ 590.916697] env[65370]: DEBUG networking_nsxv3.common.locking [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 590.916843] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquiring lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 590.916951] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquired lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 590.917192] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquired external semaphore "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 590.917297] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Releasing lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 590.917564] env[65370]: DEBUG networking_nsxv3.common.locking [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 590.917754] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquiring lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 590.917870] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquired lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 590.918077] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquired external semaphore "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 590.918203] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Releasing lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 590.918332] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Resource: SegmentPort with ID: 1fd51580-9c87-4959-b8aa-2ddb9ad6e398 is going to be created. [ 590.937642] env[65370]: DEBUG networking_nsxv3.common.locking [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 590.937896] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquiring lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 590.937960] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquired lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 590.938253] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquired external semaphore "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 590.938467] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Releasing lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 590.938683] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Releasing lock "port-1fd51580-9c87-4959-b8aa-2ddb9ad6e398" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 591.190355] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 0fab88ae-53fe-446a-bdef-85f4680e824b [ 591.190355] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 591.190355] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 591.190355] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 591.190616] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 591.190616] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 591.190616] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:0fab88ae-53fe-446a-bdef-85f4680e824b already deleted. [ 591.190703] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-0fab88ae-53fe-446a-bdef-85f4680e824b" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 591.705462] env[65370]: INFO networking_nsxv3.common.synchronization [req-6e5e5e7d-7ddc-4e66-95f6-0cd9c4865ecd req-6840b7b5-85f8-4dfb-a0df-481a4eb88538 service nova] Enqueued Resource ID: d1777ef4-6140-42f0-bcd4-a267f85cb990 with Priority: HIGHEST for action security_group_rules [ 591.705578] env[65370]: INFO networking_nsxv3.common.synchronization [req-6e5e5e7d-7ddc-4e66-95f6-0cd9c4865ecd req-6840b7b5-85f8-4dfb-a0df-481a4eb88538 service nova] Enqueued Resource ID: d1777ef4-6140-42f0-bcd4-a267f85cb990 with Priority: HIGHEST for action security_group_members [ 591.705727] env[65370]: INFO networking_nsxv3.common.synchronization [req-6e5e5e7d-7ddc-4e66-95f6-0cd9c4865ecd req-6840b7b5-85f8-4dfb-a0df-481a4eb88538 service nova] Enqueued Resource ID: 1fd51580-9c87-4959-b8aa-2ddb9ad6e398 with Priority: HIGHEST for action port [ 591.706301] env[65370]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d1777ef4-6140-42f0-bcd4-a267f85cb990 with Priority: HIGHEST for action security_group_rules [ 591.706442] env[65370]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d1777ef4-6140-42f0-bcd4-a267f85cb990 with Priority: HIGHEST for action security_group_members [ 591.706541] env[65370]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1fd51580-9c87-4959-b8aa-2ddb9ad6e398 with Priority: HIGHEST for action port [ 591.706840] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d1777ef4-6140-42f0-bcd4-a267f85cb990 taken with stack trace [, , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 591.706971] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d1777ef4-6140-42f0-bcd4-a267f85cb990" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 591.707057] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d1777ef4-6140-42f0-bcd4-a267f85cb990" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 591.707315] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d1777ef4-6140-42f0-bcd4-a267f85cb990" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 591.707401] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d1777ef4-6140-42f0-bcd4-a267f85cb990',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 591.708404] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock member-d1777ef4-6140-42f0-bcd4-a267f85cb990 taken with stack trace [, , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 591.708547] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d1777ef4-6140-42f0-bcd4-a267f85cb990" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 591.708621] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d1777ef4-6140-42f0-bcd4-a267f85cb990" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 591.708814] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d1777ef4-6140-42f0-bcd4-a267f85cb990" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 591.708975] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 591.709313] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 591.709313] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 591.709414] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 591.709451] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 591.709552] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d1777ef4-6140-42f0-bcd4-a267f85cb990',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 591.710391] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock port-1fd51580-9c87-4959-b8aa-2ddb9ad6e398 taken with stack trace [, , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 591.710548] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-1fd51580-9c87-4959-b8aa-2ddb9ad6e398" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 591.710548] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-1fd51580-9c87-4959-b8aa-2ddb9ad6e398" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 591.710714] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-1fd51580-9c87-4959-b8aa-2ddb9ad6e398" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 591.710791] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1fd51580-9c87-4959-b8aa-2ddb9ad6e398',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 591.903033] env[65370]: INFO networking_nsxv3.common.synchronization [None req-6e83384e-0916-44f5-90c8-ce14e59e1cad tempest-VolumesAssistedSnapshotsTest-1217946812 tempest-VolumesAssistedSnapshotsTest-1217946812-project-member] Enqueued Resource ID: ade9055b-2ef9-426f-9386-65654700ee06 with Priority: HIGHEST for action security_group_rules [ 591.903762] env[65370]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ade9055b-2ef9-426f-9386-65654700ee06 with Priority: HIGHEST for action security_group_rules [ 591.903981] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock rules-ade9055b-2ef9-426f-9386-65654700ee06 taken with stack trace [, , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 591.904143] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-ade9055b-2ef9-426f-9386-65654700ee06" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 591.905150] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-ade9055b-2ef9-426f-9386-65654700ee06" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 591.905150] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-ade9055b-2ef9-426f-9386-65654700ee06" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 591.905150] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('ade9055b-2ef9-426f-9386-65654700ee06',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 591.964733] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7c93cef4-117c-4bf3-aaf5-07dadeb90a88 in Status: SUCCESS [ 591.965151] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7c93cef4-117c-4bf3-aaf5-07dadeb90a88" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 591.965320] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7c93cef4-117c-4bf3-aaf5-07dadeb90a88" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 591.965609] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7c93cef4-117c-4bf3-aaf5-07dadeb90a88" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 591.965857] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 591.966038] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 591.966323] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 591.966393] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 591.966456] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 591.966576] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7c93cef4-117c-4bf3-aaf5-07dadeb90a88" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 591.966711] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('7c93cef4-117c-4bf3-aaf5-07dadeb90a88',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 592.214116] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock member-d1777ef4-6140-42f0-bcd4-a267f85cb990 taken with stack trace [, , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 592.214319] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d1777ef4-6140-42f0-bcd4-a267f85cb990" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 592.214533] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('d1777ef4-6140-42f0-bcd4-a267f85cb990',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 592.215430] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 1fd51580-9c87-4959-b8aa-2ddb9ad6e398 with status ACTIVE [ 592.215718] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 592.215818] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 592.215915] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 592.216204] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 592.216204] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 592.216359] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 592.216479] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 592.216535] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 592.216729] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 592.216729] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 592.216941] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 592.217049] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 592.218791] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 592.219023] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 592.219084] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 592.219216] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 1fd51580-9c87-4959-b8aa-2ddb9ad6e398 is going to be updated. [ 592.246258] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 592.246585] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 592.246585] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 592.246585] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 592.246849] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 592.246849] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-1fd51580-9c87-4959-b8aa-2ddb9ad6e398" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 592.428232] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 592.428503] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 592.428819] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 592.428890] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 592.428961] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 592.429510] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: ade9055b-2ef9-426f-9386-65654700ee06 already deleted. [ 592.429510] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-ade9055b-2ef9-426f-9386-65654700ee06" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 592.470043] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock member-7c93cef4-117c-4bf3-aaf5-07dadeb90a88 taken with stack trace [, , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 592.470043] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7c93cef4-117c-4bf3-aaf5-07dadeb90a88" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 592.470043] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7c93cef4-117c-4bf3-aaf5-07dadeb90a88" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 592.470343] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7c93cef4-117c-4bf3-aaf5-07dadeb90a88" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 592.470400] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 592.470481] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 592.470530] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 592.474126] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 592.474126] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 592.474126] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7c93cef4-117c-4bf3-aaf5-07dadeb90a88" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 592.474126] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock member-7c93cef4-117c-4bf3-aaf5-07dadeb90a88 taken with stack trace [, , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 592.474126] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7c93cef4-117c-4bf3-aaf5-07dadeb90a88" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 592.474126] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7c93cef4-117c-4bf3-aaf5-07dadeb90a88" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 592.474126] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7c93cef4-117c-4bf3-aaf5-07dadeb90a88" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 592.474126] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 592.474126] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 592.474126] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 592.474126] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 592.474126] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 592.474126] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7c93cef4-117c-4bf3-aaf5-07dadeb90a88" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 592.474126] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('7c93cef4-117c-4bf3-aaf5-07dadeb90a88',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 592.723077] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('d1777ef4-6140-42f0-bcd4-a267f85cb990',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 592.977604] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 7c93cef4-117c-4bf3-aaf5-07dadeb90a88: rpc.has_security_group_logging(os_id): False [ 592.979505] env[65370]: INFO networking_nsxv3.common.synchronization [None req-dc894331-c5e7-478f-bd23-9a6e6d5fabc2 None None] Enqueued Resource ID: 145d08d1-7434-4999-953e-505745c45110 with Priority: HIGHEST for action port [ 592.980257] env[65370]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 145d08d1-7434-4999-953e-505745c45110 with Priority: HIGHEST for action port [ 592.981045] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock port-145d08d1-7434-4999-953e-505745c45110 taken with stack trace [, , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 592.981144] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-145d08d1-7434-4999-953e-505745c45110" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 592.981327] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-145d08d1-7434-4999-953e-505745c45110" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 592.981459] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-145d08d1-7434-4999-953e-505745c45110" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 592.981531] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('145d08d1-7434-4999-953e-505745c45110',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 592.998202] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 592.999166] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 592.999166] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 592.999166] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 592.999166] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 592.999166] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 592.999166] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 592.999166] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 592.999415] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 592.999415] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 592.999538] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 592.999620] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 592.999667] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 592.999801] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 592.999868] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 593.000068] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 593.000185] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 593.000230] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 593.000335] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 593.000407] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 593.000495] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 7c93cef4-117c-4bf3-aaf5-07dadeb90a88 is going to be created. [ 593.092084] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 593.092279] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 593.092365] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 593.092617] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 593.093257] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 593.108333] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7c93cef4-117c-4bf3-aaf5-07dadeb90a88 in Status: IN_PROGRESS for 2s [ 593.226385] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 593.226583] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 593.226687] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 593.227378] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 593.227378] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 593.227378] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d1777ef4-6140-42f0-bcd4-a267f85cb990 is going to be created. [ 593.256596] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 593.256776] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 593.256872] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 593.257131] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 593.257286] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 593.274091] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d1777ef4-6140-42f0-bcd4-a267f85cb990 in Status: UNINITIALIZED for 2s [ 593.484603] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 145d08d1-7434-4999-953e-505745c45110 [ 593.485168] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 593.486166] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 593.486166] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 593.486166] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 593.486166] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 593.486166] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:145d08d1-7434-4999-953e-505745c45110 already deleted. [ 593.486722] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-145d08d1-7434-4999-953e-505745c45110" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 593.848131] env[65370]: INFO networking_nsxv3.common.synchronization [None req-bf0caaa7-3b6b-43ef-aa95-94badcdba066 None None] Enqueued Resource ID: c54e2017-d314-4640-97d2-ac1fe7d7c541 with Priority: HIGHEST for action port [ 593.848131] env[65370]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c54e2017-d314-4640-97d2-ac1fe7d7c541 with Priority: HIGHEST for action port [ 593.848131] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock port-c54e2017-d314-4640-97d2-ac1fe7d7c541 taken with stack trace [, , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 593.848131] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-c54e2017-d314-4640-97d2-ac1fe7d7c541" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 593.848131] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-c54e2017-d314-4640-97d2-ac1fe7d7c541" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 593.848954] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-c54e2017-d314-4640-97d2-ac1fe7d7c541" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 593.849172] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c54e2017-d314-4640-97d2-ac1fe7d7c541',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 594.211401] env[65370]: INFO networking_nsxv3.common.synchronization [req-c0036a2a-b25f-4746-838d-75c57ed2c019 req-e0a44058-ff53-47ff-88e3-2bcd4d2bfe29 tempest-ServerDiagnosticsNegativeTest-1411090309 tempest-ServerDiagnosticsNegativeTest-1411090309-project-member] Enqueued Resource ID: 81833a12-37d8-4ada-8f82-01b16a0f7a0a with Priority: HIGHEST for action security_group_members [ 594.212198] env[65370]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 81833a12-37d8-4ada-8f82-01b16a0f7a0a with Priority: HIGHEST for action security_group_members [ 594.212268] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock member-81833a12-37d8-4ada-8f82-01b16a0f7a0a taken with stack trace [, , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 594.212549] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-81833a12-37d8-4ada-8f82-01b16a0f7a0a" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 594.212549] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-81833a12-37d8-4ada-8f82-01b16a0f7a0a" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 594.213391] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-81833a12-37d8-4ada-8f82-01b16a0f7a0a" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 594.214116] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 594.214116] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 594.214116] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 594.214116] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 594.214488] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 594.214488] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('81833a12-37d8-4ada-8f82-01b16a0f7a0a',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 594.353199] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port c54e2017-d314-4640-97d2-ac1fe7d7c541 [ 594.353199] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 594.353199] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 594.353199] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 594.353199] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 594.353199] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 594.353199] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:c54e2017-d314-4640-97d2-ac1fe7d7c541 already deleted. [ 594.353199] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-c54e2017-d314-4640-97d2-ac1fe7d7c541" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 594.717853] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 594.717853] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 594.717853] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 594.717853] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 594.717853] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 594.717853] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 594.717853] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 594.717853] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 594.719339] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 594.719339] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 594.719339] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 81833a12-37d8-4ada-8f82-01b16a0f7a0a already deleted. [ 594.719339] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-81833a12-37d8-4ada-8f82-01b16a0f7a0a" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 594.779019] env[65370]: DEBUG networking_nsxv3.common.locking [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Lock network-449 taken with stack trace [, , , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 594.779019] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquiring lock "network-449" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 594.779019] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquired lock "network-449" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 594.779019] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquired external semaphore "network-449" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 594.779019] env[65370]: DEBUG networking_nsxv3.common.locking [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 594.779019] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquiring lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 594.779019] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquired lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 594.779019] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquired external semaphore "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 594.779019] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Releasing lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 594.779019] env[65370]: DEBUG dogpile.cache.region [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] No value present for key: 'zone-id' {{(pid=65370) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 594.779948] env[65370]: DEBUG dogpile.lock [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] NeedRegenerationException {{(pid=65370) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 594.780171] env[65370]: DEBUG dogpile.lock [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] no value, waiting for create lock {{(pid=65370) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 594.780450] env[65370]: DEBUG dogpile.lock [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] value creation lock acquired {{(pid=65370) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 594.780669] env[65370]: DEBUG dogpile.cache.region [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] No value present for key: 'zone-id' {{(pid=65370) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 594.780829] env[65370]: DEBUG dogpile.lock [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Calling creation function for not-yet-present value {{(pid=65370) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 594.781060] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 594.802730] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 594.803042] env[65370]: DEBUG dogpile.cache.region [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=65370) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 594.803173] env[65370]: DEBUG dogpile.lock [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Released creation lock {{(pid=65370) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 594.803388] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Releasing lock "network-449" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 594.803736] env[65370]: DEBUG networking_nsxv3.common.locking [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Lock port-a1a1f811-9171-436a-a8f2-0ccda2b2afdc taken with stack trace [, , , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 594.803935] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquiring lock "port-a1a1f811-9171-436a-a8f2-0ccda2b2afdc" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 594.804080] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquired lock "port-a1a1f811-9171-436a-a8f2-0ccda2b2afdc" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 594.805206] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquired external semaphore "port-a1a1f811-9171-436a-a8f2-0ccda2b2afdc" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 594.805264] env[65370]: DEBUG networking_nsxv3.api.rpc [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a1a1f811-9171-436a-a8f2-0ccda2b2afdc',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 595.126740] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7c93cef4-117c-4bf3-aaf5-07dadeb90a88 in Status: SUCCESS [ 595.127067] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-7c93cef4-117c-4bf3-aaf5-07dadeb90a88" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 595.288395] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d1777ef4-6140-42f0-bcd4-a267f85cb990 in Status: SUCCESS [ 595.288395] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d1777ef4-6140-42f0-bcd4-a267f85cb990" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 595.288395] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d1777ef4-6140-42f0-bcd4-a267f85cb990" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 595.290964] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d1777ef4-6140-42f0-bcd4-a267f85cb990" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 595.290964] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 595.290964] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 595.290964] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 595.290964] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 595.290964] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 595.290964] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d1777ef4-6140-42f0-bcd4-a267f85cb990" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 595.290964] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('d1777ef4-6140-42f0-bcd4-a267f85cb990',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 595.313407] env[65370]: DEBUG networking_nsxv3.common.locking [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 595.313407] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquiring lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 595.313407] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquired lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 595.313407] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquired external semaphore "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 595.313407] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Releasing lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 595.313407] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Segment Port a1a1f811-9171-436a-a8f2-0ccda2b2afdc not found, creating... [ 595.313407] env[65370]: DEBUG networking_nsxv3.common.locking [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 595.313407] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquiring lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 595.313407] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquired lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 595.313407] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquired external semaphore "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 595.314622] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Releasing lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 595.314622] env[65370]: DEBUG networking_nsxv3.common.locking [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 595.314622] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquiring lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 595.314622] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquired lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 595.314622] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquired external semaphore "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 595.314622] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Releasing lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 595.314622] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Resource: SegmentPort with ID: a1a1f811-9171-436a-a8f2-0ccda2b2afdc is going to be created. [ 595.349010] env[65370]: DEBUG networking_nsxv3.common.locking [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 595.349260] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquiring lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 595.349513] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquired lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 595.349646] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquired external semaphore "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 595.349865] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Releasing lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 595.350100] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Releasing lock "port-a1a1f811-9171-436a-a8f2-0ccda2b2afdc" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 595.792420] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock member-d1777ef4-6140-42f0-bcd4-a267f85cb990 taken with stack trace [, , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 595.792579] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d1777ef4-6140-42f0-bcd4-a267f85cb990" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 595.792954] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d1777ef4-6140-42f0-bcd4-a267f85cb990" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 595.792954] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d1777ef4-6140-42f0-bcd4-a267f85cb990" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 595.793084] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 595.793168] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 595.793233] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 595.793384] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 595.793473] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 595.793592] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d1777ef4-6140-42f0-bcd4-a267f85cb990" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 595.793752] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock member-d1777ef4-6140-42f0-bcd4-a267f85cb990 taken with stack trace [, , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 595.794371] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d1777ef4-6140-42f0-bcd4-a267f85cb990" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 595.795393] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d1777ef4-6140-42f0-bcd4-a267f85cb990" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 595.795393] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d1777ef4-6140-42f0-bcd4-a267f85cb990" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 595.795393] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 595.795393] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 595.795393] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 595.795393] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 595.795393] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 595.795393] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d1777ef4-6140-42f0-bcd4-a267f85cb990" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 595.795393] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('d1777ef4-6140-42f0-bcd4-a267f85cb990',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 595.885948] env[65370]: INFO networking_nsxv3.common.synchronization [None req-fd3240ad-de8a-4a2e-b7bc-3bbc2b7f6abe None None] Enqueued Resource ID: 8e3c99d9-f754-43b2-b6e9-7e69be92a3b6 with Priority: HIGHEST for action port [ 595.885948] env[65370]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8e3c99d9-f754-43b2-b6e9-7e69be92a3b6 with Priority: HIGHEST for action port [ 595.886230] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock port-8e3c99d9-f754-43b2-b6e9-7e69be92a3b6 taken with stack trace [, , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 595.886616] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-8e3c99d9-f754-43b2-b6e9-7e69be92a3b6" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 595.886832] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-8e3c99d9-f754-43b2-b6e9-7e69be92a3b6" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 595.887464] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-8e3c99d9-f754-43b2-b6e9-7e69be92a3b6" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 595.887464] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8e3c99d9-f754-43b2-b6e9-7e69be92a3b6',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 596.049132] env[65370]: INFO networking_nsxv3.common.synchronization [req-c0036a2a-b25f-4746-838d-75c57ed2c019 req-44a555f7-bfdb-459d-b373-c14670198f0a service nova] Enqueued Resource ID: 81833a12-37d8-4ada-8f82-01b16a0f7a0a with Priority: HIGHEST for action security_group_rules [ 596.049309] env[65370]: INFO networking_nsxv3.common.synchronization [req-c0036a2a-b25f-4746-838d-75c57ed2c019 req-44a555f7-bfdb-459d-b373-c14670198f0a service nova] Enqueued Resource ID: 81833a12-37d8-4ada-8f82-01b16a0f7a0a with Priority: HIGHEST for action security_group_members [ 596.049436] env[65370]: INFO networking_nsxv3.common.synchronization [req-c0036a2a-b25f-4746-838d-75c57ed2c019 req-44a555f7-bfdb-459d-b373-c14670198f0a service nova] Enqueued Resource ID: a1a1f811-9171-436a-a8f2-0ccda2b2afdc with Priority: HIGHEST for action port [ 596.049651] env[65370]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 81833a12-37d8-4ada-8f82-01b16a0f7a0a with Priority: HIGHEST for action security_group_rules [ 596.049789] env[65370]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 81833a12-37d8-4ada-8f82-01b16a0f7a0a with Priority: HIGHEST for action security_group_members [ 596.049898] env[65370]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a1a1f811-9171-436a-a8f2-0ccda2b2afdc with Priority: HIGHEST for action port [ 596.050421] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock rules-81833a12-37d8-4ada-8f82-01b16a0f7a0a taken with stack trace [, , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 596.050545] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-81833a12-37d8-4ada-8f82-01b16a0f7a0a" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 596.050611] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-81833a12-37d8-4ada-8f82-01b16a0f7a0a" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 596.050984] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-81833a12-37d8-4ada-8f82-01b16a0f7a0a" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 596.051692] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('81833a12-37d8-4ada-8f82-01b16a0f7a0a',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 596.054464] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock member-81833a12-37d8-4ada-8f82-01b16a0f7a0a taken with stack trace [, , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 596.054711] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-81833a12-37d8-4ada-8f82-01b16a0f7a0a" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 596.054711] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-81833a12-37d8-4ada-8f82-01b16a0f7a0a" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 596.054863] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-81833a12-37d8-4ada-8f82-01b16a0f7a0a" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 596.055667] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 596.055667] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 596.055667] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 596.055667] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 596.055667] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 596.055667] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('81833a12-37d8-4ada-8f82-01b16a0f7a0a',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 596.057260] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock port-a1a1f811-9171-436a-a8f2-0ccda2b2afdc taken with stack trace [, , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 596.057260] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-a1a1f811-9171-436a-a8f2-0ccda2b2afdc" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 596.057260] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-a1a1f811-9171-436a-a8f2-0ccda2b2afdc" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 596.057872] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-a1a1f811-9171-436a-a8f2-0ccda2b2afdc" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 596.057872] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a1a1f811-9171-436a-a8f2-0ccda2b2afdc',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 596.298148] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for d1777ef4-6140-42f0-bcd4-a267f85cb990: rpc.has_security_group_logging(os_id): False [ 596.321050] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 596.321050] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 596.321233] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 596.321398] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 596.321535] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 596.321767] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 596.321875] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 596.321941] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 596.322114] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 596.322234] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 596.322488] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 596.322573] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 596.322612] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 596.322746] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 596.322821] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 596.323010] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 596.323104] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 596.323159] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 596.323401] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 596.323436] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 596.323555] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d1777ef4-6140-42f0-bcd4-a267f85cb990 is going to be created. [ 596.389759] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 8e3c99d9-f754-43b2-b6e9-7e69be92a3b6 [ 596.390057] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 596.390204] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 596.390300] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 596.390496] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 596.390594] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 596.390686] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:8e3c99d9-f754-43b2-b6e9-7e69be92a3b6 already deleted. [ 596.390769] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-8e3c99d9-f754-43b2-b6e9-7e69be92a3b6" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 596.392965] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 596.393179] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 596.393280] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 596.393601] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 596.393722] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 596.405945] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d1777ef4-6140-42f0-bcd4-a267f85cb990 in Status: IN_PROGRESS for 2s [ 596.555541] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock member-81833a12-37d8-4ada-8f82-01b16a0f7a0a taken with stack trace [, , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 596.555754] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-81833a12-37d8-4ada-8f82-01b16a0f7a0a" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 596.558214] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('81833a12-37d8-4ada-8f82-01b16a0f7a0a',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 596.559460] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port a1a1f811-9171-436a-a8f2-0ccda2b2afdc with status ACTIVE [ 596.560160] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 596.560936] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 596.561042] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 596.561279] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 596.561392] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 596.561589] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 596.561699] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 596.561762] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 596.561955] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 596.566019] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 596.566019] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 596.566019] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 596.566019] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 596.566019] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 596.566019] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 596.566019] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: a1a1f811-9171-436a-a8f2-0ccda2b2afdc is going to be updated. [ 596.592908] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 596.593124] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 596.593423] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 596.593423] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 596.593624] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 596.593809] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-a1a1f811-9171-436a-a8f2-0ccda2b2afdc" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 596.687225] env[65370]: INFO networking_nsxv3.common.synchronization [req-5c6a0825-5eec-4965-8806-8b9f0ccc9973 req-2259a49c-f82c-4ff0-ae41-c66a579589a6 tempest-TenantUsagesTestJSON-2042669284 tempest-TenantUsagesTestJSON-2042669284-project-member] Enqueued Resource ID: 48cb2a6d-3a04-4700-a0e8-ee3e4e1a679c with Priority: HIGHEST for action security_group_members [ 596.687750] env[65370]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 48cb2a6d-3a04-4700-a0e8-ee3e4e1a679c with Priority: HIGHEST for action security_group_members [ 596.688066] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock member-48cb2a6d-3a04-4700-a0e8-ee3e4e1a679c taken with stack trace [, , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 596.688191] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-48cb2a6d-3a04-4700-a0e8-ee3e4e1a679c" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 596.688260] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-48cb2a6d-3a04-4700-a0e8-ee3e4e1a679c" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 596.688523] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-48cb2a6d-3a04-4700-a0e8-ee3e4e1a679c" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 596.688684] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 596.688788] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 596.688849] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 596.689014] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 596.689275] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 596.689419] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('48cb2a6d-3a04-4700-a0e8-ee3e4e1a679c',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 597.066405] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('81833a12-37d8-4ada-8f82-01b16a0f7a0a',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 597.099354] env[65370]: DEBUG networking_nsxv3.common.locking [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Lock network-449 taken with stack trace [, , , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 597.099543] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquiring lock "network-449" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 597.099657] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquired lock "network-449" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 597.099903] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquired external semaphore "network-449" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 597.100159] env[65370]: DEBUG networking_nsxv3.common.locking [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 597.100306] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquiring lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 597.100413] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquired lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 597.100610] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquired external semaphore "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 597.100745] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Releasing lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 597.100989] env[65370]: DEBUG dogpile.cache.region [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] No value present for key: 'zone-id' {{(pid=65370) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 597.101288] env[65370]: DEBUG dogpile.lock [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] NeedRegenerationException {{(pid=65370) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 597.101446] env[65370]: DEBUG dogpile.lock [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] no value, waiting for create lock {{(pid=65370) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 597.101591] env[65370]: DEBUG dogpile.lock [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] value creation lock acquired {{(pid=65370) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 597.101738] env[65370]: DEBUG dogpile.cache.region [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] No value present for key: 'zone-id' {{(pid=65370) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 597.101876] env[65370]: DEBUG dogpile.lock [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Calling creation function for not-yet-present value {{(pid=65370) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 597.102052] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 597.122061] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 597.122251] env[65370]: DEBUG dogpile.cache.region [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=65370) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 597.122413] env[65370]: DEBUG dogpile.lock [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Released creation lock {{(pid=65370) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 597.122633] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Releasing lock "network-449" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 597.122985] env[65370]: DEBUG networking_nsxv3.common.locking [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Lock port-d81430b2-3b27-478b-9e79-1100bd22b8af taken with stack trace [, , , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 597.123116] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquiring lock "port-d81430b2-3b27-478b-9e79-1100bd22b8af" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 597.123229] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquired lock "port-d81430b2-3b27-478b-9e79-1100bd22b8af" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 597.123560] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquired external semaphore "port-d81430b2-3b27-478b-9e79-1100bd22b8af" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 597.123659] env[65370]: DEBUG networking_nsxv3.api.rpc [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d81430b2-3b27-478b-9e79-1100bd22b8af',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 597.193073] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 597.193073] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 597.193073] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 597.193073] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 597.193073] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 597.193073] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 597.193073] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 597.193073] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 597.193073] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 597.193073] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 597.193487] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 48cb2a6d-3a04-4700-a0e8-ee3e4e1a679c already deleted. [ 597.193487] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-48cb2a6d-3a04-4700-a0e8-ee3e4e1a679c" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 597.569990] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 597.571033] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 597.571033] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 597.571033] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 597.571033] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 597.571033] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 81833a12-37d8-4ada-8f82-01b16a0f7a0a is going to be created. [ 597.597126] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 597.597500] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 597.597724] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 597.597995] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 597.598262] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 597.610660] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 81833a12-37d8-4ada-8f82-01b16a0f7a0a in Status: UNINITIALIZED for 2s [ 597.626482] env[65370]: DEBUG networking_nsxv3.common.locking [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 597.626836] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquiring lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 597.627016] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquired lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 597.627320] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquired external semaphore "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 597.627529] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Releasing lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 597.627653] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Segment Port d81430b2-3b27-478b-9e79-1100bd22b8af not found, creating... [ 597.627935] env[65370]: DEBUG networking_nsxv3.common.locking [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 597.628725] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquiring lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 597.628725] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquired lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 597.629095] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquired external semaphore "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 597.629241] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Releasing lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 597.630632] env[65370]: DEBUG networking_nsxv3.common.locking [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 597.630801] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquiring lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 597.631400] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquired lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 597.631400] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquired external semaphore "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 597.631400] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Releasing lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 597.631659] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Resource: SegmentPort with ID: d81430b2-3b27-478b-9e79-1100bd22b8af is going to be created. [ 597.658126] env[65370]: DEBUG networking_nsxv3.common.locking [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 597.658354] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquiring lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 597.658472] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquired lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 597.659072] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquired external semaphore "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 597.659307] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Releasing lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 597.659526] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Releasing lock "port-d81430b2-3b27-478b-9e79-1100bd22b8af" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 598.126525] env[65370]: INFO networking_nsxv3.common.synchronization [None req-c2c142fa-9f05-4165-99f2-0fe6de235353 None None] Enqueued Resource ID: 6dbd4983-4b4f-4769-841b-4bd9848e99d5 with Priority: HIGHEST for action port [ 598.127218] env[65370]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6dbd4983-4b4f-4769-841b-4bd9848e99d5 with Priority: HIGHEST for action port [ 598.127625] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock port-6dbd4983-4b4f-4769-841b-4bd9848e99d5 taken with stack trace [, , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 598.127816] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-6dbd4983-4b4f-4769-841b-4bd9848e99d5" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 598.127934] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-6dbd4983-4b4f-4769-841b-4bd9848e99d5" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 598.128289] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-6dbd4983-4b4f-4769-841b-4bd9848e99d5" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 598.128429] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6dbd4983-4b4f-4769-841b-4bd9848e99d5',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 598.378024] env[65370]: INFO networking_nsxv3.common.synchronization [req-5c6a0825-5eec-4965-8806-8b9f0ccc9973 req-af82354e-d47e-4433-bd6f-15c1cf143fbb service nova] Enqueued Resource ID: 48cb2a6d-3a04-4700-a0e8-ee3e4e1a679c with Priority: HIGHEST for action security_group_rules [ 598.378024] env[65370]: INFO networking_nsxv3.common.synchronization [req-5c6a0825-5eec-4965-8806-8b9f0ccc9973 req-af82354e-d47e-4433-bd6f-15c1cf143fbb service nova] Enqueued Resource ID: 48cb2a6d-3a04-4700-a0e8-ee3e4e1a679c with Priority: HIGHEST for action security_group_members [ 598.378024] env[65370]: INFO networking_nsxv3.common.synchronization [req-5c6a0825-5eec-4965-8806-8b9f0ccc9973 req-af82354e-d47e-4433-bd6f-15c1cf143fbb service nova] Enqueued Resource ID: d81430b2-3b27-478b-9e79-1100bd22b8af with Priority: HIGHEST for action port [ 598.378024] env[65370]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 48cb2a6d-3a04-4700-a0e8-ee3e4e1a679c with Priority: HIGHEST for action security_group_rules [ 598.378024] env[65370]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 48cb2a6d-3a04-4700-a0e8-ee3e4e1a679c with Priority: HIGHEST for action security_group_members [ 598.378024] env[65370]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d81430b2-3b27-478b-9e79-1100bd22b8af with Priority: HIGHEST for action port [ 598.379259] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock rules-48cb2a6d-3a04-4700-a0e8-ee3e4e1a679c taken with stack trace [, , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 598.379564] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-48cb2a6d-3a04-4700-a0e8-ee3e4e1a679c" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 598.379757] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-48cb2a6d-3a04-4700-a0e8-ee3e4e1a679c" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 598.382130] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-48cb2a6d-3a04-4700-a0e8-ee3e4e1a679c" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 598.382130] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('48cb2a6d-3a04-4700-a0e8-ee3e4e1a679c',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 598.382130] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock member-48cb2a6d-3a04-4700-a0e8-ee3e4e1a679c taken with stack trace [, , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 598.382130] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-48cb2a6d-3a04-4700-a0e8-ee3e4e1a679c" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 598.382130] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-48cb2a6d-3a04-4700-a0e8-ee3e4e1a679c" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 598.382130] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-48cb2a6d-3a04-4700-a0e8-ee3e4e1a679c" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 598.382130] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 598.382130] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 598.382130] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 598.382130] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 598.382794] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 598.383028] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('48cb2a6d-3a04-4700-a0e8-ee3e4e1a679c',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 598.384037] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock port-d81430b2-3b27-478b-9e79-1100bd22b8af taken with stack trace [, , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 598.384350] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-d81430b2-3b27-478b-9e79-1100bd22b8af" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 598.384595] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-d81430b2-3b27-478b-9e79-1100bd22b8af" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 598.384911] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-d81430b2-3b27-478b-9e79-1100bd22b8af" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 598.385188] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d81430b2-3b27-478b-9e79-1100bd22b8af',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 598.418923] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d1777ef4-6140-42f0-bcd4-a267f85cb990 in Status: SUCCESS [ 598.419110] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d1777ef4-6140-42f0-bcd4-a267f85cb990" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 598.631404] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 6dbd4983-4b4f-4769-841b-4bd9848e99d5 [ 598.631404] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 598.631404] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 598.631404] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 598.631404] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 598.631404] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 598.631404] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:6dbd4983-4b4f-4769-841b-4bd9848e99d5 already deleted. [ 598.631404] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-6dbd4983-4b4f-4769-841b-4bd9848e99d5" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 598.697496] env[65370]: INFO networking_nsxv3.common.synchronization [None req-79f2a197-6f67-41c5-a44a-8fc55e27a87c tempest-ServerActionsTestOtherB-1099767447 tempest-ServerActionsTestOtherB-1099767447-project-member] Enqueued Resource ID: 2011abd7-ba10-4aae-84fb-1b1bfbd238fa with Priority: HIGHEST for action security_group_rules [ 598.698497] env[65370]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2011abd7-ba10-4aae-84fb-1b1bfbd238fa with Priority: HIGHEST for action security_group_rules [ 598.700029] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock rules-2011abd7-ba10-4aae-84fb-1b1bfbd238fa taken with stack trace [, , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 598.700029] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-2011abd7-ba10-4aae-84fb-1b1bfbd238fa" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 598.700029] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-2011abd7-ba10-4aae-84fb-1b1bfbd238fa" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 598.700409] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-2011abd7-ba10-4aae-84fb-1b1bfbd238fa" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 598.700566] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('2011abd7-ba10-4aae-84fb-1b1bfbd238fa',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 598.888636] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('48cb2a6d-3a04-4700-a0e8-ee3e4e1a679c',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 598.890114] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock member-48cb2a6d-3a04-4700-a0e8-ee3e4e1a679c taken with stack trace [, , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 598.890114] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-48cb2a6d-3a04-4700-a0e8-ee3e4e1a679c" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 598.890301] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port d81430b2-3b27-478b-9e79-1100bd22b8af with status ACTIVE [ 598.890949] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 598.890949] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 598.890949] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 598.891521] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 598.891820] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 598.893032] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 598.893032] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 598.893032] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 598.893032] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 598.893032] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 598.893032] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 598.893453] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 598.893453] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 598.893682] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 598.893754] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 598.893864] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: d81430b2-3b27-478b-9e79-1100bd22b8af is going to be updated. [ 598.925762] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 598.929898] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 598.929898] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 598.930117] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 598.930117] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 598.930378] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-d81430b2-3b27-478b-9e79-1100bd22b8af" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 599.177839] env[65370]: INFO networking_nsxv3.common.synchronization [None req-b111556b-8f0f-47d5-8f80-1c48f076e39c tempest-ServerActionsTestOtherB-1099767447 tempest-ServerActionsTestOtherB-1099767447-project-member] Enqueued Resource ID: 2011abd7-ba10-4aae-84fb-1b1bfbd238fa with Priority: HIGHEST for action security_group_rules [ 599.178627] env[65370]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2011abd7-ba10-4aae-84fb-1b1bfbd238fa with Priority: HIGHEST for action security_group_rules [ 599.178676] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock rules-2011abd7-ba10-4aae-84fb-1b1bfbd238fa taken with stack trace [, , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 599.179765] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-2011abd7-ba10-4aae-84fb-1b1bfbd238fa" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 599.224216] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 599.224903] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 599.224903] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 599.224903] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 599.225301] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 599.225301] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 2011abd7-ba10-4aae-84fb-1b1bfbd238fa already deleted. [ 599.225301] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-2011abd7-ba10-4aae-84fb-1b1bfbd238fa" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 599.225301] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-2011abd7-ba10-4aae-84fb-1b1bfbd238fa" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 599.225522] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-2011abd7-ba10-4aae-84fb-1b1bfbd238fa" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 599.225522] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('2011abd7-ba10-4aae-84fb-1b1bfbd238fa',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 599.405819] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('48cb2a6d-3a04-4700-a0e8-ee3e4e1a679c',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 599.621755] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 81833a12-37d8-4ada-8f82-01b16a0f7a0a in Status: SUCCESS [ 599.623146] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-81833a12-37d8-4ada-8f82-01b16a0f7a0a" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 599.623146] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-81833a12-37d8-4ada-8f82-01b16a0f7a0a" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 599.623146] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-81833a12-37d8-4ada-8f82-01b16a0f7a0a" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 599.623146] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 599.623146] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 599.623146] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 599.623146] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 599.623146] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 599.623146] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-81833a12-37d8-4ada-8f82-01b16a0f7a0a" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 599.623146] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('81833a12-37d8-4ada-8f82-01b16a0f7a0a',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 599.748487] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 599.748847] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 599.748847] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 599.748847] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 599.748943] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 599.749197] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 2011abd7-ba10-4aae-84fb-1b1bfbd238fa already deleted. [ 599.749197] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-2011abd7-ba10-4aae-84fb-1b1bfbd238fa" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 599.904860] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 599.905099] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 599.905099] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 599.905324] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 599.905420] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 599.905518] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 48cb2a6d-3a04-4700-a0e8-ee3e4e1a679c is going to be created. [ 599.935501] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 599.935501] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 599.935501] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 599.935501] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 599.935501] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 599.947697] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 48cb2a6d-3a04-4700-a0e8-ee3e4e1a679c in Status: UNINITIALIZED for 2s [ 600.128458] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock member-81833a12-37d8-4ada-8f82-01b16a0f7a0a taken with stack trace [, , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 600.128701] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-81833a12-37d8-4ada-8f82-01b16a0f7a0a" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 600.128799] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-81833a12-37d8-4ada-8f82-01b16a0f7a0a" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 600.129143] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-81833a12-37d8-4ada-8f82-01b16a0f7a0a" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 600.129334] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 600.129471] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 600.129682] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 600.129927] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 600.130036] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 600.130144] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-81833a12-37d8-4ada-8f82-01b16a0f7a0a" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 600.130315] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock member-81833a12-37d8-4ada-8f82-01b16a0f7a0a taken with stack trace [, , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 600.130411] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-81833a12-37d8-4ada-8f82-01b16a0f7a0a" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 600.130489] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-81833a12-37d8-4ada-8f82-01b16a0f7a0a" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 600.130709] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-81833a12-37d8-4ada-8f82-01b16a0f7a0a" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 600.130916] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 600.131460] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 600.132944] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 600.132944] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 600.132944] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 600.132944] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-81833a12-37d8-4ada-8f82-01b16a0f7a0a" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 600.132944] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('81833a12-37d8-4ada-8f82-01b16a0f7a0a',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 600.318871] env[65370]: INFO networking_nsxv3.common.synchronization [None req-79850812-a982-4bee-8356-13a74278bf92 None None] Enqueued Resource ID: 20e12628-ff68-41ea-bce4-6838af3801ea with Priority: HIGHEST for action port [ 600.318871] env[65370]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 20e12628-ff68-41ea-bce4-6838af3801ea with Priority: HIGHEST for action port [ 600.318871] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock port-20e12628-ff68-41ea-bce4-6838af3801ea taken with stack trace [, , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 600.318871] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-20e12628-ff68-41ea-bce4-6838af3801ea" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 600.318871] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-20e12628-ff68-41ea-bce4-6838af3801ea" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 600.318871] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-20e12628-ff68-41ea-bce4-6838af3801ea" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 600.318871] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('20e12628-ff68-41ea-bce4-6838af3801ea',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 600.629477] env[65370]: INFO networking_nsxv3.common.synchronization [req-3cd8cb08-263e-4638-be0c-fd050ebae21f req-de841100-75ab-494d-8eb4-82e7f4ecb743 tempest-MigrationsAdminTest-1653527346 tempest-MigrationsAdminTest-1653527346-project-member] Enqueued Resource ID: 00a251e9-7a00-4293-9092-9556bc8b91c2 with Priority: HIGHEST for action security_group_members [ 600.630097] env[65370]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 00a251e9-7a00-4293-9092-9556bc8b91c2 with Priority: HIGHEST for action security_group_members [ 600.630402] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock member-00a251e9-7a00-4293-9092-9556bc8b91c2 taken with stack trace [, , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 600.630525] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-00a251e9-7a00-4293-9092-9556bc8b91c2" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 600.630632] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-00a251e9-7a00-4293-9092-9556bc8b91c2" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 600.630839] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-00a251e9-7a00-4293-9092-9556bc8b91c2" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 600.630993] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 600.631587] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 600.631587] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 600.631587] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 600.631587] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 600.631741] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('00a251e9-7a00-4293-9092-9556bc8b91c2',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 600.635066] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 81833a12-37d8-4ada-8f82-01b16a0f7a0a: rpc.has_security_group_logging(os_id): False [ 600.658479] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 600.658479] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 600.658479] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 600.658811] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 600.658873] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 600.659082] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 600.659184] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 600.659240] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 600.659371] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 600.659438] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 600.659604] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 600.659678] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 600.659734] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 600.659915] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 600.660064] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 600.660462] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 600.660575] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 600.660620] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 600.661366] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 600.661366] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 600.661366] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 81833a12-37d8-4ada-8f82-01b16a0f7a0a is going to be created. [ 600.758383] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 600.758383] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 600.758383] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 600.759324] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 600.759324] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 600.785387] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 81833a12-37d8-4ada-8f82-01b16a0f7a0a in Status: IN_PROGRESS for 2s [ 600.823626] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 20e12628-ff68-41ea-bce4-6838af3801ea [ 600.823626] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 600.823810] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 600.823810] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 600.824768] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 600.824768] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 600.824768] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:20e12628-ff68-41ea-bce4-6838af3801ea already deleted. [ 600.824768] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-20e12628-ff68-41ea-bce4-6838af3801ea" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 601.135131] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 601.135343] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 601.135418] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 601.135586] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 601.135683] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 601.135895] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 601.135975] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 601.136049] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 601.136189] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 601.136267] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 601.136364] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 00a251e9-7a00-4293-9092-9556bc8b91c2 already deleted. [ 601.136448] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-00a251e9-7a00-4293-9092-9556bc8b91c2" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 601.233080] env[65370]: DEBUG networking_nsxv3.common.locking [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Lock network-449 taken with stack trace [, , , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 601.233524] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquiring lock "network-449" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 601.233928] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquired lock "network-449" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 601.234082] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquired external semaphore "network-449" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 601.234384] env[65370]: DEBUG networking_nsxv3.common.locking [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 601.234648] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquiring lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 601.234806] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquired lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 601.235077] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquired external semaphore "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 601.235261] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Releasing lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 601.235504] env[65370]: DEBUG dogpile.cache.region [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] No value present for key: 'zone-id' {{(pid=65370) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 601.236044] env[65370]: DEBUG dogpile.lock [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] NeedRegenerationException {{(pid=65370) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 601.236044] env[65370]: DEBUG dogpile.lock [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] no value, waiting for create lock {{(pid=65370) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 601.236044] env[65370]: DEBUG dogpile.lock [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] value creation lock acquired {{(pid=65370) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 601.236358] env[65370]: DEBUG dogpile.cache.region [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] No value present for key: 'zone-id' {{(pid=65370) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 601.236553] env[65370]: DEBUG dogpile.lock [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Calling creation function for not-yet-present value {{(pid=65370) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 601.236740] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 601.261346] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 601.263043] env[65370]: DEBUG dogpile.cache.region [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Cache value generated in 0.025 seconds for key(s): 'zone-id' {{(pid=65370) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 601.263043] env[65370]: DEBUG dogpile.lock [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Released creation lock {{(pid=65370) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 601.263043] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Releasing lock "network-449" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 601.263043] env[65370]: DEBUG networking_nsxv3.common.locking [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Lock port-df4abfad-b60d-47f6-af92-32280d49f5d0 taken with stack trace [, , , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 601.263391] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquiring lock "port-df4abfad-b60d-47f6-af92-32280d49f5d0" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 601.263391] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquired lock "port-df4abfad-b60d-47f6-af92-32280d49f5d0" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 601.263799] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquired external semaphore "port-df4abfad-b60d-47f6-af92-32280d49f5d0" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 601.263799] env[65370]: DEBUG networking_nsxv3.api.rpc [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('df4abfad-b60d-47f6-af92-32280d49f5d0',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 601.768626] env[65370]: DEBUG networking_nsxv3.common.locking [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 601.768963] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquiring lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 601.768963] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquired lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 601.769260] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquired external semaphore "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 601.769498] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Releasing lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 601.770132] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Segment Port df4abfad-b60d-47f6-af92-32280d49f5d0 not found, creating... [ 601.770132] env[65370]: DEBUG networking_nsxv3.common.locking [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 601.770132] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquiring lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 601.770324] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquired lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 601.770487] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquired external semaphore "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 601.770559] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Releasing lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 601.770849] env[65370]: DEBUG networking_nsxv3.common.locking [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 601.771567] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquiring lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 601.771567] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquired lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 601.771567] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquired external semaphore "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 601.771567] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Releasing lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 601.771813] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Resource: SegmentPort with ID: df4abfad-b60d-47f6-af92-32280d49f5d0 is going to be created. [ 601.794745] env[65370]: DEBUG networking_nsxv3.common.locking [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 601.795012] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquiring lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 601.795087] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquired lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 601.795356] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquired external semaphore "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 601.795658] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Releasing lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 601.795872] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Releasing lock "port-df4abfad-b60d-47f6-af92-32280d49f5d0" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 601.958675] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 48cb2a6d-3a04-4700-a0e8-ee3e4e1a679c in Status: SUCCESS [ 601.958899] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-48cb2a6d-3a04-4700-a0e8-ee3e4e1a679c" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 601.959142] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-48cb2a6d-3a04-4700-a0e8-ee3e4e1a679c" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 601.959362] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-48cb2a6d-3a04-4700-a0e8-ee3e4e1a679c" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 601.959542] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 601.959663] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 601.959730] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 601.959876] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 601.959962] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 601.960058] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-48cb2a6d-3a04-4700-a0e8-ee3e4e1a679c" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 601.960145] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('48cb2a6d-3a04-4700-a0e8-ee3e4e1a679c',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 602.430235] env[65370]: INFO networking_nsxv3.common.synchronization [None req-ad4de901-1233-4f7b-835e-1e878035fec4 None None] Enqueued Resource ID: 1b041950-9f4f-4b96-9972-0d648f1ac428 with Priority: HIGHEST for action port [ 602.430822] env[65370]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1b041950-9f4f-4b96-9972-0d648f1ac428 with Priority: HIGHEST for action port [ 602.431429] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock port-1b041950-9f4f-4b96-9972-0d648f1ac428 taken with stack trace [, , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 602.431584] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-1b041950-9f4f-4b96-9972-0d648f1ac428" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 602.431654] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-1b041950-9f4f-4b96-9972-0d648f1ac428" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 602.431904] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-1b041950-9f4f-4b96-9972-0d648f1ac428" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 602.431998] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1b041950-9f4f-4b96-9972-0d648f1ac428',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 602.464686] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock member-48cb2a6d-3a04-4700-a0e8-ee3e4e1a679c taken with stack trace [, , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 602.464686] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-48cb2a6d-3a04-4700-a0e8-ee3e4e1a679c" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 602.464686] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-48cb2a6d-3a04-4700-a0e8-ee3e4e1a679c" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 602.464686] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-48cb2a6d-3a04-4700-a0e8-ee3e4e1a679c" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 602.464686] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 602.464686] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 602.464686] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 602.464686] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 602.464686] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 602.464686] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-48cb2a6d-3a04-4700-a0e8-ee3e4e1a679c" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 602.464686] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock member-48cb2a6d-3a04-4700-a0e8-ee3e4e1a679c taken with stack trace [, , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 602.464686] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-48cb2a6d-3a04-4700-a0e8-ee3e4e1a679c" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 602.464686] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-48cb2a6d-3a04-4700-a0e8-ee3e4e1a679c" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 602.464686] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-48cb2a6d-3a04-4700-a0e8-ee3e4e1a679c" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 602.466809] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 602.466809] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 602.466809] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 602.466809] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 602.466809] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 602.466809] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-48cb2a6d-3a04-4700-a0e8-ee3e4e1a679c" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 602.466809] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('48cb2a6d-3a04-4700-a0e8-ee3e4e1a679c',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 602.546294] env[65370]: INFO networking_nsxv3.common.synchronization [req-3cd8cb08-263e-4638-be0c-fd050ebae21f req-29425968-9dde-4824-8b9a-e75bc0728a20 service nova] Enqueued Resource ID: 00a251e9-7a00-4293-9092-9556bc8b91c2 with Priority: HIGHEST for action security_group_rules [ 602.546294] env[65370]: INFO networking_nsxv3.common.synchronization [req-3cd8cb08-263e-4638-be0c-fd050ebae21f req-29425968-9dde-4824-8b9a-e75bc0728a20 service nova] Enqueued Resource ID: 00a251e9-7a00-4293-9092-9556bc8b91c2 with Priority: HIGHEST for action security_group_members [ 602.546294] env[65370]: INFO networking_nsxv3.common.synchronization [req-3cd8cb08-263e-4638-be0c-fd050ebae21f req-29425968-9dde-4824-8b9a-e75bc0728a20 service nova] Enqueued Resource ID: df4abfad-b60d-47f6-af92-32280d49f5d0 with Priority: HIGHEST for action port [ 602.546829] env[65370]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 00a251e9-7a00-4293-9092-9556bc8b91c2 with Priority: HIGHEST for action security_group_rules [ 602.547173] env[65370]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 00a251e9-7a00-4293-9092-9556bc8b91c2 with Priority: HIGHEST for action security_group_members [ 602.547587] env[65370]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: df4abfad-b60d-47f6-af92-32280d49f5d0 with Priority: HIGHEST for action port [ 602.548085] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock rules-00a251e9-7a00-4293-9092-9556bc8b91c2 taken with stack trace [, , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 602.548353] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-00a251e9-7a00-4293-9092-9556bc8b91c2" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 602.550914] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-00a251e9-7a00-4293-9092-9556bc8b91c2" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 602.550914] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-00a251e9-7a00-4293-9092-9556bc8b91c2" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 602.550914] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('00a251e9-7a00-4293-9092-9556bc8b91c2',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 602.550914] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock member-00a251e9-7a00-4293-9092-9556bc8b91c2 taken with stack trace [, , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 602.550914] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-00a251e9-7a00-4293-9092-9556bc8b91c2" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 602.550914] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-00a251e9-7a00-4293-9092-9556bc8b91c2" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 602.550914] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-00a251e9-7a00-4293-9092-9556bc8b91c2" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 602.550914] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 602.550914] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 602.550914] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 602.550914] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 602.551860] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 602.552155] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('00a251e9-7a00-4293-9092-9556bc8b91c2',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 602.553848] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock port-df4abfad-b60d-47f6-af92-32280d49f5d0 taken with stack trace [, , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 602.554225] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-df4abfad-b60d-47f6-af92-32280d49f5d0" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 602.554658] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-df4abfad-b60d-47f6-af92-32280d49f5d0" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 602.555749] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-df4abfad-b60d-47f6-af92-32280d49f5d0" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 602.555749] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('df4abfad-b60d-47f6-af92-32280d49f5d0',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 602.799871] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 81833a12-37d8-4ada-8f82-01b16a0f7a0a in Status: SUCCESS [ 602.800247] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-81833a12-37d8-4ada-8f82-01b16a0f7a0a" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 602.934961] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 1b041950-9f4f-4b96-9972-0d648f1ac428 [ 602.934961] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 602.935148] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 602.935223] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 602.935441] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 602.935532] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 602.935752] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:1b041950-9f4f-4b96-9972-0d648f1ac428 already deleted. [ 602.935963] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-1b041950-9f4f-4b96-9972-0d648f1ac428" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 602.968103] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 48cb2a6d-3a04-4700-a0e8-ee3e4e1a679c: rpc.has_security_group_logging(os_id): False [ 602.987658] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 602.987658] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 602.988724] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 602.988724] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 602.988724] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 602.988724] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 602.989030] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 602.989112] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 602.989271] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 602.989358] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 602.990966] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 602.990966] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 602.990966] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 602.990966] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 602.990966] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 602.990966] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 602.990966] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 602.990966] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 602.990966] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 602.990966] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 602.990966] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 48cb2a6d-3a04-4700-a0e8-ee3e4e1a679c is going to be created. [ 603.061422] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 603.062150] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 603.062150] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 603.062341] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 603.062602] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 603.063792] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port df4abfad-b60d-47f6-af92-32280d49f5d0 with status ACTIVE [ 603.063915] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 603.064441] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 603.065441] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 603.065769] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 603.065861] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 603.066275] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 603.066371] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 603.068659] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 603.068904] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 603.069055] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 603.070444] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 603.070444] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 603.070444] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 603.070444] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 603.070444] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 603.070444] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: df4abfad-b60d-47f6-af92-32280d49f5d0 is going to be updated. [ 603.071936] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock member-00a251e9-7a00-4293-9092-9556bc8b91c2 taken with stack trace [, , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 603.072050] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-00a251e9-7a00-4293-9092-9556bc8b91c2" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 603.072306] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('00a251e9-7a00-4293-9092-9556bc8b91c2',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 603.091853] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 48cb2a6d-3a04-4700-a0e8-ee3e4e1a679c in Status: IN_PROGRESS for 2s [ 603.112919] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 603.113072] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 603.113072] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 603.113285] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 603.113530] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 603.113592] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-df4abfad-b60d-47f6-af92-32280d49f5d0" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 603.580794] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('00a251e9-7a00-4293-9092-9556bc8b91c2',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 604.086632] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 604.086922] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 604.086922] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 604.087089] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 604.087260] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 604.087260] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 00a251e9-7a00-4293-9092-9556bc8b91c2 is going to be created. [ 604.115850] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 604.115850] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 604.115850] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 604.115850] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 604.116034] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 604.129046] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 00a251e9-7a00-4293-9092-9556bc8b91c2 in Status: UNINITIALIZED for 2s [ 604.578731] env[65370]: INFO networking_nsxv3.common.synchronization [None req-9e1a7e85-abf4-4635-a3e9-0cfd32c15c2b None None] Enqueued Resource ID: ad53d1ec-037b-453b-ab22-98291030aa6a with Priority: HIGHEST for action port [ 604.579506] env[65370]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ad53d1ec-037b-453b-ab22-98291030aa6a with Priority: HIGHEST for action port [ 604.579612] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock port-ad53d1ec-037b-453b-ab22-98291030aa6a taken with stack trace [, , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 604.582531] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-ad53d1ec-037b-453b-ab22-98291030aa6a" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 604.582531] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-ad53d1ec-037b-453b-ab22-98291030aa6a" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 604.582531] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-ad53d1ec-037b-453b-ab22-98291030aa6a" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 604.582531] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ad53d1ec-037b-453b-ab22-98291030aa6a',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 604.793816] env[65370]: INFO networking_nsxv3.common.synchronization [None req-dc187b8e-781d-46ee-9bde-be47432dc251 None None] Enqueued Resource ID: c5b442b5-b4ee-4ae1-9b2e-5e010a46b75e with Priority: HIGHEST for action port [ 604.795744] env[65370]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c5b442b5-b4ee-4ae1-9b2e-5e010a46b75e with Priority: HIGHEST for action port [ 604.795744] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock port-c5b442b5-b4ee-4ae1-9b2e-5e010a46b75e taken with stack trace [, , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 604.795744] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-c5b442b5-b4ee-4ae1-9b2e-5e010a46b75e" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 604.795744] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-c5b442b5-b4ee-4ae1-9b2e-5e010a46b75e" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 604.795744] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-c5b442b5-b4ee-4ae1-9b2e-5e010a46b75e" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 604.795744] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c5b442b5-b4ee-4ae1-9b2e-5e010a46b75e',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 605.086048] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port ad53d1ec-037b-453b-ab22-98291030aa6a [ 605.086048] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 605.086048] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 605.086048] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 605.086048] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 605.086048] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 605.086048] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:ad53d1ec-037b-453b-ab22-98291030aa6a already deleted. [ 605.086048] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-ad53d1ec-037b-453b-ab22-98291030aa6a" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 605.113757] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 48cb2a6d-3a04-4700-a0e8-ee3e4e1a679c in Status: SUCCESS [ 605.113757] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-48cb2a6d-3a04-4700-a0e8-ee3e4e1a679c" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 605.299856] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port c5b442b5-b4ee-4ae1-9b2e-5e010a46b75e [ 605.299856] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 605.299856] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 605.299856] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 605.299856] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 605.299856] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 605.299856] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:c5b442b5-b4ee-4ae1-9b2e-5e010a46b75e already deleted. [ 605.299856] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-c5b442b5-b4ee-4ae1-9b2e-5e010a46b75e" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 606.138606] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 00a251e9-7a00-4293-9092-9556bc8b91c2 in Status: SUCCESS [ 606.138860] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-00a251e9-7a00-4293-9092-9556bc8b91c2" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 606.138984] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-00a251e9-7a00-4293-9092-9556bc8b91c2" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 606.139222] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-00a251e9-7a00-4293-9092-9556bc8b91c2" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 606.139780] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 606.139780] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 606.139780] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 606.139780] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 606.139996] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 606.139996] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-00a251e9-7a00-4293-9092-9556bc8b91c2" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 606.140068] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('00a251e9-7a00-4293-9092-9556bc8b91c2',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 606.642500] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock member-00a251e9-7a00-4293-9092-9556bc8b91c2 taken with stack trace [, , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 606.642817] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-00a251e9-7a00-4293-9092-9556bc8b91c2" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 606.642817] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-00a251e9-7a00-4293-9092-9556bc8b91c2" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 606.643999] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-00a251e9-7a00-4293-9092-9556bc8b91c2" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 606.644354] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 606.645015] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 606.645015] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 606.645015] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 606.645015] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 606.645201] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-00a251e9-7a00-4293-9092-9556bc8b91c2" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 606.645268] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock member-00a251e9-7a00-4293-9092-9556bc8b91c2 taken with stack trace [, , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 606.645397] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-00a251e9-7a00-4293-9092-9556bc8b91c2" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 606.645595] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-00a251e9-7a00-4293-9092-9556bc8b91c2" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 606.645655] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-00a251e9-7a00-4293-9092-9556bc8b91c2" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 606.647031] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 606.647031] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 606.647031] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 606.647031] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 606.647031] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 606.647254] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-00a251e9-7a00-4293-9092-9556bc8b91c2" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 606.647254] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('00a251e9-7a00-4293-9092-9556bc8b91c2',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 607.149420] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 00a251e9-7a00-4293-9092-9556bc8b91c2: rpc.has_security_group_logging(os_id): False [ 607.175694] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 607.175891] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 607.175891] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 607.176232] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 607.176232] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 607.178030] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 607.178030] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 607.178030] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 607.178030] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 607.178030] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 607.178030] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 607.178030] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 607.178030] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 607.178030] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 607.178030] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 607.178030] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 607.178030] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 607.178030] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 607.178030] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 607.179848] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 607.179848] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 00a251e9-7a00-4293-9092-9556bc8b91c2 is going to be created. [ 607.197650] env[65370]: INFO networking_nsxv3.common.synchronization [None req-5a6f7d61-0818-4925-8480-4e11c576a82f None None] Enqueued Resource ID: 5bffe63c-4d97-4183-a4a3-0307f4e87dbc with Priority: HIGHEST for action port [ 607.199019] env[65370]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5bffe63c-4d97-4183-a4a3-0307f4e87dbc with Priority: HIGHEST for action port [ 607.199019] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock port-5bffe63c-4d97-4183-a4a3-0307f4e87dbc taken with stack trace [, , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 607.199019] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-5bffe63c-4d97-4183-a4a3-0307f4e87dbc" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 607.199019] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-5bffe63c-4d97-4183-a4a3-0307f4e87dbc" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 607.200426] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-5bffe63c-4d97-4183-a4a3-0307f4e87dbc" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 607.200426] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5bffe63c-4d97-4183-a4a3-0307f4e87dbc',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 607.255879] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 607.256377] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 607.256377] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 607.256548] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 607.256697] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 607.270196] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 00a251e9-7a00-4293-9092-9556bc8b91c2 in Status: IN_PROGRESS for 2s [ 607.703580] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 5bffe63c-4d97-4183-a4a3-0307f4e87dbc [ 607.704182] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 607.704182] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 607.704182] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 607.704535] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 607.704535] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 607.704623] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:5bffe63c-4d97-4183-a4a3-0307f4e87dbc already deleted. [ 607.704674] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-5bffe63c-4d97-4183-a4a3-0307f4e87dbc" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 607.902918] env[65370]: INFO networking_nsxv3.common.synchronization [req-c4808f95-de7c-4412-a7ca-7a4c20040828 req-7c2f2e43-7919-40c7-a866-2cf4e004d3c4 tempest-VolumesAssistedSnapshotsTest-1217946812 tempest-VolumesAssistedSnapshotsTest-1217946812-project-member] Enqueued Resource ID: ade9055b-2ef9-426f-9386-65654700ee06 with Priority: HIGHEST for action security_group_members [ 607.902918] env[65370]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ade9055b-2ef9-426f-9386-65654700ee06 with Priority: HIGHEST for action security_group_members [ 607.902918] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock member-ade9055b-2ef9-426f-9386-65654700ee06 taken with stack trace [, , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 607.902918] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ade9055b-2ef9-426f-9386-65654700ee06" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 607.902918] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ade9055b-2ef9-426f-9386-65654700ee06" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 607.903429] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ade9055b-2ef9-426f-9386-65654700ee06" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 607.904610] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 607.905557] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 607.905557] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 607.905557] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 607.907254] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 607.907254] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ade9055b-2ef9-426f-9386-65654700ee06',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 608.334702] env[65370]: DEBUG networking_nsxv3.common.locking [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Lock network-28 taken with stack trace [, , , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 608.334702] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquiring lock "network-28" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 608.334702] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquired lock "network-28" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 608.334702] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquired external semaphore "network-28" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 608.334702] env[65370]: DEBUG networking_nsxv3.common.locking [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 608.334702] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquiring lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 608.334702] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquired lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 608.334702] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquired external semaphore "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 608.338092] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Releasing lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 608.338439] env[65370]: DEBUG dogpile.cache.region [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] No value present for key: 'zone-id' {{(pid=65370) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 608.338756] env[65370]: DEBUG dogpile.lock [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] NeedRegenerationException {{(pid=65370) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 608.338756] env[65370]: DEBUG dogpile.lock [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] no value, waiting for create lock {{(pid=65370) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 608.338848] env[65370]: DEBUG dogpile.lock [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] value creation lock acquired {{(pid=65370) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 608.338882] env[65370]: DEBUG dogpile.cache.region [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] No value present for key: 'zone-id' {{(pid=65370) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 608.339679] env[65370]: DEBUG dogpile.lock [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Calling creation function for not-yet-present value {{(pid=65370) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 608.339679] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 608.361188] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 608.361417] env[65370]: DEBUG dogpile.cache.region [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=65370) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 608.361680] env[65370]: DEBUG dogpile.lock [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Released creation lock {{(pid=65370) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 608.361800] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Releasing lock "network-28" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 608.362162] env[65370]: DEBUG networking_nsxv3.common.locking [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Lock port-2da1f2bc-e97e-472e-8cb8-fa915fc3fa31 taken with stack trace [, , , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 608.362333] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquiring lock "port-2da1f2bc-e97e-472e-8cb8-fa915fc3fa31" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 608.362445] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquired lock "port-2da1f2bc-e97e-472e-8cb8-fa915fc3fa31" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 608.362800] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquired external semaphore "port-2da1f2bc-e97e-472e-8cb8-fa915fc3fa31" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 608.362904] env[65370]: DEBUG networking_nsxv3.api.rpc [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2da1f2bc-e97e-472e-8cb8-fa915fc3fa31',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 608.408140] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 608.408386] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 608.408493] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 608.408746] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 608.408841] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 608.409052] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 608.409151] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 608.409214] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 608.409458] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 608.409458] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 608.409554] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ade9055b-2ef9-426f-9386-65654700ee06 already deleted. [ 608.409593] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ade9055b-2ef9-426f-9386-65654700ee06" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 608.866346] env[65370]: DEBUG networking_nsxv3.common.locking [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 608.866558] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquiring lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 608.866715] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquired lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 608.866945] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquired external semaphore "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 608.867121] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Releasing lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 608.867274] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Segment Port 2da1f2bc-e97e-472e-8cb8-fa915fc3fa31 not found, creating... [ 608.867590] env[65370]: DEBUG networking_nsxv3.common.locking [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 608.867708] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquiring lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 608.867831] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquired lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 608.868045] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquired external semaphore "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 608.868204] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Releasing lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 608.868562] env[65370]: DEBUG networking_nsxv3.common.locking [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 608.868736] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquiring lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 608.868850] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquired lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 608.869225] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquired external semaphore "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 608.869404] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Releasing lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 608.869586] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Resource: SegmentPort with ID: 2da1f2bc-e97e-472e-8cb8-fa915fc3fa31 is going to be created. [ 608.892795] env[65370]: DEBUG networking_nsxv3.common.locking [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 608.893069] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquiring lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 608.893232] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquired lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 608.893634] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquired external semaphore "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 608.893969] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Releasing lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 608.894233] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Releasing lock "port-2da1f2bc-e97e-472e-8cb8-fa915fc3fa31" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 609.203488] env[65370]: INFO networking_nsxv3.common.synchronization [None req-70fb3d9c-ffa4-4a99-b4d6-1eb8801cc222 tempest-ServersWithSpecificFlavorTestJSON-1546929489 tempest-ServersWithSpecificFlavorTestJSON-1546929489-project-member] Enqueued Resource ID: b8e66f81-0f32-48b8-b81f-542b74cbecd4 with Priority: HIGHEST for action security_group_rules [ 609.204744] env[65370]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b8e66f81-0f32-48b8-b81f-542b74cbecd4 with Priority: HIGHEST for action security_group_rules [ 609.204744] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock rules-b8e66f81-0f32-48b8-b81f-542b74cbecd4 taken with stack trace [, , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 609.204744] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-b8e66f81-0f32-48b8-b81f-542b74cbecd4" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 609.204744] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-b8e66f81-0f32-48b8-b81f-542b74cbecd4" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 609.205106] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-b8e66f81-0f32-48b8-b81f-542b74cbecd4" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 609.205106] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('b8e66f81-0f32-48b8-b81f-542b74cbecd4',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 609.283113] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 00a251e9-7a00-4293-9092-9556bc8b91c2 in Status: SUCCESS [ 609.283113] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-00a251e9-7a00-4293-9092-9556bc8b91c2" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 609.523526] env[65370]: INFO networking_nsxv3.common.synchronization [req-d6846176-1d60-4ed0-9860-d25510787f19 req-17b0b2a4-f117-4ab4-986a-1de1ee7da925 tempest-ImagesNegativeTestJSON-2112195763 tempest-ImagesNegativeTestJSON-2112195763-project-member] Enqueued Resource ID: 7c93cef4-117c-4bf3-aaf5-07dadeb90a88 with Priority: HIGHEST for action security_group_members [ 609.523947] env[65370]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7c93cef4-117c-4bf3-aaf5-07dadeb90a88 with Priority: HIGHEST for action security_group_members [ 609.524394] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock member-7c93cef4-117c-4bf3-aaf5-07dadeb90a88 taken with stack trace [, , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 609.524457] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7c93cef4-117c-4bf3-aaf5-07dadeb90a88" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 609.524514] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7c93cef4-117c-4bf3-aaf5-07dadeb90a88" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 609.524868] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7c93cef4-117c-4bf3-aaf5-07dadeb90a88" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 609.524993] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 609.525233] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 609.525233] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 609.525758] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 609.525758] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 609.525758] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7c93cef4-117c-4bf3-aaf5-07dadeb90a88',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 609.614689] env[65370]: INFO networking_nsxv3.common.synchronization [req-c4808f95-de7c-4412-a7ca-7a4c20040828 req-4c235fb0-cc96-45c1-9c4d-af016b297ea8 service nova] Enqueued Resource ID: ade9055b-2ef9-426f-9386-65654700ee06 with Priority: HIGHEST for action security_group_rules [ 609.614689] env[65370]: INFO networking_nsxv3.common.synchronization [req-c4808f95-de7c-4412-a7ca-7a4c20040828 req-4c235fb0-cc96-45c1-9c4d-af016b297ea8 service nova] Enqueued Resource ID: ade9055b-2ef9-426f-9386-65654700ee06 with Priority: HIGHEST for action security_group_members [ 609.614689] env[65370]: INFO networking_nsxv3.common.synchronization [req-c4808f95-de7c-4412-a7ca-7a4c20040828 req-4c235fb0-cc96-45c1-9c4d-af016b297ea8 service nova] Enqueued Resource ID: 2da1f2bc-e97e-472e-8cb8-fa915fc3fa31 with Priority: HIGHEST for action port [ 609.614689] env[65370]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ade9055b-2ef9-426f-9386-65654700ee06 with Priority: HIGHEST for action security_group_rules [ 609.614689] env[65370]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ade9055b-2ef9-426f-9386-65654700ee06 with Priority: HIGHEST for action security_group_members [ 609.614689] env[65370]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2da1f2bc-e97e-472e-8cb8-fa915fc3fa31 with Priority: HIGHEST for action port [ 609.615104] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock rules-ade9055b-2ef9-426f-9386-65654700ee06 taken with stack trace [, , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 609.615153] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-ade9055b-2ef9-426f-9386-65654700ee06" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 609.615240] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-ade9055b-2ef9-426f-9386-65654700ee06" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 609.615405] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-ade9055b-2ef9-426f-9386-65654700ee06" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 609.615507] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('ade9055b-2ef9-426f-9386-65654700ee06',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 609.616447] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock member-ade9055b-2ef9-426f-9386-65654700ee06 taken with stack trace [, , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 609.616447] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ade9055b-2ef9-426f-9386-65654700ee06" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 609.616620] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ade9055b-2ef9-426f-9386-65654700ee06" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 609.616674] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ade9055b-2ef9-426f-9386-65654700ee06" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 609.616818] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 609.616937] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 609.617026] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 609.617150] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 609.617237] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 609.617326] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ade9055b-2ef9-426f-9386-65654700ee06',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 609.618059] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock port-2da1f2bc-e97e-472e-8cb8-fa915fc3fa31 taken with stack trace [, , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 609.618171] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-2da1f2bc-e97e-472e-8cb8-fa915fc3fa31" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 609.618237] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-2da1f2bc-e97e-472e-8cb8-fa915fc3fa31" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 609.618387] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-2da1f2bc-e97e-472e-8cb8-fa915fc3fa31" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 609.618460] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2da1f2bc-e97e-472e-8cb8-fa915fc3fa31',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 609.730015] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 609.730015] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 609.730015] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 609.730015] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 609.730015] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 609.730015] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: b8e66f81-0f32-48b8-b81f-542b74cbecd4 already deleted. [ 609.730015] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-b8e66f81-0f32-48b8-b81f-542b74cbecd4" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 609.908760] env[65370]: INFO networking_nsxv3.common.synchronization [None req-0f98bbd6-0ba1-4496-a4c3-1bfc9438936d tempest-ServersWithSpecificFlavorTestJSON-1546929489 tempest-ServersWithSpecificFlavorTestJSON-1546929489-project-member] Enqueued Resource ID: b8e66f81-0f32-48b8-b81f-542b74cbecd4 with Priority: HIGHEST for action security_group_rules [ 609.909373] env[65370]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b8e66f81-0f32-48b8-b81f-542b74cbecd4 with Priority: HIGHEST for action security_group_rules [ 609.909641] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock rules-b8e66f81-0f32-48b8-b81f-542b74cbecd4 taken with stack trace [, , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 609.909867] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-b8e66f81-0f32-48b8-b81f-542b74cbecd4" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 609.909867] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-b8e66f81-0f32-48b8-b81f-542b74cbecd4" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 609.910263] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-b8e66f81-0f32-48b8-b81f-542b74cbecd4" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 609.910263] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('b8e66f81-0f32-48b8-b81f-542b74cbecd4',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 610.029228] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 610.029490] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 610.029565] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 610.029798] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 610.029893] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 610.030120] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 610.030218] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 610.030294] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 610.030445] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 610.030525] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 610.030612] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7c93cef4-117c-4bf3-aaf5-07dadeb90a88 is going to be updated. [ 610.120257] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock member-ade9055b-2ef9-426f-9386-65654700ee06 taken with stack trace [, , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 610.120490] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ade9055b-2ef9-426f-9386-65654700ee06" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 610.121286] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('ade9055b-2ef9-426f-9386-65654700ee06',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 610.121917] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 2da1f2bc-e97e-472e-8cb8-fa915fc3fa31 with status ACTIVE [ 610.122135] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 610.122269] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 610.122334] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 610.122737] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 610.122737] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 610.122866] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 610.122967] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 610.123189] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 610.123404] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 610.123726] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 610.123726] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 610.123860] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 610.123918] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 610.124218] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 610.124218] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 610.124584] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 2da1f2bc-e97e-472e-8cb8-fa915fc3fa31 is going to be updated. [ 610.137885] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 610.138085] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 610.138147] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 610.138399] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 610.138557] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 610.154069] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 610.154239] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 610.154357] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 610.154575] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 610.154829] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 610.154951] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-2da1f2bc-e97e-472e-8cb8-fa915fc3fa31" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 610.160378] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7c93cef4-117c-4bf3-aaf5-07dadeb90a88 in Status: IN_PROGRESS for 2s [ 610.432686] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 610.433038] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 610.433038] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 610.433151] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 610.433217] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 610.433309] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: b8e66f81-0f32-48b8-b81f-542b74cbecd4 already deleted. [ 610.433385] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-b8e66f81-0f32-48b8-b81f-542b74cbecd4" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 610.628088] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('ade9055b-2ef9-426f-9386-65654700ee06',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 611.130071] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 611.130242] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 611.130757] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 611.131044] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 611.131111] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 611.131278] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ade9055b-2ef9-426f-9386-65654700ee06 is going to be created. [ 611.166402] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 611.166622] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 611.166694] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 611.167700] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 611.167878] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 611.179631] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ade9055b-2ef9-426f-9386-65654700ee06 in Status: UNINITIALIZED for 2s [ 611.292143] env[65370]: INFO networking_nsxv3.common.synchronization [None req-749477f6-5f5f-43d0-a66d-80f075873347 None None] Enqueued Resource ID: a8999434-1a50-4ef9-a570-024e0ce111ca with Priority: HIGHEST for action port [ 611.292695] env[65370]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a8999434-1a50-4ef9-a570-024e0ce111ca with Priority: HIGHEST for action port [ 611.294033] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock port-a8999434-1a50-4ef9-a570-024e0ce111ca taken with stack trace [, , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 611.294033] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-a8999434-1a50-4ef9-a570-024e0ce111ca" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 611.294033] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-a8999434-1a50-4ef9-a570-024e0ce111ca" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 611.294033] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-a8999434-1a50-4ef9-a570-024e0ce111ca" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 611.294033] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a8999434-1a50-4ef9-a570-024e0ce111ca',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 611.797779] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port a8999434-1a50-4ef9-a570-024e0ce111ca [ 611.797779] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 611.798297] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 611.801739] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 611.801739] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 611.801739] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 611.801739] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:a8999434-1a50-4ef9-a570-024e0ce111ca already deleted. [ 611.801739] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-a8999434-1a50-4ef9-a570-024e0ce111ca" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 612.030085] env[65370]: INFO networking_nsxv3.common.synchronization [req-e1b09a6a-5ba4-4696-aae6-3bae7322330e req-1f9954ea-5ffc-4079-ae84-8653ec60ef26 tempest-DeleteServersAdminTestJSON-1084129215 tempest-DeleteServersAdminTestJSON-1084129215-project-admin] Enqueued Resource ID: d1777ef4-6140-42f0-bcd4-a267f85cb990 with Priority: HIGHEST for action security_group_members [ 612.030085] env[65370]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d1777ef4-6140-42f0-bcd4-a267f85cb990 with Priority: HIGHEST for action security_group_members [ 612.030494] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock member-d1777ef4-6140-42f0-bcd4-a267f85cb990 taken with stack trace [, , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 612.030627] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d1777ef4-6140-42f0-bcd4-a267f85cb990" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 612.030694] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d1777ef4-6140-42f0-bcd4-a267f85cb990" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 612.031564] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d1777ef4-6140-42f0-bcd4-a267f85cb990" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 612.031564] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 612.031564] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 612.031564] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 612.031564] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 612.031564] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 612.031904] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d1777ef4-6140-42f0-bcd4-a267f85cb990',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 612.176090] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7c93cef4-117c-4bf3-aaf5-07dadeb90a88 in Status: SUCCESS [ 612.176291] env[65370]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7c93cef4-117c-4bf3-aaf5-07dadeb90a88 deletion is rescheduled due to dependency. [ 612.176413] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7c93cef4-117c-4bf3-aaf5-07dadeb90a88" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 612.247122] env[65370]: INFO networking_nsxv3.common.synchronization [None req-f14f77ec-9116-45ad-9f34-2a7f5ed1ce33 None None] Enqueued Resource ID: edc1c8f5-0404-43ea-8e02-4745211ddd84 with Priority: HIGHEST for action port [ 612.248035] env[65370]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: edc1c8f5-0404-43ea-8e02-4745211ddd84 with Priority: HIGHEST for action port [ 612.248347] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock port-edc1c8f5-0404-43ea-8e02-4745211ddd84 taken with stack trace [, , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 612.248624] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-edc1c8f5-0404-43ea-8e02-4745211ddd84" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 612.248624] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-edc1c8f5-0404-43ea-8e02-4745211ddd84" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 612.249030] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-edc1c8f5-0404-43ea-8e02-4745211ddd84" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 612.249142] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('edc1c8f5-0404-43ea-8e02-4745211ddd84',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 612.383323] env[65370]: INFO networking_nsxv3.common.synchronization [req-6a98d627-0b88-464b-b6b2-c4a2e3abe0f4 req-1aa3308d-8226-433f-885f-a0797a9a46fe tempest-ServerActionsTestOtherB-1099767447 tempest-ServerActionsTestOtherB-1099767447-project-member] Enqueued Resource ID: 2011abd7-ba10-4aae-84fb-1b1bfbd238fa with Priority: HIGHEST for action security_group_members [ 612.383323] env[65370]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2011abd7-ba10-4aae-84fb-1b1bfbd238fa with Priority: HIGHEST for action security_group_members [ 612.383688] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock member-2011abd7-ba10-4aae-84fb-1b1bfbd238fa taken with stack trace [, , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 612.383857] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2011abd7-ba10-4aae-84fb-1b1bfbd238fa" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 612.383902] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2011abd7-ba10-4aae-84fb-1b1bfbd238fa" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 612.384177] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2011abd7-ba10-4aae-84fb-1b1bfbd238fa" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 612.384329] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 612.384483] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 612.384483] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 612.384681] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 612.384804] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 612.384863] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2011abd7-ba10-4aae-84fb-1b1bfbd238fa',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 612.538015] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 612.538015] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 612.538015] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 612.538015] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 612.538015] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 612.538015] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 612.538015] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 612.538015] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 612.538015] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 612.538015] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 612.538015] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d1777ef4-6140-42f0-bcd4-a267f85cb990 is going to be updated. [ 612.576202] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 612.576368] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 612.576460] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 612.576711] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 612.576890] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 612.589765] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d1777ef4-6140-42f0-bcd4-a267f85cb990 in Status: IN_PROGRESS for 2s [ 612.752668] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port edc1c8f5-0404-43ea-8e02-4745211ddd84 [ 612.752668] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 612.752668] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 612.752668] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 612.752668] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 612.753054] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 612.753054] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:edc1c8f5-0404-43ea-8e02-4745211ddd84 already deleted. [ 612.753054] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-edc1c8f5-0404-43ea-8e02-4745211ddd84" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 612.888034] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 612.888034] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 612.888034] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 612.888640] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 612.889153] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 612.889273] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 612.889830] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 612.889830] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 612.889830] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 612.889830] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 612.889957] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2011abd7-ba10-4aae-84fb-1b1bfbd238fa already deleted. [ 612.890469] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2011abd7-ba10-4aae-84fb-1b1bfbd238fa" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 612.931098] env[65370]: DEBUG networking_nsxv3.common.locking [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Lock network-93 taken with stack trace [, , , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 612.931098] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquiring lock "network-93" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 612.931098] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquired lock "network-93" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 612.931098] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquired external semaphore "network-93" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 612.931546] env[65370]: DEBUG networking_nsxv3.common.locking [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 612.931709] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquiring lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 612.931824] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquired lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 612.932198] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquired external semaphore "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 612.936225] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Releasing lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 612.936225] env[65370]: DEBUG dogpile.cache.region [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] No value present for key: 'zone-id' {{(pid=65370) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 612.936225] env[65370]: DEBUG dogpile.lock [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] NeedRegenerationException {{(pid=65370) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 612.936225] env[65370]: DEBUG dogpile.lock [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] no value, waiting for create lock {{(pid=65370) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 612.936225] env[65370]: DEBUG dogpile.lock [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] value creation lock acquired {{(pid=65370) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 612.936225] env[65370]: DEBUG dogpile.cache.region [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] No value present for key: 'zone-id' {{(pid=65370) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 612.936225] env[65370]: DEBUG dogpile.lock [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Calling creation function for not-yet-present value {{(pid=65370) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 612.936225] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 612.954240] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 612.956196] env[65370]: DEBUG dogpile.cache.region [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=65370) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 612.956427] env[65370]: DEBUG dogpile.lock [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Released creation lock {{(pid=65370) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 612.956611] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Releasing lock "network-93" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 612.956943] env[65370]: DEBUG networking_nsxv3.common.locking [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Lock port-94585bf9-a1ee-44f0-8e4c-1031bf9b22d2 taken with stack trace [, , , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 612.957219] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquiring lock "port-94585bf9-a1ee-44f0-8e4c-1031bf9b22d2" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 612.957293] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquired lock "port-94585bf9-a1ee-44f0-8e4c-1031bf9b22d2" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 612.957689] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquired external semaphore "port-94585bf9-a1ee-44f0-8e4c-1031bf9b22d2" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 612.957762] env[65370]: DEBUG networking_nsxv3.api.rpc [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('94585bf9-a1ee-44f0-8e4c-1031bf9b22d2',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 613.201045] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ade9055b-2ef9-426f-9386-65654700ee06 in Status: SUCCESS [ 613.201045] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ade9055b-2ef9-426f-9386-65654700ee06" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 613.201045] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ade9055b-2ef9-426f-9386-65654700ee06" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 613.201045] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ade9055b-2ef9-426f-9386-65654700ee06" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 613.201360] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 613.201434] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 613.201496] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 613.202303] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 613.202303] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 613.202303] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ade9055b-2ef9-426f-9386-65654700ee06" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 613.202303] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('ade9055b-2ef9-426f-9386-65654700ee06',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 613.460349] env[65370]: DEBUG networking_nsxv3.common.locking [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 613.460608] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquiring lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 613.460856] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquired lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 613.461270] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquired external semaphore "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 613.461454] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Releasing lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 613.461679] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Segment Port 94585bf9-a1ee-44f0-8e4c-1031bf9b22d2 not found, creating... [ 613.461988] env[65370]: DEBUG networking_nsxv3.common.locking [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 613.462627] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquiring lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 613.462627] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquired lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 613.462783] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquired external semaphore "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 613.462843] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Releasing lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 613.463198] env[65370]: DEBUG networking_nsxv3.common.locking [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 613.463433] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquiring lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 613.463995] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquired lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 613.463995] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquired external semaphore "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 613.463995] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Releasing lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 613.464149] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Resource: SegmentPort with ID: 94585bf9-a1ee-44f0-8e4c-1031bf9b22d2 is going to be created. [ 613.494310] env[65370]: DEBUG networking_nsxv3.common.locking [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 613.494310] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquiring lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 613.494310] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquired lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 613.494310] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquired external semaphore "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 613.494310] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Releasing lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 613.495312] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Releasing lock "port-94585bf9-a1ee-44f0-8e4c-1031bf9b22d2" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 613.687956] env[65370]: INFO networking_nsxv3.common.synchronization [None req-a9a9f6e3-9ccc-49d0-8815-585455f930a2 None None] Enqueued Resource ID: 56a94042-1da0-4538-a42a-f21b2c097236 with Priority: HIGHEST for action port [ 613.687956] env[65370]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 56a94042-1da0-4538-a42a-f21b2c097236 with Priority: HIGHEST for action port [ 613.688557] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock port-56a94042-1da0-4538-a42a-f21b2c097236 taken with stack trace [, , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 613.688717] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-56a94042-1da0-4538-a42a-f21b2c097236" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 613.688810] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-56a94042-1da0-4538-a42a-f21b2c097236" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 613.689133] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-56a94042-1da0-4538-a42a-f21b2c097236" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 613.689234] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('56a94042-1da0-4538-a42a-f21b2c097236',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 613.704587] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('ade9055b-2ef9-426f-9386-65654700ee06',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 614.195772] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 56a94042-1da0-4538-a42a-f21b2c097236 [ 614.196618] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 614.196618] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 614.196618] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 614.196618] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 614.196618] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 614.197014] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:56a94042-1da0-4538-a42a-f21b2c097236 already deleted. [ 614.197014] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-56a94042-1da0-4538-a42a-f21b2c097236" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 614.207389] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for ade9055b-2ef9-426f-9386-65654700ee06: rpc.has_security_group_logging(os_id): False [ 614.229046] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 614.229329] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 614.229395] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 614.230988] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 614.230988] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 614.230988] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 614.230988] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 614.230988] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 614.230988] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 614.230988] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 614.230988] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: ade9055b-2ef9-426f-9386-65654700ee06 is going to be created. [ 614.238194] env[65370]: INFO networking_nsxv3.common.synchronization [req-6a98d627-0b88-464b-b6b2-c4a2e3abe0f4 req-db947a45-08db-4a45-abe0-8eaaa4a2711b service nova] Enqueued Resource ID: 2011abd7-ba10-4aae-84fb-1b1bfbd238fa with Priority: HIGHEST for action security_group_rules [ 614.238194] env[65370]: INFO networking_nsxv3.common.synchronization [req-6a98d627-0b88-464b-b6b2-c4a2e3abe0f4 req-db947a45-08db-4a45-abe0-8eaaa4a2711b service nova] Enqueued Resource ID: 2011abd7-ba10-4aae-84fb-1b1bfbd238fa with Priority: HIGHEST for action security_group_members [ 614.238194] env[65370]: INFO networking_nsxv3.common.synchronization [req-6a98d627-0b88-464b-b6b2-c4a2e3abe0f4 req-db947a45-08db-4a45-abe0-8eaaa4a2711b service nova] Enqueued Resource ID: 94585bf9-a1ee-44f0-8e4c-1031bf9b22d2 with Priority: HIGHEST for action port [ 614.238194] env[65370]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2011abd7-ba10-4aae-84fb-1b1bfbd238fa with Priority: HIGHEST for action security_group_rules [ 614.238194] env[65370]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2011abd7-ba10-4aae-84fb-1b1bfbd238fa with Priority: HIGHEST for action security_group_members [ 614.238194] env[65370]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 94585bf9-a1ee-44f0-8e4c-1031bf9b22d2 with Priority: HIGHEST for action port [ 614.238194] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock rules-2011abd7-ba10-4aae-84fb-1b1bfbd238fa taken with stack trace [, , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 614.238194] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-2011abd7-ba10-4aae-84fb-1b1bfbd238fa" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 614.238194] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-2011abd7-ba10-4aae-84fb-1b1bfbd238fa" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 614.238194] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-2011abd7-ba10-4aae-84fb-1b1bfbd238fa" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 614.238194] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('2011abd7-ba10-4aae-84fb-1b1bfbd238fa',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 614.239854] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock member-2011abd7-ba10-4aae-84fb-1b1bfbd238fa taken with stack trace [, , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 614.240037] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2011abd7-ba10-4aae-84fb-1b1bfbd238fa" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 614.240096] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2011abd7-ba10-4aae-84fb-1b1bfbd238fa" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 614.240237] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2011abd7-ba10-4aae-84fb-1b1bfbd238fa" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 614.240390] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 614.241079] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 614.241242] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 614.242094] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 614.242094] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 614.242094] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2011abd7-ba10-4aae-84fb-1b1bfbd238fa',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 614.242769] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock port-94585bf9-a1ee-44f0-8e4c-1031bf9b22d2 taken with stack trace [, , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 614.244174] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-94585bf9-a1ee-44f0-8e4c-1031bf9b22d2" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 614.244174] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-94585bf9-a1ee-44f0-8e4c-1031bf9b22d2" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 614.244254] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-94585bf9-a1ee-44f0-8e4c-1031bf9b22d2" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 614.244700] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('94585bf9-a1ee-44f0-8e4c-1031bf9b22d2',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 614.324348] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 614.324348] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 614.324348] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 614.324740] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 614.324740] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 614.342075] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ade9055b-2ef9-426f-9386-65654700ee06 in Status: IN_PROGRESS for 2s [ 614.608283] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d1777ef4-6140-42f0-bcd4-a267f85cb990 in Status: SUCCESS [ 614.608481] env[65370]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d1777ef4-6140-42f0-bcd4-a267f85cb990 deletion is rescheduled due to dependency. [ 614.608609] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d1777ef4-6140-42f0-bcd4-a267f85cb990" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 614.746243] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock member-2011abd7-ba10-4aae-84fb-1b1bfbd238fa taken with stack trace [, , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 614.746413] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2011abd7-ba10-4aae-84fb-1b1bfbd238fa" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 614.747483] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('2011abd7-ba10-4aae-84fb-1b1bfbd238fa',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 614.747988] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 94585bf9-a1ee-44f0-8e4c-1031bf9b22d2 with status ACTIVE [ 614.748274] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 614.748460] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 614.748580] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 614.748897] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 614.749619] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 614.751467] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 614.751607] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 614.751676] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 614.752113] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 614.752113] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 614.752221] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 614.752437] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 614.752437] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 614.752601] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 614.752691] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 614.752962] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 94585bf9-a1ee-44f0-8e4c-1031bf9b22d2 is going to be updated. [ 614.798562] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 614.798720] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 614.798791] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 614.799011] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 614.799253] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 614.799423] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-94585bf9-a1ee-44f0-8e4c-1031bf9b22d2" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 615.077377] env[65370]: INFO networking_nsxv3.common.synchronization [None req-fca36fc4-6304-4eff-adcd-befac32bea83 None None] Enqueued Resource ID: ffbee09d-f571-49c4-bb63-71aebb81ef64 with Priority: HIGHEST for action port [ 615.079041] env[65370]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ffbee09d-f571-49c4-bb63-71aebb81ef64 with Priority: HIGHEST for action port [ 615.079222] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock port-ffbee09d-f571-49c4-bb63-71aebb81ef64 taken with stack trace [, , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 615.079823] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-ffbee09d-f571-49c4-bb63-71aebb81ef64" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 615.080078] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-ffbee09d-f571-49c4-bb63-71aebb81ef64" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 615.080512] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-ffbee09d-f571-49c4-bb63-71aebb81ef64" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 615.081396] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ffbee09d-f571-49c4-bb63-71aebb81ef64',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 615.259061] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('2011abd7-ba10-4aae-84fb-1b1bfbd238fa',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 615.583645] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port ffbee09d-f571-49c4-bb63-71aebb81ef64 [ 615.584445] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 615.584445] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 615.584445] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 615.584840] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 615.584840] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 615.584840] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:ffbee09d-f571-49c4-bb63-71aebb81ef64 already deleted. [ 615.584939] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-ffbee09d-f571-49c4-bb63-71aebb81ef64" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 615.762763] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 615.762937] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 615.762985] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 615.763242] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 615.763340] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 615.763435] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2011abd7-ba10-4aae-84fb-1b1bfbd238fa is going to be created. [ 615.793569] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 615.793569] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 615.793569] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 615.794718] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 615.794718] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 615.807560] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2011abd7-ba10-4aae-84fb-1b1bfbd238fa in Status: UNINITIALIZED for 2s [ 616.356376] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ade9055b-2ef9-426f-9386-65654700ee06 in Status: SUCCESS [ 616.356376] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-ade9055b-2ef9-426f-9386-65654700ee06" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 616.840121] env[65370]: INFO networking_nsxv3.common.synchronization [None req-be040b72-55ec-4298-b031-4b786dd5c371 None None] Enqueued Resource ID: 5c33bc01-e0ab-4e2d-a337-26a65013225e with Priority: HIGHEST for action port [ 616.840417] env[65370]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5c33bc01-e0ab-4e2d-a337-26a65013225e with Priority: HIGHEST for action port [ 616.840749] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock port-5c33bc01-e0ab-4e2d-a337-26a65013225e taken with stack trace [, , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 616.841825] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-5c33bc01-e0ab-4e2d-a337-26a65013225e" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 616.841825] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-5c33bc01-e0ab-4e2d-a337-26a65013225e" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 616.842370] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-5c33bc01-e0ab-4e2d-a337-26a65013225e" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 616.842674] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5c33bc01-e0ab-4e2d-a337-26a65013225e',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 617.345830] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 5c33bc01-e0ab-4e2d-a337-26a65013225e [ 617.346150] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 617.346311] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 617.346402] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 617.347389] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 617.347484] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 617.347598] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:5c33bc01-e0ab-4e2d-a337-26a65013225e already deleted. [ 617.348277] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-5c33bc01-e0ab-4e2d-a337-26a65013225e" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 617.501498] env[65370]: INFO networking_nsxv3.common.synchronization [req-e3163ce6-4e4d-402f-9af1-05e73bc19dc9 req-5198116d-68e7-402b-a6e2-032d8cd24c44 tempest-ServerDiagnosticsNegativeTest-1411090309 tempest-ServerDiagnosticsNegativeTest-1411090309-project-member] Enqueued Resource ID: 81833a12-37d8-4ada-8f82-01b16a0f7a0a with Priority: HIGHEST for action security_group_members [ 617.502378] env[65370]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 81833a12-37d8-4ada-8f82-01b16a0f7a0a with Priority: HIGHEST for action security_group_members [ 617.503395] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock member-81833a12-37d8-4ada-8f82-01b16a0f7a0a taken with stack trace [, , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 617.503830] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-81833a12-37d8-4ada-8f82-01b16a0f7a0a" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 617.503931] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-81833a12-37d8-4ada-8f82-01b16a0f7a0a" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 617.505055] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-81833a12-37d8-4ada-8f82-01b16a0f7a0a" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 617.505055] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 617.505055] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 617.505055] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 617.505055] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 617.505055] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 617.505055] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('81833a12-37d8-4ada-8f82-01b16a0f7a0a',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 617.821495] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2011abd7-ba10-4aae-84fb-1b1bfbd238fa in Status: SUCCESS [ 617.821495] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2011abd7-ba10-4aae-84fb-1b1bfbd238fa" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 617.821495] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2011abd7-ba10-4aae-84fb-1b1bfbd238fa" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 617.821495] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2011abd7-ba10-4aae-84fb-1b1bfbd238fa" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 617.821770] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 617.822026] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 617.822026] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 617.822425] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 617.822425] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 617.822425] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2011abd7-ba10-4aae-84fb-1b1bfbd238fa" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 617.822510] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('2011abd7-ba10-4aae-84fb-1b1bfbd238fa',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 618.008564] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 618.008711] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 618.008809] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 618.008965] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 618.009073] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 618.009352] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 618.009412] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 618.009445] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 618.009577] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 618.009676] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 618.009763] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 81833a12-37d8-4ada-8f82-01b16a0f7a0a is going to be updated. [ 618.042353] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 618.042353] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 618.042753] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 618.043081] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 618.043161] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 618.054353] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 81833a12-37d8-4ada-8f82-01b16a0f7a0a in Status: IN_PROGRESS for 2s [ 618.275467] env[65370]: INFO networking_nsxv3.common.synchronization [req-31076e3e-4b30-412b-9aff-02c2c017f358 req-a876ebf1-3cad-4991-9afe-be2bd25f2552 tempest-ImagesTestJSON-246049254 tempest-ImagesTestJSON-246049254-project-member] Enqueued Resource ID: 67f4a0c1-3a3c-4ed8-9358-3a9645aba154 with Priority: HIGHEST for action security_group_members [ 618.276488] env[65370]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 67f4a0c1-3a3c-4ed8-9358-3a9645aba154 with Priority: HIGHEST for action security_group_members [ 618.276488] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock member-67f4a0c1-3a3c-4ed8-9358-3a9645aba154 taken with stack trace [, , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 618.276917] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-67f4a0c1-3a3c-4ed8-9358-3a9645aba154" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 618.276917] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-67f4a0c1-3a3c-4ed8-9358-3a9645aba154" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 618.276917] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-67f4a0c1-3a3c-4ed8-9358-3a9645aba154" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 618.277495] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 618.277495] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 618.277495] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 618.277789] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 618.277875] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 618.277963] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('67f4a0c1-3a3c-4ed8-9358-3a9645aba154',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 618.326126] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('2011abd7-ba10-4aae-84fb-1b1bfbd238fa',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 618.783438] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 618.783438] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 618.783438] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 618.783438] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 618.783438] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 618.783438] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 618.783438] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 618.783438] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 618.783438] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 618.783438] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 618.783438] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 67f4a0c1-3a3c-4ed8-9358-3a9645aba154 already deleted. [ 618.783438] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-67f4a0c1-3a3c-4ed8-9358-3a9645aba154" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 618.827439] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 2011abd7-ba10-4aae-84fb-1b1bfbd238fa: rpc.has_security_group_logging(os_id): False [ 618.847254] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 618.847440] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 618.847498] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 618.848516] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 618.848516] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 618.848516] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 618.848516] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 618.848516] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 618.848695] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 618.848695] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 618.848772] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 2011abd7-ba10-4aae-84fb-1b1bfbd238fa is going to be created. [ 618.855868] env[65370]: DEBUG networking_nsxv3.common.locking [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Lock network-955 taken with stack trace [, , , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 618.856108] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquiring lock "network-955" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 618.856186] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquired lock "network-955" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 618.856503] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquired external semaphore "network-955" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 618.856757] env[65370]: DEBUG networking_nsxv3.common.locking [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 618.856910] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquiring lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 618.857028] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquired lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 618.857244] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquired external semaphore "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 618.857381] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Releasing lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 618.857578] env[65370]: DEBUG dogpile.cache.region [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] No value present for key: 'zone-id' {{(pid=65370) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 618.857704] env[65370]: DEBUG dogpile.lock [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] NeedRegenerationException {{(pid=65370) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 618.857811] env[65370]: DEBUG dogpile.lock [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] no value, waiting for create lock {{(pid=65370) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 618.857913] env[65370]: DEBUG dogpile.lock [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] value creation lock acquired {{(pid=65370) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 618.858023] env[65370]: DEBUG dogpile.cache.region [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] No value present for key: 'zone-id' {{(pid=65370) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 618.858123] env[65370]: DEBUG dogpile.lock [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Calling creation function for not-yet-present value {{(pid=65370) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 618.858246] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 618.886434] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 618.886701] env[65370]: DEBUG dogpile.cache.region [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Cache value generated in 0.028 seconds for key(s): 'zone-id' {{(pid=65370) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 618.886948] env[65370]: DEBUG dogpile.lock [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Released creation lock {{(pid=65370) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 618.887264] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Releasing lock "network-955" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 618.887708] env[65370]: DEBUG networking_nsxv3.common.locking [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Lock port-74626168-9cdc-4860-b67c-3d92ac41f2af taken with stack trace [, , , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 618.887957] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquiring lock "port-74626168-9cdc-4860-b67c-3d92ac41f2af" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 618.888594] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquired lock "port-74626168-9cdc-4860-b67c-3d92ac41f2af" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 618.889073] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquired external semaphore "port-74626168-9cdc-4860-b67c-3d92ac41f2af" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 618.889489] env[65370]: DEBUG networking_nsxv3.api.rpc [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('74626168-9cdc-4860-b67c-3d92ac41f2af',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 618.925398] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 618.925398] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 618.925522] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 618.925693] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 618.925893] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 618.940164] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 2011abd7-ba10-4aae-84fb-1b1bfbd238fa in Status: IN_PROGRESS for 2s [ 619.398021] env[65370]: DEBUG networking_nsxv3.common.locking [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 619.398021] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquiring lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 619.398021] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquired lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 619.398021] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquired external semaphore "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 619.398021] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Releasing lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 619.398021] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Segment Port 74626168-9cdc-4860-b67c-3d92ac41f2af not found, creating... [ 619.398021] env[65370]: DEBUG networking_nsxv3.common.locking [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 619.398021] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquiring lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 619.398021] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquired lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 619.398021] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquired external semaphore "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 619.398021] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Releasing lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 619.398642] env[65370]: DEBUG networking_nsxv3.common.locking [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 619.398642] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquiring lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 619.398642] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquired lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 619.399069] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquired external semaphore "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 619.400120] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Releasing lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 619.400384] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Resource: SegmentPort with ID: 74626168-9cdc-4860-b67c-3d92ac41f2af is going to be created. [ 619.425137] env[65370]: DEBUG networking_nsxv3.common.locking [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 619.425137] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquiring lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 619.425137] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquired lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 619.425137] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquired external semaphore "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 619.425137] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Releasing lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 619.425137] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Releasing lock "port-74626168-9cdc-4860-b67c-3d92ac41f2af" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 619.506380] env[65370]: INFO networking_nsxv3.common.synchronization [None req-7d16cbfe-3ad2-4b87-b97f-ecc722177d8e None None] Enqueued Resource ID: ca5172b4-a4e4-4ab0-bc49-297210d76e4f with Priority: HIGHEST for action port [ 619.506380] env[65370]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ca5172b4-a4e4-4ab0-bc49-297210d76e4f with Priority: HIGHEST for action port [ 619.506808] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock port-ca5172b4-a4e4-4ab0-bc49-297210d76e4f taken with stack trace [, , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 619.506808] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-ca5172b4-a4e4-4ab0-bc49-297210d76e4f" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 619.507058] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-ca5172b4-a4e4-4ab0-bc49-297210d76e4f" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 619.507156] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-ca5172b4-a4e4-4ab0-bc49-297210d76e4f" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 619.507243] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ca5172b4-a4e4-4ab0-bc49-297210d76e4f',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 620.010714] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port ca5172b4-a4e4-4ab0-bc49-297210d76e4f [ 620.011108] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 620.011108] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 620.011282] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 620.011362] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 620.011491] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 620.011563] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:ca5172b4-a4e4-4ab0-bc49-297210d76e4f already deleted. [ 620.011635] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-ca5172b4-a4e4-4ab0-bc49-297210d76e4f" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 620.078216] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 81833a12-37d8-4ada-8f82-01b16a0f7a0a in Status: SUCCESS [ 620.078431] env[65370]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 81833a12-37d8-4ada-8f82-01b16a0f7a0a deletion is rescheduled due to dependency. [ 620.078557] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-81833a12-37d8-4ada-8f82-01b16a0f7a0a" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 620.160439] env[65370]: INFO networking_nsxv3.common.synchronization [req-31076e3e-4b30-412b-9aff-02c2c017f358 req-1386a4f7-10fc-489b-bf6f-a7612480038b service nova] Enqueued Resource ID: 67f4a0c1-3a3c-4ed8-9358-3a9645aba154 with Priority: HIGHEST for action security_group_rules [ 620.161501] env[65370]: INFO networking_nsxv3.common.synchronization [req-31076e3e-4b30-412b-9aff-02c2c017f358 req-1386a4f7-10fc-489b-bf6f-a7612480038b service nova] Enqueued Resource ID: 67f4a0c1-3a3c-4ed8-9358-3a9645aba154 with Priority: HIGHEST for action security_group_members [ 620.161501] env[65370]: INFO networking_nsxv3.common.synchronization [req-31076e3e-4b30-412b-9aff-02c2c017f358 req-1386a4f7-10fc-489b-bf6f-a7612480038b service nova] Enqueued Resource ID: 74626168-9cdc-4860-b67c-3d92ac41f2af with Priority: HIGHEST for action port [ 620.165284] env[65370]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 67f4a0c1-3a3c-4ed8-9358-3a9645aba154 with Priority: HIGHEST for action security_group_rules [ 620.166146] env[65370]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 67f4a0c1-3a3c-4ed8-9358-3a9645aba154 with Priority: HIGHEST for action security_group_members [ 620.166146] env[65370]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 74626168-9cdc-4860-b67c-3d92ac41f2af with Priority: HIGHEST for action port [ 620.166146] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock rules-67f4a0c1-3a3c-4ed8-9358-3a9645aba154 taken with stack trace [, , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 620.166374] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-67f4a0c1-3a3c-4ed8-9358-3a9645aba154" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 620.166374] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-67f4a0c1-3a3c-4ed8-9358-3a9645aba154" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 620.166690] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-67f4a0c1-3a3c-4ed8-9358-3a9645aba154" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 620.166690] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('67f4a0c1-3a3c-4ed8-9358-3a9645aba154',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 620.167681] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock member-67f4a0c1-3a3c-4ed8-9358-3a9645aba154 taken with stack trace [, , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 620.171457] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-67f4a0c1-3a3c-4ed8-9358-3a9645aba154" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 620.171571] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-67f4a0c1-3a3c-4ed8-9358-3a9645aba154" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 620.172138] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-67f4a0c1-3a3c-4ed8-9358-3a9645aba154" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 620.172138] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 620.172138] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 620.172381] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 620.173362] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 620.173965] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 620.173965] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('67f4a0c1-3a3c-4ed8-9358-3a9645aba154',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 620.175349] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock port-74626168-9cdc-4860-b67c-3d92ac41f2af taken with stack trace [, , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 620.175617] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-74626168-9cdc-4860-b67c-3d92ac41f2af" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 620.175617] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-74626168-9cdc-4860-b67c-3d92ac41f2af" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 620.175845] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-74626168-9cdc-4860-b67c-3d92ac41f2af" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 620.175969] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('74626168-9cdc-4860-b67c-3d92ac41f2af',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 620.677974] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock member-67f4a0c1-3a3c-4ed8-9358-3a9645aba154 taken with stack trace [, , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 620.678386] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-67f4a0c1-3a3c-4ed8-9358-3a9645aba154" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 620.678386] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('67f4a0c1-3a3c-4ed8-9358-3a9645aba154',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 620.682065] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 74626168-9cdc-4860-b67c-3d92ac41f2af with status ACTIVE [ 620.682303] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 620.682395] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 620.682481] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 620.682693] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 620.683912] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 620.683912] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 620.683912] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 620.683912] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 620.683912] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 620.683912] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 620.683912] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 620.683912] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 620.683912] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 620.683912] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 620.683912] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 620.683912] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 74626168-9cdc-4860-b67c-3d92ac41f2af is going to be updated. [ 620.716052] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 620.716392] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 620.716392] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 620.716651] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 620.716795] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 620.716973] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-74626168-9cdc-4860-b67c-3d92ac41f2af" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 620.956227] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 2011abd7-ba10-4aae-84fb-1b1bfbd238fa in Status: SUCCESS [ 620.957092] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-2011abd7-ba10-4aae-84fb-1b1bfbd238fa" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 621.183476] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('67f4a0c1-3a3c-4ed8-9358-3a9645aba154',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 621.227215] env[65370]: INFO networking_nsxv3.common.synchronization [None req-66151367-8d89-488a-8097-8bbfbc760cfa None None] Enqueued Resource ID: bf12d1f9-fff3-4e10-bd5f-1a411ace55c4 with Priority: HIGHEST for action port [ 621.227215] env[65370]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bf12d1f9-fff3-4e10-bd5f-1a411ace55c4 with Priority: HIGHEST for action port [ 621.227215] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock port-bf12d1f9-fff3-4e10-bd5f-1a411ace55c4 taken with stack trace [, , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 621.227215] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-bf12d1f9-fff3-4e10-bd5f-1a411ace55c4" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 621.227215] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-bf12d1f9-fff3-4e10-bd5f-1a411ace55c4" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 621.227215] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-bf12d1f9-fff3-4e10-bd5f-1a411ace55c4" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 621.227215] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('bf12d1f9-fff3-4e10-bd5f-1a411ace55c4',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 621.562012] env[65370]: INFO networking_nsxv3.common.synchronization [None req-c064d1ab-7966-42d8-aa0f-05ae768734de None None] Enqueued Resource ID: 847c3f37-7b8e-445e-8306-a2cd89c6f8f4 with Priority: HIGHEST for action port [ 621.562721] env[65370]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 847c3f37-7b8e-445e-8306-a2cd89c6f8f4 with Priority: HIGHEST for action port [ 621.564455] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock port-847c3f37-7b8e-445e-8306-a2cd89c6f8f4 taken with stack trace [, , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 621.565296] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-847c3f37-7b8e-445e-8306-a2cd89c6f8f4" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 621.565680] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-847c3f37-7b8e-445e-8306-a2cd89c6f8f4" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 621.566100] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-847c3f37-7b8e-445e-8306-a2cd89c6f8f4" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 621.566319] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('847c3f37-7b8e-445e-8306-a2cd89c6f8f4',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 621.687283] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 621.687283] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 621.687283] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 621.687283] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 621.687283] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 621.687283] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 67f4a0c1-3a3c-4ed8-9358-3a9645aba154 is going to be created. [ 621.718076] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 621.718431] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 621.718583] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 621.720828] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 621.720828] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 621.734578] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 67f4a0c1-3a3c-4ed8-9358-3a9645aba154 in Status: UNINITIALIZED for 2s [ 621.734578] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port bf12d1f9-fff3-4e10-bd5f-1a411ace55c4 [ 621.734578] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 621.734578] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 621.734578] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 621.734929] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 621.735079] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 621.735148] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:bf12d1f9-fff3-4e10-bd5f-1a411ace55c4 already deleted. [ 621.735184] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-bf12d1f9-fff3-4e10-bd5f-1a411ace55c4" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 622.069236] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 847c3f37-7b8e-445e-8306-a2cd89c6f8f4 [ 622.069690] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 622.069874] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 622.069963] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 622.070282] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 622.070427] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 622.070582] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:847c3f37-7b8e-445e-8306-a2cd89c6f8f4 already deleted. [ 622.070914] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-847c3f37-7b8e-445e-8306-a2cd89c6f8f4" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 622.864262] env[65370]: INFO networking_nsxv3.common.synchronization [req-ec91388e-3c60-4cab-852c-1a7c79417f31 req-bc03f7ab-f53c-45c7-8ab2-0294c579306d tempest-SecurityGroupsTestJSON-1618218766 tempest-SecurityGroupsTestJSON-1618218766-project-member] Enqueued Resource ID: 8d9c7efa-60b6-44af-830b-f32145b1b403 with Priority: HIGHEST for action security_group_members [ 622.864989] env[65370]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8d9c7efa-60b6-44af-830b-f32145b1b403 with Priority: HIGHEST for action security_group_members [ 622.868059] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock member-8d9c7efa-60b6-44af-830b-f32145b1b403 taken with stack trace [, , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 622.868299] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8d9c7efa-60b6-44af-830b-f32145b1b403" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 622.868400] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8d9c7efa-60b6-44af-830b-f32145b1b403" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 622.868719] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8d9c7efa-60b6-44af-830b-f32145b1b403" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 622.869814] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 622.870669] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 622.870866] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 622.871102] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 622.871183] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 622.871288] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('8d9c7efa-60b6-44af-830b-f32145b1b403',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 623.254604] env[65370]: INFO networking_nsxv3.common.synchronization [None req-78cdf473-55d4-45cf-89aa-35a0d4bd1b75 None None] Enqueued Resource ID: f880db21-1f94-4606-a12b-accef451108b with Priority: HIGHEST for action port [ 623.254604] env[65370]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f880db21-1f94-4606-a12b-accef451108b with Priority: HIGHEST for action port [ 623.254604] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock port-f880db21-1f94-4606-a12b-accef451108b taken with stack trace [, , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 623.254778] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-f880db21-1f94-4606-a12b-accef451108b" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 623.254778] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-f880db21-1f94-4606-a12b-accef451108b" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 623.255031] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-f880db21-1f94-4606-a12b-accef451108b" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 623.257543] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f880db21-1f94-4606-a12b-accef451108b',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 623.351745] env[65370]: DEBUG networking_nsxv3.common.locking [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Lock network-633 taken with stack trace [, , , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 623.353570] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquiring lock "network-633" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 623.353570] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquired lock "network-633" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 623.353570] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquired external semaphore "network-633" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 623.353570] env[65370]: DEBUG networking_nsxv3.common.locking [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 623.353570] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquiring lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 623.353570] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquired lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 623.353570] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquired external semaphore "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 623.354022] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Releasing lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 623.354164] env[65370]: DEBUG dogpile.cache.region [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] No value present for key: 'zone-id' {{(pid=65370) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 623.354264] env[65370]: DEBUG dogpile.lock [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] NeedRegenerationException {{(pid=65370) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 623.354360] env[65370]: DEBUG dogpile.lock [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] no value, waiting for create lock {{(pid=65370) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 623.354455] env[65370]: DEBUG dogpile.lock [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] value creation lock acquired {{(pid=65370) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 623.354856] env[65370]: DEBUG dogpile.cache.region [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] No value present for key: 'zone-id' {{(pid=65370) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 623.354994] env[65370]: DEBUG dogpile.lock [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Calling creation function for not-yet-present value {{(pid=65370) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 623.355136] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 623.376608] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 623.376838] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 623.376935] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 623.377214] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 623.377312] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 623.377520] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 623.377650] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 623.377715] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 623.377874] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 623.377999] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 623.378107] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8d9c7efa-60b6-44af-830b-f32145b1b403 already deleted. [ 623.378192] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8d9c7efa-60b6-44af-830b-f32145b1b403" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 623.379399] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 623.379607] env[65370]: DEBUG dogpile.cache.region [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Cache value generated in 0.024 seconds for key(s): 'zone-id' {{(pid=65370) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 623.379821] env[65370]: DEBUG dogpile.lock [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Released creation lock {{(pid=65370) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 623.381713] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Releasing lock "network-633" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 623.381713] env[65370]: DEBUG networking_nsxv3.common.locking [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Lock port-e4267dc8-2a84-4783-8ba4-f4b822014fa5 taken with stack trace [, , , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 623.381713] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquiring lock "port-e4267dc8-2a84-4783-8ba4-f4b822014fa5" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 623.381713] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquired lock "port-e4267dc8-2a84-4783-8ba4-f4b822014fa5" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 623.382403] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquired external semaphore "port-e4267dc8-2a84-4783-8ba4-f4b822014fa5" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 623.382736] env[65370]: DEBUG networking_nsxv3.api.rpc [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e4267dc8-2a84-4783-8ba4-f4b822014fa5',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 623.744337] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 67f4a0c1-3a3c-4ed8-9358-3a9645aba154 in Status: SUCCESS [ 623.746017] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-67f4a0c1-3a3c-4ed8-9358-3a9645aba154" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 623.746292] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-67f4a0c1-3a3c-4ed8-9358-3a9645aba154" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 623.746539] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-67f4a0c1-3a3c-4ed8-9358-3a9645aba154" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 623.746740] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 623.746879] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 623.746958] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 623.747251] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 623.747251] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 623.747338] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-67f4a0c1-3a3c-4ed8-9358-3a9645aba154" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 623.747386] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('67f4a0c1-3a3c-4ed8-9358-3a9645aba154',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 623.760320] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port f880db21-1f94-4606-a12b-accef451108b [ 623.760466] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 623.761073] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 623.761073] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 623.761073] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 623.761073] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 623.761073] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:f880db21-1f94-4606-a12b-accef451108b already deleted. [ 623.761073] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-f880db21-1f94-4606-a12b-accef451108b" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 623.793622] env[65370]: INFO networking_nsxv3.common.synchronization [None req-a7f02720-60b3-40bb-88d8-0b65fa4f5d79 None None] Enqueued Resource ID: a1d638eb-2d8f-48f0-bd38-7fadc82c69dc with Priority: HIGHEST for action port [ 623.793622] env[65370]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a1d638eb-2d8f-48f0-bd38-7fadc82c69dc with Priority: HIGHEST for action port [ 623.793775] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock port-a1d638eb-2d8f-48f0-bd38-7fadc82c69dc taken with stack trace [, , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 623.793917] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-a1d638eb-2d8f-48f0-bd38-7fadc82c69dc" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 623.793917] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-a1d638eb-2d8f-48f0-bd38-7fadc82c69dc" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 623.794343] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-a1d638eb-2d8f-48f0-bd38-7fadc82c69dc" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 623.794429] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a1d638eb-2d8f-48f0-bd38-7fadc82c69dc',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 623.892024] env[65370]: DEBUG networking_nsxv3.common.locking [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 623.892024] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquiring lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 623.892024] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquired lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 623.892024] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquired external semaphore "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 623.892024] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Releasing lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 623.892024] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Segment Port e4267dc8-2a84-4783-8ba4-f4b822014fa5 not found, creating... [ 623.892024] env[65370]: DEBUG networking_nsxv3.common.locking [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 623.892024] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquiring lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 623.892024] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquired lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 623.892024] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquired external semaphore "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 623.892024] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Releasing lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 623.892750] env[65370]: DEBUG networking_nsxv3.common.locking [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 623.892750] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquiring lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 623.892750] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquired lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 623.892750] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquired external semaphore "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 623.892750] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Releasing lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 623.892750] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Resource: SegmentPort with ID: e4267dc8-2a84-4783-8ba4-f4b822014fa5 is going to be created. [ 623.922472] env[65370]: DEBUG networking_nsxv3.common.locking [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 623.922472] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquiring lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 623.922472] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquired lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 623.922849] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquired external semaphore "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 623.923452] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Releasing lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 623.923452] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Releasing lock "port-e4267dc8-2a84-4783-8ba4-f4b822014fa5" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 624.250119] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock member-67f4a0c1-3a3c-4ed8-9358-3a9645aba154 taken with stack trace [, , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 624.250362] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-67f4a0c1-3a3c-4ed8-9358-3a9645aba154" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 624.250475] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-67f4a0c1-3a3c-4ed8-9358-3a9645aba154" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 624.250715] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-67f4a0c1-3a3c-4ed8-9358-3a9645aba154" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 624.250929] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 624.251305] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 624.251421] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 624.251734] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 624.251818] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 624.251938] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-67f4a0c1-3a3c-4ed8-9358-3a9645aba154" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 624.252138] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock member-67f4a0c1-3a3c-4ed8-9358-3a9645aba154 taken with stack trace [, , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 624.252266] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-67f4a0c1-3a3c-4ed8-9358-3a9645aba154" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 624.252354] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-67f4a0c1-3a3c-4ed8-9358-3a9645aba154" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 624.252554] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-67f4a0c1-3a3c-4ed8-9358-3a9645aba154" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 624.252745] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 624.252944] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 624.253058] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 624.253244] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 624.253355] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 624.253469] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-67f4a0c1-3a3c-4ed8-9358-3a9645aba154" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 624.253591] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('67f4a0c1-3a3c-4ed8-9358-3a9645aba154',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 624.298131] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port a1d638eb-2d8f-48f0-bd38-7fadc82c69dc [ 624.298131] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 624.298131] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 624.298131] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 624.298131] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 624.298131] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 624.298980] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:a1d638eb-2d8f-48f0-bd38-7fadc82c69dc already deleted. [ 624.299156] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-a1d638eb-2d8f-48f0-bd38-7fadc82c69dc" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 624.459840] env[65370]: INFO networking_nsxv3.common.synchronization [None req-0558a4cc-5ff2-4fe5-938a-b910d4c00bda None None] Enqueued Resource ID: 9bc66341-3beb-42e7-9e3b-24990d32cdef with Priority: HIGHEST for action port [ 624.460115] env[65370]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9bc66341-3beb-42e7-9e3b-24990d32cdef with Priority: HIGHEST for action port [ 624.460516] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock port-9bc66341-3beb-42e7-9e3b-24990d32cdef taken with stack trace [, , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 624.460654] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-9bc66341-3beb-42e7-9e3b-24990d32cdef" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 624.460731] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-9bc66341-3beb-42e7-9e3b-24990d32cdef" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 624.460998] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-9bc66341-3beb-42e7-9e3b-24990d32cdef" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 624.463116] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9bc66341-3beb-42e7-9e3b-24990d32cdef',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 624.684654] env[65370]: INFO networking_nsxv3.common.synchronization [req-ec91388e-3c60-4cab-852c-1a7c79417f31 req-22b53e47-2f25-4ede-a269-246c61a80d2c service nova] Enqueued Resource ID: 8d9c7efa-60b6-44af-830b-f32145b1b403 with Priority: HIGHEST for action security_group_rules [ 624.685229] env[65370]: INFO networking_nsxv3.common.synchronization [req-ec91388e-3c60-4cab-852c-1a7c79417f31 req-22b53e47-2f25-4ede-a269-246c61a80d2c service nova] Enqueued Resource ID: 8d9c7efa-60b6-44af-830b-f32145b1b403 with Priority: HIGHEST for action security_group_members [ 624.685229] env[65370]: INFO networking_nsxv3.common.synchronization [req-ec91388e-3c60-4cab-852c-1a7c79417f31 req-22b53e47-2f25-4ede-a269-246c61a80d2c service nova] Enqueued Resource ID: e4267dc8-2a84-4783-8ba4-f4b822014fa5 with Priority: HIGHEST for action port [ 624.685829] env[65370]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8d9c7efa-60b6-44af-830b-f32145b1b403 with Priority: HIGHEST for action security_group_rules [ 624.685971] env[65370]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8d9c7efa-60b6-44af-830b-f32145b1b403 with Priority: HIGHEST for action security_group_members [ 624.686627] env[65370]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e4267dc8-2a84-4783-8ba4-f4b822014fa5 with Priority: HIGHEST for action port [ 624.686627] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock rules-8d9c7efa-60b6-44af-830b-f32145b1b403 taken with stack trace [, , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 624.687142] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-8d9c7efa-60b6-44af-830b-f32145b1b403" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 624.687142] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-8d9c7efa-60b6-44af-830b-f32145b1b403" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 624.687487] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-8d9c7efa-60b6-44af-830b-f32145b1b403" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 624.687487] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('8d9c7efa-60b6-44af-830b-f32145b1b403',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 624.688390] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock member-8d9c7efa-60b6-44af-830b-f32145b1b403 taken with stack trace [, , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 624.688611] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8d9c7efa-60b6-44af-830b-f32145b1b403" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 624.688611] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8d9c7efa-60b6-44af-830b-f32145b1b403" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 624.688773] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8d9c7efa-60b6-44af-830b-f32145b1b403" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 624.688959] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 624.689077] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 624.689247] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 624.689310] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 624.689400] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 624.689523] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('8d9c7efa-60b6-44af-830b-f32145b1b403',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 624.690439] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock port-e4267dc8-2a84-4783-8ba4-f4b822014fa5 taken with stack trace [, , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 624.690588] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-e4267dc8-2a84-4783-8ba4-f4b822014fa5" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 624.690964] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-e4267dc8-2a84-4783-8ba4-f4b822014fa5" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 624.690964] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-e4267dc8-2a84-4783-8ba4-f4b822014fa5" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 624.691140] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e4267dc8-2a84-4783-8ba4-f4b822014fa5',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 624.756095] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 67f4a0c1-3a3c-4ed8-9358-3a9645aba154: rpc.has_security_group_logging(os_id): False [ 624.783459] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 624.783459] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 624.783459] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 624.783459] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 624.783459] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 624.783459] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 624.783459] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 624.783952] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 624.783952] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 624.783952] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 624.784745] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 624.784745] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 624.784745] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 624.784745] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 624.784745] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 624.785070] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 624.785070] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 624.785187] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 624.785315] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 624.785383] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 624.785585] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 67f4a0c1-3a3c-4ed8-9358-3a9645aba154 is going to be created. [ 624.862125] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 624.862302] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 624.862302] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 624.862589] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 624.862672] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 624.880342] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 67f4a0c1-3a3c-4ed8-9358-3a9645aba154 in Status: IN_PROGRESS for 2s [ 624.966967] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 9bc66341-3beb-42e7-9e3b-24990d32cdef [ 624.967227] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 624.967357] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 624.967421] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 624.967644] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 624.967739] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 624.967845] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:9bc66341-3beb-42e7-9e3b-24990d32cdef already deleted. [ 624.967904] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-9bc66341-3beb-42e7-9e3b-24990d32cdef" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 625.182174] env[65370]: INFO networking_nsxv3.common.synchronization [None req-2cb30cb6-6253-456c-8332-f063b360fcc3 None None] Enqueued Resource ID: 7fa10275-3611-4695-83fe-d7b4caf4c768 with Priority: HIGHEST for action port [ 625.184115] env[65370]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7fa10275-3611-4695-83fe-d7b4caf4c768 with Priority: HIGHEST for action port [ 625.184613] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock port-7fa10275-3611-4695-83fe-d7b4caf4c768 taken with stack trace [, , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 625.184773] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-7fa10275-3611-4695-83fe-d7b4caf4c768" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 625.184905] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-7fa10275-3611-4695-83fe-d7b4caf4c768" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 625.185301] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-7fa10275-3611-4695-83fe-d7b4caf4c768" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 625.185389] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7fa10275-3611-4695-83fe-d7b4caf4c768',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 625.193138] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock member-8d9c7efa-60b6-44af-830b-f32145b1b403 taken with stack trace [, , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 625.193308] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8d9c7efa-60b6-44af-830b-f32145b1b403" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 625.195192] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('8d9c7efa-60b6-44af-830b-f32145b1b403',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 625.196014] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port e4267dc8-2a84-4783-8ba4-f4b822014fa5 with status ACTIVE [ 625.201376] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 625.207463] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 625.207463] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 625.207463] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 625.207463] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 625.207463] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 625.207463] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 625.207463] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 625.207463] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 625.207463] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 625.207463] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 625.207463] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 625.207463] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 625.207463] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 625.207463] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 625.207463] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: e4267dc8-2a84-4783-8ba4-f4b822014fa5 is going to be updated. [ 625.267222] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 625.267371] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 625.267713] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 625.267713] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 625.267855] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 625.267966] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-e4267dc8-2a84-4783-8ba4-f4b822014fa5" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 625.690077] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 7fa10275-3611-4695-83fe-d7b4caf4c768 [ 625.690342] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 625.690484] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 625.690552] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 625.690789] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 625.690887] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 625.690980] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:7fa10275-3611-4695-83fe-d7b4caf4c768 already deleted. [ 625.691090] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-7fa10275-3611-4695-83fe-d7b4caf4c768" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 625.710613] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('8d9c7efa-60b6-44af-830b-f32145b1b403',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 626.213733] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 626.213733] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 626.213733] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 626.213733] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 626.213733] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 626.213733] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8d9c7efa-60b6-44af-830b-f32145b1b403 is going to be created. [ 626.241805] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 626.242041] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 626.242041] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 626.242355] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 626.242502] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 626.262254] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8d9c7efa-60b6-44af-830b-f32145b1b403 in Status: UNINITIALIZED for 2s [ 626.893159] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 67f4a0c1-3a3c-4ed8-9358-3a9645aba154 in Status: SUCCESS [ 626.893378] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-67f4a0c1-3a3c-4ed8-9358-3a9645aba154" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 627.429112] env[65370]: INFO networking_nsxv3.common.synchronization [None req-1e9a1677-e6a6-4b1a-812e-639295a39b4c None None] Enqueued Resource ID: 9653b9a0-01d3-434c-ad2f-de0613809720 with Priority: HIGHEST for action port [ 627.429365] env[65370]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9653b9a0-01d3-434c-ad2f-de0613809720 with Priority: HIGHEST for action port [ 627.429593] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock port-9653b9a0-01d3-434c-ad2f-de0613809720 taken with stack trace [, , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 627.429702] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-9653b9a0-01d3-434c-ad2f-de0613809720" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 627.429740] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-9653b9a0-01d3-434c-ad2f-de0613809720" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 627.429967] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-9653b9a0-01d3-434c-ad2f-de0613809720" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 627.430085] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9653b9a0-01d3-434c-ad2f-de0613809720',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 627.648699] env[65370]: INFO networking_nsxv3.common.synchronization [req-f7da0f1f-ac6a-4f4e-99f6-72ba06ef5b5a req-98c8fbbb-8a49-4929-9b2c-81e6ecb73559 tempest-ServersWithSpecificFlavorTestJSON-1546929489 tempest-ServersWithSpecificFlavorTestJSON-1546929489-project-member] Enqueued Resource ID: b8e66f81-0f32-48b8-b81f-542b74cbecd4 with Priority: HIGHEST for action security_group_members [ 627.648699] env[65370]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b8e66f81-0f32-48b8-b81f-542b74cbecd4 with Priority: HIGHEST for action security_group_members [ 627.649033] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock member-b8e66f81-0f32-48b8-b81f-542b74cbecd4 taken with stack trace [, , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 627.649454] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b8e66f81-0f32-48b8-b81f-542b74cbecd4" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 627.649522] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b8e66f81-0f32-48b8-b81f-542b74cbecd4" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 627.649830] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b8e66f81-0f32-48b8-b81f-542b74cbecd4" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 627.650281] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 627.650281] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 627.650281] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 627.652140] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 627.652140] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 627.652140] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b8e66f81-0f32-48b8-b81f-542b74cbecd4',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 627.935983] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 9653b9a0-01d3-434c-ad2f-de0613809720 [ 627.936242] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 627.936381] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 627.936483] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 627.936664] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 627.936754] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 627.936947] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:9653b9a0-01d3-434c-ad2f-de0613809720 already deleted. [ 627.936947] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-9653b9a0-01d3-434c-ad2f-de0613809720" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 628.159710] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 628.159710] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 628.159710] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 628.159710] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 628.159710] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 628.159710] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 628.159710] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 628.159710] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 628.167038] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 628.167038] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 628.167038] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b8e66f81-0f32-48b8-b81f-542b74cbecd4 already deleted. [ 628.167038] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b8e66f81-0f32-48b8-b81f-542b74cbecd4" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 628.274861] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8d9c7efa-60b6-44af-830b-f32145b1b403 in Status: SUCCESS [ 628.275131] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8d9c7efa-60b6-44af-830b-f32145b1b403" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 628.275347] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8d9c7efa-60b6-44af-830b-f32145b1b403" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 628.276477] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8d9c7efa-60b6-44af-830b-f32145b1b403" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 628.276477] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 628.276477] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 628.276477] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 628.276477] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 628.276477] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 628.276831] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8d9c7efa-60b6-44af-830b-f32145b1b403" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 628.276831] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('8d9c7efa-60b6-44af-830b-f32145b1b403',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 628.367062] env[65370]: DEBUG networking_nsxv3.common.locking [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Lock network-573 taken with stack trace [, , , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 628.370385] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquiring lock "network-573" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 628.370487] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquired lock "network-573" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 628.370913] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquired external semaphore "network-573" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 628.371910] env[65370]: DEBUG networking_nsxv3.common.locking [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 628.371910] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquiring lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 628.372231] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquired lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 628.372789] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquired external semaphore "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 628.372789] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Releasing lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 628.373019] env[65370]: DEBUG dogpile.cache.region [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] No value present for key: 'zone-id' {{(pid=65370) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 628.373960] env[65370]: DEBUG dogpile.lock [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] NeedRegenerationException {{(pid=65370) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 628.374151] env[65370]: DEBUG dogpile.lock [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] no value, waiting for create lock {{(pid=65370) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 628.374310] env[65370]: DEBUG dogpile.lock [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] value creation lock acquired {{(pid=65370) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 628.374481] env[65370]: DEBUG dogpile.cache.region [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] No value present for key: 'zone-id' {{(pid=65370) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 628.375328] env[65370]: DEBUG dogpile.lock [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Calling creation function for not-yet-present value {{(pid=65370) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 628.375503] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 628.397229] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 628.397229] env[65370]: DEBUG dogpile.cache.region [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=65370) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 628.397318] env[65370]: DEBUG dogpile.lock [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Released creation lock {{(pid=65370) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 628.397446] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Releasing lock "network-573" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 628.397801] env[65370]: DEBUG networking_nsxv3.common.locking [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Lock port-acab3f2b-0ef6-4eb1-a7cb-4f49cb69e352 taken with stack trace [, , , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 628.397975] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquiring lock "port-acab3f2b-0ef6-4eb1-a7cb-4f49cb69e352" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 628.398101] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquired lock "port-acab3f2b-0ef6-4eb1-a7cb-4f49cb69e352" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 628.398416] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquired external semaphore "port-acab3f2b-0ef6-4eb1-a7cb-4f49cb69e352" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 628.398544] env[65370]: DEBUG networking_nsxv3.api.rpc [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('acab3f2b-0ef6-4eb1-a7cb-4f49cb69e352',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 628.781112] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock member-8d9c7efa-60b6-44af-830b-f32145b1b403 taken with stack trace [, , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 628.782334] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8d9c7efa-60b6-44af-830b-f32145b1b403" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 628.782334] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8d9c7efa-60b6-44af-830b-f32145b1b403" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 628.782334] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8d9c7efa-60b6-44af-830b-f32145b1b403" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 628.782334] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 628.782334] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 628.782334] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 628.782334] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 628.782334] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 628.782334] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8d9c7efa-60b6-44af-830b-f32145b1b403" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 628.783337] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock member-8d9c7efa-60b6-44af-830b-f32145b1b403 taken with stack trace [, , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 628.783337] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8d9c7efa-60b6-44af-830b-f32145b1b403" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 628.783337] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8d9c7efa-60b6-44af-830b-f32145b1b403" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 628.783337] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8d9c7efa-60b6-44af-830b-f32145b1b403" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 628.783337] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 628.783337] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 628.783337] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 628.783337] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 628.783337] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 628.783337] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8d9c7efa-60b6-44af-830b-f32145b1b403" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 628.783337] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('8d9c7efa-60b6-44af-830b-f32145b1b403',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 628.902177] env[65370]: DEBUG networking_nsxv3.common.locking [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 628.902394] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquiring lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 628.902636] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquired lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 628.902986] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquired external semaphore "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 628.903160] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Releasing lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 628.903317] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Segment Port acab3f2b-0ef6-4eb1-a7cb-4f49cb69e352 not found, creating... [ 628.903630] env[65370]: DEBUG networking_nsxv3.common.locking [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 628.903764] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquiring lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 628.903879] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquired lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 628.904124] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquired external semaphore "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 628.904261] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Releasing lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 628.904565] env[65370]: DEBUG networking_nsxv3.common.locking [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 628.904749] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquiring lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 628.904866] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquired lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 628.905075] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquired external semaphore "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 628.905463] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Releasing lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 628.905463] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Resource: SegmentPort with ID: acab3f2b-0ef6-4eb1-a7cb-4f49cb69e352 is going to be created. [ 628.927163] env[65370]: DEBUG networking_nsxv3.common.locking [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 628.927375] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquiring lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 628.927487] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquired lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 628.927914] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquired external semaphore "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 628.928153] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Releasing lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 628.928380] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Releasing lock "port-acab3f2b-0ef6-4eb1-a7cb-4f49cb69e352" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 629.259940] env[65370]: INFO networking_nsxv3.common.synchronization [None req-a07d3f3e-b223-439e-a341-8160ed3b065a tempest-ServerActionsTestOtherA-1239332614 tempest-ServerActionsTestOtherA-1239332614-project-member] Enqueued Resource ID: 408a8a38-c326-4f43-84a2-818a13f7e124 with Priority: HIGHEST for action security_group_rules [ 629.260512] env[65370]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 408a8a38-c326-4f43-84a2-818a13f7e124 with Priority: HIGHEST for action security_group_rules [ 629.260811] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock rules-408a8a38-c326-4f43-84a2-818a13f7e124 taken with stack trace [, , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 629.260941] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-408a8a38-c326-4f43-84a2-818a13f7e124" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 629.260999] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-408a8a38-c326-4f43-84a2-818a13f7e124" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 629.261284] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-408a8a38-c326-4f43-84a2-818a13f7e124" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 629.261369] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('408a8a38-c326-4f43-84a2-818a13f7e124',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 629.285544] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 8d9c7efa-60b6-44af-830b-f32145b1b403: rpc.has_security_group_logging(os_id): False [ 629.304400] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 629.304526] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 629.304639] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 629.304889] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 629.304983] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 629.305215] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 629.305319] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 629.305379] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 629.305532] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 629.305630] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 629.305798] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 629.305874] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 629.305986] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 629.306086] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 629.306153] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 629.306327] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 629.306415] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 629.306467] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 629.306609] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 629.306681] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 629.306766] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 8d9c7efa-60b6-44af-830b-f32145b1b403 is going to be created. [ 629.366175] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 629.366325] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 629.366394] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 629.366600] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 629.366869] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 629.377703] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 8d9c7efa-60b6-44af-830b-f32145b1b403 in Status: IN_PROGRESS for 2s [ 629.754922] env[65370]: INFO networking_nsxv3.common.synchronization [req-f7da0f1f-ac6a-4f4e-99f6-72ba06ef5b5a req-99acedc7-30af-436d-98db-3a417a77a6f6 service nova] Enqueued Resource ID: b8e66f81-0f32-48b8-b81f-542b74cbecd4 with Priority: HIGHEST for action security_group_rules [ 629.755101] env[65370]: INFO networking_nsxv3.common.synchronization [req-f7da0f1f-ac6a-4f4e-99f6-72ba06ef5b5a req-99acedc7-30af-436d-98db-3a417a77a6f6 service nova] Enqueued Resource ID: b8e66f81-0f32-48b8-b81f-542b74cbecd4 with Priority: HIGHEST for action security_group_members [ 629.755225] env[65370]: INFO networking_nsxv3.common.synchronization [req-f7da0f1f-ac6a-4f4e-99f6-72ba06ef5b5a req-99acedc7-30af-436d-98db-3a417a77a6f6 service nova] Enqueued Resource ID: acab3f2b-0ef6-4eb1-a7cb-4f49cb69e352 with Priority: HIGHEST for action port [ 629.759031] env[65370]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b8e66f81-0f32-48b8-b81f-542b74cbecd4 with Priority: HIGHEST for action security_group_rules [ 629.759031] env[65370]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b8e66f81-0f32-48b8-b81f-542b74cbecd4 with Priority: HIGHEST for action security_group_members [ 629.759031] env[65370]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: acab3f2b-0ef6-4eb1-a7cb-4f49cb69e352 with Priority: HIGHEST for action port [ 629.759031] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock rules-b8e66f81-0f32-48b8-b81f-542b74cbecd4 taken with stack trace [, , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 629.759031] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-b8e66f81-0f32-48b8-b81f-542b74cbecd4" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 629.759031] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-b8e66f81-0f32-48b8-b81f-542b74cbecd4" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 629.759031] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-b8e66f81-0f32-48b8-b81f-542b74cbecd4" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 629.759031] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('b8e66f81-0f32-48b8-b81f-542b74cbecd4',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 629.759031] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock member-b8e66f81-0f32-48b8-b81f-542b74cbecd4 taken with stack trace [, , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 629.759031] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b8e66f81-0f32-48b8-b81f-542b74cbecd4" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 629.759031] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b8e66f81-0f32-48b8-b81f-542b74cbecd4" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 629.759031] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b8e66f81-0f32-48b8-b81f-542b74cbecd4" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 629.759031] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 629.759031] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 629.759031] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 629.759031] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 629.763117] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 629.763117] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b8e66f81-0f32-48b8-b81f-542b74cbecd4',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 629.767218] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock port-acab3f2b-0ef6-4eb1-a7cb-4f49cb69e352 taken with stack trace [, , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 629.767218] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-acab3f2b-0ef6-4eb1-a7cb-4f49cb69e352" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 629.770676] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-acab3f2b-0ef6-4eb1-a7cb-4f49cb69e352" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 629.770676] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-acab3f2b-0ef6-4eb1-a7cb-4f49cb69e352" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 629.770676] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('acab3f2b-0ef6-4eb1-a7cb-4f49cb69e352',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 629.796717] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 629.797096] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 629.797096] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 629.797716] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 629.797716] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 629.797716] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 408a8a38-c326-4f43-84a2-818a13f7e124 already deleted. [ 629.797716] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-408a8a38-c326-4f43-84a2-818a13f7e124" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 629.891220] env[65370]: INFO networking_nsxv3.common.synchronization [None req-6fdfad67-c3da-48ff-a6fc-832d2cede1e4 tempest-ServerActionsTestOtherA-1239332614 tempest-ServerActionsTestOtherA-1239332614-project-member] Enqueued Resource ID: 408a8a38-c326-4f43-84a2-818a13f7e124 with Priority: HIGHEST for action security_group_rules [ 629.891220] env[65370]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 408a8a38-c326-4f43-84a2-818a13f7e124 with Priority: HIGHEST for action security_group_rules [ 629.891220] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock rules-408a8a38-c326-4f43-84a2-818a13f7e124 taken with stack trace [, , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 629.891220] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-408a8a38-c326-4f43-84a2-818a13f7e124" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 629.891220] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-408a8a38-c326-4f43-84a2-818a13f7e124" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 629.891411] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-408a8a38-c326-4f43-84a2-818a13f7e124" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 629.891443] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('408a8a38-c326-4f43-84a2-818a13f7e124',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 630.268104] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('b8e66f81-0f32-48b8-b81f-542b74cbecd4',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 630.272430] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock member-b8e66f81-0f32-48b8-b81f-542b74cbecd4 taken with stack trace [, , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 630.272693] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b8e66f81-0f32-48b8-b81f-542b74cbecd4" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 630.275200] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port acab3f2b-0ef6-4eb1-a7cb-4f49cb69e352 with status ACTIVE [ 630.275288] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 630.275660] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 630.275660] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 630.275900] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 630.276017] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 630.276237] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 630.276347] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 630.276429] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 630.280441] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 630.280654] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 630.280810] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 630.280938] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 630.281018] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 630.281267] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 630.281267] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 630.281409] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: acab3f2b-0ef6-4eb1-a7cb-4f49cb69e352 is going to be updated. [ 630.307270] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 630.307493] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 630.307493] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 630.307718] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 630.307858] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 630.308078] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-acab3f2b-0ef6-4eb1-a7cb-4f49cb69e352" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 630.329368] env[65370]: INFO networking_nsxv3.common.synchronization [None req-5e9a4ca6-590d-4589-ae20-06314e73f61c None None] Enqueued Resource ID: 92b05013-4f9e-4337-af5d-32dca393370e with Priority: HIGHEST for action port [ 630.330701] env[65370]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 92b05013-4f9e-4337-af5d-32dca393370e with Priority: HIGHEST for action port [ 630.330701] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock port-92b05013-4f9e-4337-af5d-32dca393370e taken with stack trace [, , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 630.330701] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-92b05013-4f9e-4337-af5d-32dca393370e" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 630.330701] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-92b05013-4f9e-4337-af5d-32dca393370e" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 630.330701] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-92b05013-4f9e-4337-af5d-32dca393370e" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 630.331100] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('92b05013-4f9e-4337-af5d-32dca393370e',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 630.419587] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 630.419587] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 630.419587] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 630.419587] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 630.419587] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 630.419587] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 408a8a38-c326-4f43-84a2-818a13f7e124 already deleted. [ 630.419587] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-408a8a38-c326-4f43-84a2-818a13f7e124" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 630.771160] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('b8e66f81-0f32-48b8-b81f-542b74cbecd4',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 630.833543] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 92b05013-4f9e-4337-af5d-32dca393370e [ 630.833918] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 630.833918] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 630.834113] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 630.834234] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 630.834479] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 630.834479] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:92b05013-4f9e-4337-af5d-32dca393370e already deleted. [ 630.834479] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-92b05013-4f9e-4337-af5d-32dca393370e" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 631.266178] env[65370]: INFO networking_nsxv3.common.synchronization [req-abce78cc-bf96-47c1-aa5c-af74729a55c9 req-50159ad4-8b6e-442d-865d-07f2e12191a1 tempest-ImagesOneServerNegativeTestJSON-1384686973 tempest-ImagesOneServerNegativeTestJSON-1384686973-project-member] Enqueued Resource ID: e2790d7c-6d0c-45bc-84d1-8cb00d26b9b0 with Priority: HIGHEST for action security_group_members [ 631.266178] env[65370]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e2790d7c-6d0c-45bc-84d1-8cb00d26b9b0 with Priority: HIGHEST for action security_group_members [ 631.266178] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock member-e2790d7c-6d0c-45bc-84d1-8cb00d26b9b0 taken with stack trace [, , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 631.266696] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e2790d7c-6d0c-45bc-84d1-8cb00d26b9b0" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 631.266929] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e2790d7c-6d0c-45bc-84d1-8cb00d26b9b0" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 631.267353] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e2790d7c-6d0c-45bc-84d1-8cb00d26b9b0" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 631.268184] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 631.268710] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 631.268710] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 631.268710] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 631.268710] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 631.269295] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e2790d7c-6d0c-45bc-84d1-8cb00d26b9b0',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 631.274998] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 631.274998] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 631.274998] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 631.274998] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 631.275249] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 631.275910] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b8e66f81-0f32-48b8-b81f-542b74cbecd4 is going to be created. [ 631.303732] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 631.303732] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 631.303732] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 631.303732] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 631.303732] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 631.313058] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b8e66f81-0f32-48b8-b81f-542b74cbecd4 in Status: UNINITIALIZED for 2s [ 631.388960] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 8d9c7efa-60b6-44af-830b-f32145b1b403 in Status: SUCCESS [ 631.389213] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-8d9c7efa-60b6-44af-830b-f32145b1b403" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 631.563755] env[65370]: INFO networking_nsxv3.common.synchronization [None req-29c35636-c87c-4e50-aa3f-f3e20330d2cf None None] Enqueued Resource ID: 83d86b11-46ec-43a4-bcd8-4d94f983ce9a with Priority: HIGHEST for action port [ 631.564317] env[65370]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 83d86b11-46ec-43a4-bcd8-4d94f983ce9a with Priority: HIGHEST for action port [ 631.564855] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock port-83d86b11-46ec-43a4-bcd8-4d94f983ce9a taken with stack trace [, , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 631.564855] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-83d86b11-46ec-43a4-bcd8-4d94f983ce9a" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 631.564855] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-83d86b11-46ec-43a4-bcd8-4d94f983ce9a" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 631.565437] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-83d86b11-46ec-43a4-bcd8-4d94f983ce9a" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 631.565675] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('83d86b11-46ec-43a4-bcd8-4d94f983ce9a',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 631.672322] env[65370]: DEBUG networking_nsxv3.common.locking [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Lock network-823 taken with stack trace [, , , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 631.672674] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquiring lock "network-823" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 631.673047] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquired lock "network-823" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 631.673376] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquired external semaphore "network-823" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 631.673938] env[65370]: DEBUG networking_nsxv3.common.locking [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 631.674630] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquiring lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 631.674889] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquired lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 631.675369] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquired external semaphore "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 631.675674] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Releasing lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 631.675938] env[65370]: DEBUG dogpile.cache.region [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] No value present for key: 'zone-id' {{(pid=65370) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 631.676152] env[65370]: DEBUG dogpile.lock [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] NeedRegenerationException {{(pid=65370) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 631.676291] env[65370]: DEBUG dogpile.lock [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] no value, waiting for create lock {{(pid=65370) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 631.676433] env[65370]: DEBUG dogpile.lock [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] value creation lock acquired {{(pid=65370) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 631.676558] env[65370]: DEBUG dogpile.cache.region [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] No value present for key: 'zone-id' {{(pid=65370) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 631.676686] env[65370]: DEBUG dogpile.lock [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Calling creation function for not-yet-present value {{(pid=65370) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 631.676837] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 631.709659] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 631.710346] env[65370]: DEBUG dogpile.cache.region [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Cache value generated in 0.033 seconds for key(s): 'zone-id' {{(pid=65370) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 631.710754] env[65370]: DEBUG dogpile.lock [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Released creation lock {{(pid=65370) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 631.710885] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Releasing lock "network-823" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 631.711246] env[65370]: DEBUG networking_nsxv3.common.locking [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Lock port-16955f58-dc6b-4f23-91ca-5b340f9ef277 taken with stack trace [, , , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 631.711563] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquiring lock "port-16955f58-dc6b-4f23-91ca-5b340f9ef277" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 631.711686] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquired lock "port-16955f58-dc6b-4f23-91ca-5b340f9ef277" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 631.712168] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquired external semaphore "port-16955f58-dc6b-4f23-91ca-5b340f9ef277" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 631.712385] env[65370]: DEBUG networking_nsxv3.api.rpc [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('16955f58-dc6b-4f23-91ca-5b340f9ef277',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 631.771193] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 631.771193] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 631.771193] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 631.771525] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 631.771525] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 631.771707] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 631.771805] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 631.771863] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 631.772122] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 631.772122] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 631.772217] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e2790d7c-6d0c-45bc-84d1-8cb00d26b9b0 already deleted. [ 631.774784] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e2790d7c-6d0c-45bc-84d1-8cb00d26b9b0" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 632.077476] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 83d86b11-46ec-43a4-bcd8-4d94f983ce9a [ 632.077476] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 632.077948] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 632.077948] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 632.077948] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 632.077948] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 632.078162] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:83d86b11-46ec-43a4-bcd8-4d94f983ce9a already deleted. [ 632.078232] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-83d86b11-46ec-43a4-bcd8-4d94f983ce9a" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 632.217084] env[65370]: DEBUG networking_nsxv3.common.locking [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 632.217364] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquiring lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 632.217500] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquired lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 632.217823] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquired external semaphore "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 632.218042] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Releasing lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 632.218224] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Segment Port 16955f58-dc6b-4f23-91ca-5b340f9ef277 not found, creating... [ 632.218527] env[65370]: DEBUG networking_nsxv3.common.locking [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 632.218692] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquiring lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 632.219035] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquired lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 632.219250] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquired external semaphore "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 632.219381] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Releasing lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 632.219647] env[65370]: DEBUG networking_nsxv3.common.locking [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 632.219794] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquiring lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 632.219901] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquired lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 632.220113] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquired external semaphore "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 632.220235] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Releasing lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 632.220365] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Resource: SegmentPort with ID: 16955f58-dc6b-4f23-91ca-5b340f9ef277 is going to be created. [ 632.242977] env[65370]: DEBUG networking_nsxv3.common.locking [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 632.242977] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquiring lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 632.242977] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquired lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 632.242977] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquired external semaphore "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 632.242977] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Releasing lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 632.242977] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Releasing lock "port-16955f58-dc6b-4f23-91ca-5b340f9ef277" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 633.055596] env[65370]: INFO networking_nsxv3.common.synchronization [req-abce78cc-bf96-47c1-aa5c-af74729a55c9 req-03f44eb4-c5df-49a9-ba89-f569e3869457 service nova] Enqueued Resource ID: e2790d7c-6d0c-45bc-84d1-8cb00d26b9b0 with Priority: HIGHEST for action security_group_rules [ 633.055820] env[65370]: INFO networking_nsxv3.common.synchronization [req-abce78cc-bf96-47c1-aa5c-af74729a55c9 req-03f44eb4-c5df-49a9-ba89-f569e3869457 service nova] Enqueued Resource ID: e2790d7c-6d0c-45bc-84d1-8cb00d26b9b0 with Priority: HIGHEST for action security_group_members [ 633.056041] env[65370]: INFO networking_nsxv3.common.synchronization [req-abce78cc-bf96-47c1-aa5c-af74729a55c9 req-03f44eb4-c5df-49a9-ba89-f569e3869457 service nova] Enqueued Resource ID: 16955f58-dc6b-4f23-91ca-5b340f9ef277 with Priority: HIGHEST for action port [ 633.056628] env[65370]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e2790d7c-6d0c-45bc-84d1-8cb00d26b9b0 with Priority: HIGHEST for action security_group_rules [ 633.056820] env[65370]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e2790d7c-6d0c-45bc-84d1-8cb00d26b9b0 with Priority: HIGHEST for action security_group_members [ 633.056979] env[65370]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 16955f58-dc6b-4f23-91ca-5b340f9ef277 with Priority: HIGHEST for action port [ 633.059517] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e2790d7c-6d0c-45bc-84d1-8cb00d26b9b0 taken with stack trace [, , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 633.059687] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e2790d7c-6d0c-45bc-84d1-8cb00d26b9b0" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 633.059758] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e2790d7c-6d0c-45bc-84d1-8cb00d26b9b0" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 633.060024] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e2790d7c-6d0c-45bc-84d1-8cb00d26b9b0" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 633.060150] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e2790d7c-6d0c-45bc-84d1-8cb00d26b9b0',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 633.061201] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock member-e2790d7c-6d0c-45bc-84d1-8cb00d26b9b0 taken with stack trace [, , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 633.061373] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e2790d7c-6d0c-45bc-84d1-8cb00d26b9b0" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 633.061471] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e2790d7c-6d0c-45bc-84d1-8cb00d26b9b0" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 633.065094] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e2790d7c-6d0c-45bc-84d1-8cb00d26b9b0" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 633.065094] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 633.065094] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 633.065094] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 633.065094] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 633.065094] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 633.065094] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e2790d7c-6d0c-45bc-84d1-8cb00d26b9b0',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 633.065386] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock port-16955f58-dc6b-4f23-91ca-5b340f9ef277 taken with stack trace [, , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 633.065386] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-16955f58-dc6b-4f23-91ca-5b340f9ef277" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 633.065770] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-16955f58-dc6b-4f23-91ca-5b340f9ef277" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 633.065770] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-16955f58-dc6b-4f23-91ca-5b340f9ef277" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 633.065770] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('16955f58-dc6b-4f23-91ca-5b340f9ef277',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 633.329136] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b8e66f81-0f32-48b8-b81f-542b74cbecd4 in Status: SUCCESS [ 633.329136] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b8e66f81-0f32-48b8-b81f-542b74cbecd4" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 633.329136] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b8e66f81-0f32-48b8-b81f-542b74cbecd4" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 633.329136] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b8e66f81-0f32-48b8-b81f-542b74cbecd4" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 633.329136] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 633.329136] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 633.329136] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 633.329136] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 633.329136] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 633.329136] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b8e66f81-0f32-48b8-b81f-542b74cbecd4" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 633.329136] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('b8e66f81-0f32-48b8-b81f-542b74cbecd4',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 633.572497] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('e2790d7c-6d0c-45bc-84d1-8cb00d26b9b0',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 633.572754] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock member-e2790d7c-6d0c-45bc-84d1-8cb00d26b9b0 taken with stack trace [, , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 633.572754] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e2790d7c-6d0c-45bc-84d1-8cb00d26b9b0" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 633.575047] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 16955f58-dc6b-4f23-91ca-5b340f9ef277 with status ACTIVE [ 633.575047] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 633.575047] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 633.575047] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 633.575047] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 633.575047] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 633.575047] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 633.575047] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 633.575047] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 633.575047] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 633.575047] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 633.575047] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 633.575587] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 633.575587] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 633.576355] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 633.576787] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 633.576787] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 16955f58-dc6b-4f23-91ca-5b340f9ef277 is going to be updated. [ 633.600291] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 633.600440] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 633.600510] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 633.600723] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 633.600885] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 633.601060] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-16955f58-dc6b-4f23-91ca-5b340f9ef277" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 633.751030] env[65370]: INFO networking_nsxv3.common.synchronization [req-224839a8-d65a-45fa-b6c1-f6cbc27a0d2a req-2df43b23-1c39-45c4-ac7a-89217e7fa9bc tempest-FloatingIPsAssociationNegativeTestJSON-1863561544 tempest-FloatingIPsAssociationNegativeTestJSON-1863561544-project-member] Enqueued Resource ID: ce41a48f-c3f8-4fae-9206-7c7028887496 with Priority: HIGHEST for action security_group_members [ 633.751030] env[65370]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ce41a48f-c3f8-4fae-9206-7c7028887496 with Priority: HIGHEST for action security_group_members [ 633.751679] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock member-ce41a48f-c3f8-4fae-9206-7c7028887496 taken with stack trace [, , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 633.751679] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ce41a48f-c3f8-4fae-9206-7c7028887496" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 633.751679] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ce41a48f-c3f8-4fae-9206-7c7028887496" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 633.751679] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ce41a48f-c3f8-4fae-9206-7c7028887496" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 633.751921] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 633.751921] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 633.751921] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 633.752060] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 633.752272] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 633.752272] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ce41a48f-c3f8-4fae-9206-7c7028887496',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 633.833579] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('b8e66f81-0f32-48b8-b81f-542b74cbecd4',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 634.079067] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('e2790d7c-6d0c-45bc-84d1-8cb00d26b9b0',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 634.186175] env[65370]: DEBUG networking_nsxv3.common.locking [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Lock network-349 taken with stack trace [, , , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 634.186175] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquiring lock "network-349" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 634.186175] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquired lock "network-349" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 634.186449] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquired external semaphore "network-349" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 634.186699] env[65370]: DEBUG networking_nsxv3.common.locking [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 634.186856] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquiring lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 634.187023] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquired lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 634.187970] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquired external semaphore "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 634.188177] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Releasing lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 634.188530] env[65370]: DEBUG dogpile.cache.region [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] No value present for key: 'zone-id' {{(pid=65370) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 634.188615] env[65370]: DEBUG dogpile.lock [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] NeedRegenerationException {{(pid=65370) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 634.188742] env[65370]: DEBUG dogpile.lock [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] no value, waiting for create lock {{(pid=65370) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 634.188809] env[65370]: DEBUG dogpile.lock [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] value creation lock acquired {{(pid=65370) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 634.191123] env[65370]: DEBUG dogpile.cache.region [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] No value present for key: 'zone-id' {{(pid=65370) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 634.191123] env[65370]: DEBUG dogpile.lock [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Calling creation function for not-yet-present value {{(pid=65370) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 634.191123] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 634.211368] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 634.211562] env[65370]: DEBUG dogpile.cache.region [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=65370) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 634.211800] env[65370]: DEBUG dogpile.lock [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Released creation lock {{(pid=65370) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 634.212118] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Releasing lock "network-349" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 634.212595] env[65370]: DEBUG networking_nsxv3.common.locking [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Lock port-113d0406-88f7-4d50-b0cc-cda9a0b18815 taken with stack trace [, , , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 634.212999] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquiring lock "port-113d0406-88f7-4d50-b0cc-cda9a0b18815" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 634.213081] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquired lock "port-113d0406-88f7-4d50-b0cc-cda9a0b18815" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 634.213504] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquired external semaphore "port-113d0406-88f7-4d50-b0cc-cda9a0b18815" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 634.213743] env[65370]: DEBUG networking_nsxv3.api.rpc [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('113d0406-88f7-4d50-b0cc-cda9a0b18815',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 634.256377] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 634.256377] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 634.256377] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 634.256377] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 634.256377] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 634.256377] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 634.256377] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 634.256377] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 634.256377] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 634.256377] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 634.256377] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ce41a48f-c3f8-4fae-9206-7c7028887496 already deleted. [ 634.256377] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ce41a48f-c3f8-4fae-9206-7c7028887496" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 634.336199] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for b8e66f81-0f32-48b8-b81f-542b74cbecd4: rpc.has_security_group_logging(os_id): False [ 634.358426] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 634.358714] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 634.358714] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 634.359119] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 634.359119] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 634.359327] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 634.359426] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 634.359484] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 634.359653] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 634.359732] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 634.359815] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: b8e66f81-0f32-48b8-b81f-542b74cbecd4 is going to be created. [ 634.432589] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 634.432589] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 634.432589] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 634.432589] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 634.432589] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 634.454257] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b8e66f81-0f32-48b8-b81f-542b74cbecd4 in Status: IN_PROGRESS for 2s [ 634.587528] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 634.587693] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 634.587764] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 634.587988] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 634.588090] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 634.588186] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e2790d7c-6d0c-45bc-84d1-8cb00d26b9b0 is going to be created. [ 634.625033] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 634.625249] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 634.625370] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 634.629027] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 634.629027] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 634.637625] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e2790d7c-6d0c-45bc-84d1-8cb00d26b9b0 in Status: UNINITIALIZED for 2s [ 634.719724] env[65370]: DEBUG networking_nsxv3.common.locking [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 634.723187] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquiring lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 634.725800] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquired lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 634.725800] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquired external semaphore "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 634.725800] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Releasing lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 634.725800] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Segment Port 113d0406-88f7-4d50-b0cc-cda9a0b18815 not found, creating... [ 634.725800] env[65370]: DEBUG networking_nsxv3.common.locking [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 634.725800] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquiring lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 634.725800] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquired lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 634.725800] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquired external semaphore "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 634.727221] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Releasing lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 634.727221] env[65370]: DEBUG networking_nsxv3.common.locking [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 634.727332] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquiring lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 634.727743] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquired lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 634.727888] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquired external semaphore "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 634.728157] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Releasing lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 634.728427] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Resource: SegmentPort with ID: 113d0406-88f7-4d50-b0cc-cda9a0b18815 is going to be created. [ 634.761058] env[65370]: DEBUG networking_nsxv3.common.locking [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 634.761385] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquiring lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 634.761476] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquired lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 634.761780] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquired external semaphore "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 634.762085] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Releasing lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 634.762341] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Releasing lock "port-113d0406-88f7-4d50-b0cc-cda9a0b18815" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 635.306428] env[65370]: INFO networking_nsxv3.common.synchronization [req-49696fc1-3552-4b01-8fd2-93d7ed7f143a req-a4b46152-6f78-408d-96f5-7a6e1c5018ff tempest-TenantUsagesTestJSON-2042669284 tempest-TenantUsagesTestJSON-2042669284-project-member] Enqueued Resource ID: 48cb2a6d-3a04-4700-a0e8-ee3e4e1a679c with Priority: HIGHEST for action security_group_members [ 635.307075] env[65370]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 48cb2a6d-3a04-4700-a0e8-ee3e4e1a679c with Priority: HIGHEST for action security_group_members [ 635.307396] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock member-48cb2a6d-3a04-4700-a0e8-ee3e4e1a679c taken with stack trace [, , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 635.307517] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-48cb2a6d-3a04-4700-a0e8-ee3e4e1a679c" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 635.307581] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-48cb2a6d-3a04-4700-a0e8-ee3e4e1a679c" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 635.307795] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-48cb2a6d-3a04-4700-a0e8-ee3e4e1a679c" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 635.307963] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 635.308078] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 635.308139] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 635.308293] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 635.308380] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 635.308474] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('48cb2a6d-3a04-4700-a0e8-ee3e4e1a679c',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 635.418346] env[65370]: INFO networking_nsxv3.common.synchronization [None req-a305a4c4-daab-44da-861f-dc516690706c None None] Enqueued Resource ID: 652efc97-b304-48fb-bf9d-143bd76ff02d with Priority: HIGHEST for action port [ 635.420730] env[65370]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 652efc97-b304-48fb-bf9d-143bd76ff02d with Priority: HIGHEST for action port [ 635.420730] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock port-652efc97-b304-48fb-bf9d-143bd76ff02d taken with stack trace [, , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 635.420730] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-652efc97-b304-48fb-bf9d-143bd76ff02d" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 635.420730] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-652efc97-b304-48fb-bf9d-143bd76ff02d" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 635.420730] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-652efc97-b304-48fb-bf9d-143bd76ff02d" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 635.420730] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('652efc97-b304-48fb-bf9d-143bd76ff02d',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 635.513871] env[65370]: INFO networking_nsxv3.common.synchronization [req-224839a8-d65a-45fa-b6c1-f6cbc27a0d2a req-74bae906-3ef8-44a2-9438-237715d332de service nova] Enqueued Resource ID: ce41a48f-c3f8-4fae-9206-7c7028887496 with Priority: HIGHEST for action security_group_rules [ 635.513871] env[65370]: INFO networking_nsxv3.common.synchronization [req-224839a8-d65a-45fa-b6c1-f6cbc27a0d2a req-74bae906-3ef8-44a2-9438-237715d332de service nova] Enqueued Resource ID: ce41a48f-c3f8-4fae-9206-7c7028887496 with Priority: HIGHEST for action security_group_members [ 635.513871] env[65370]: INFO networking_nsxv3.common.synchronization [req-224839a8-d65a-45fa-b6c1-f6cbc27a0d2a req-74bae906-3ef8-44a2-9438-237715d332de service nova] Enqueued Resource ID: 113d0406-88f7-4d50-b0cc-cda9a0b18815 with Priority: HIGHEST for action port [ 635.514341] env[65370]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ce41a48f-c3f8-4fae-9206-7c7028887496 with Priority: HIGHEST for action security_group_rules [ 635.514498] env[65370]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ce41a48f-c3f8-4fae-9206-7c7028887496 with Priority: HIGHEST for action security_group_members [ 635.515793] env[65370]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 113d0406-88f7-4d50-b0cc-cda9a0b18815 with Priority: HIGHEST for action port [ 635.515793] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock rules-ce41a48f-c3f8-4fae-9206-7c7028887496 taken with stack trace [, , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 635.515793] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-ce41a48f-c3f8-4fae-9206-7c7028887496" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 635.515793] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-ce41a48f-c3f8-4fae-9206-7c7028887496" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 635.515793] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-ce41a48f-c3f8-4fae-9206-7c7028887496" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 635.515793] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('ce41a48f-c3f8-4fae-9206-7c7028887496',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 635.518325] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock member-ce41a48f-c3f8-4fae-9206-7c7028887496 taken with stack trace [, , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 635.518325] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ce41a48f-c3f8-4fae-9206-7c7028887496" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 635.518325] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ce41a48f-c3f8-4fae-9206-7c7028887496" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 635.518325] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ce41a48f-c3f8-4fae-9206-7c7028887496" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 635.518325] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 635.518325] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 635.518325] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 635.518641] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 635.518774] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 635.519201] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ce41a48f-c3f8-4fae-9206-7c7028887496',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 635.520112] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock port-113d0406-88f7-4d50-b0cc-cda9a0b18815 taken with stack trace [, , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 635.520312] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-113d0406-88f7-4d50-b0cc-cda9a0b18815" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 635.521034] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-113d0406-88f7-4d50-b0cc-cda9a0b18815" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 635.521034] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-113d0406-88f7-4d50-b0cc-cda9a0b18815" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 635.521034] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('113d0406-88f7-4d50-b0cc-cda9a0b18815',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 635.810803] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 635.811157] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 635.811267] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 635.811583] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 635.811723] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 635.812323] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 635.812323] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 635.812493] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 635.812589] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 635.812719] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 635.812867] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 48cb2a6d-3a04-4700-a0e8-ee3e4e1a679c is going to be updated. [ 635.844743] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 635.844957] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 635.845084] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 635.845380] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 635.845584] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 635.858748] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 48cb2a6d-3a04-4700-a0e8-ee3e4e1a679c in Status: IN_PROGRESS for 2s [ 635.923049] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 652efc97-b304-48fb-bf9d-143bd76ff02d [ 635.923406] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 635.923545] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 635.923614] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 635.923880] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 635.923999] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 635.924099] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:652efc97-b304-48fb-bf9d-143bd76ff02d already deleted. [ 635.924214] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-652efc97-b304-48fb-bf9d-143bd76ff02d" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 636.023132] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock member-ce41a48f-c3f8-4fae-9206-7c7028887496 taken with stack trace [, , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 636.023314] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ce41a48f-c3f8-4fae-9206-7c7028887496" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 636.024803] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('ce41a48f-c3f8-4fae-9206-7c7028887496',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 636.024803] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 113d0406-88f7-4d50-b0cc-cda9a0b18815 with status ACTIVE [ 636.024999] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 636.025137] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 636.025222] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 636.025428] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 636.025515] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 636.025688] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 636.025781] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 636.025836] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 636.025978] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 636.026062] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 636.027875] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 636.027875] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 636.027875] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 636.027875] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 636.027875] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 636.027875] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 113d0406-88f7-4d50-b0cc-cda9a0b18815 is going to be updated. [ 636.049832] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 636.050112] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 636.050223] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 636.050477] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 636.050668] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 636.050901] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-113d0406-88f7-4d50-b0cc-cda9a0b18815" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 636.468650] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b8e66f81-0f32-48b8-b81f-542b74cbecd4 in Status: SUCCESS [ 636.468904] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-b8e66f81-0f32-48b8-b81f-542b74cbecd4" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 636.528681] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('ce41a48f-c3f8-4fae-9206-7c7028887496',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 636.649540] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e2790d7c-6d0c-45bc-84d1-8cb00d26b9b0 in Status: SUCCESS [ 636.649758] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e2790d7c-6d0c-45bc-84d1-8cb00d26b9b0" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 636.649932] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e2790d7c-6d0c-45bc-84d1-8cb00d26b9b0" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 636.650185] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e2790d7c-6d0c-45bc-84d1-8cb00d26b9b0" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 636.650380] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 636.650500] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 636.650564] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 636.650722] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 636.650805] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 636.650889] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e2790d7c-6d0c-45bc-84d1-8cb00d26b9b0" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 636.650980] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('e2790d7c-6d0c-45bc-84d1-8cb00d26b9b0',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 637.031853] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 637.032061] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 637.032108] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 637.032355] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 637.032449] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 637.032558] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ce41a48f-c3f8-4fae-9206-7c7028887496 is going to be created. [ 637.060735] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 637.061039] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 637.061106] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 637.061362] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 637.061587] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 637.072251] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ce41a48f-c3f8-4fae-9206-7c7028887496 in Status: UNINITIALIZED for 2s [ 637.152193] env[65370]: INFO networking_nsxv3.common.synchronization [req-60a409c0-e6c4-4b1f-90b6-ff13583e7066 req-4b7db21b-64b1-44be-be77-35b4c211ff66 tempest-ServerTagsTestJSON-174359618 tempest-ServerTagsTestJSON-174359618-project-member] Enqueued Resource ID: e01148a4-883d-4ac9-887d-a7302ffdd9d7 with Priority: HIGHEST for action security_group_members [ 637.152193] env[65370]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e01148a4-883d-4ac9-887d-a7302ffdd9d7 with Priority: HIGHEST for action security_group_members [ 637.152408] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock member-e01148a4-883d-4ac9-887d-a7302ffdd9d7 taken with stack trace [, , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 637.152508] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e01148a4-883d-4ac9-887d-a7302ffdd9d7" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 637.152570] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e01148a4-883d-4ac9-887d-a7302ffdd9d7" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 637.152814] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e01148a4-883d-4ac9-887d-a7302ffdd9d7" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 637.152974] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 637.153081] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 637.153154] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 637.153422] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 637.153422] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 637.153568] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e01148a4-883d-4ac9-887d-a7302ffdd9d7',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 637.154719] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock member-e2790d7c-6d0c-45bc-84d1-8cb00d26b9b0 taken with stack trace [, , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 637.154719] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e2790d7c-6d0c-45bc-84d1-8cb00d26b9b0" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 637.154719] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e2790d7c-6d0c-45bc-84d1-8cb00d26b9b0" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 637.154969] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e2790d7c-6d0c-45bc-84d1-8cb00d26b9b0" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 637.154969] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 637.155248] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 637.155248] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 637.155248] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 637.155419] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 637.155419] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e2790d7c-6d0c-45bc-84d1-8cb00d26b9b0" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 637.156061] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock member-e2790d7c-6d0c-45bc-84d1-8cb00d26b9b0 taken with stack trace [, , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 637.156061] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e2790d7c-6d0c-45bc-84d1-8cb00d26b9b0" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 637.156061] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e2790d7c-6d0c-45bc-84d1-8cb00d26b9b0" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 637.156061] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e2790d7c-6d0c-45bc-84d1-8cb00d26b9b0" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 637.156061] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 637.156061] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 637.156479] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 637.156479] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 637.156479] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 637.156479] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e2790d7c-6d0c-45bc-84d1-8cb00d26b9b0" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 637.156479] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('e2790d7c-6d0c-45bc-84d1-8cb00d26b9b0',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 637.394071] env[65370]: INFO networking_nsxv3.common.synchronization [req-77f236e1-3322-4af9-bc84-75db2746c333 req-c35ddf6e-77ed-47b3-809b-ddb37e3f6f61 tempest-SecurityGroupsTestJSON-1618218766 tempest-SecurityGroupsTestJSON-1618218766-project-member] Enqueued Resource ID: 8d9c7efa-60b6-44af-830b-f32145b1b403 with Priority: HIGHEST for action security_group_members [ 637.395142] env[65370]: INFO networking_nsxv3.common.synchronization [req-77f236e1-3322-4af9-bc84-75db2746c333 req-c35ddf6e-77ed-47b3-809b-ddb37e3f6f61 tempest-SecurityGroupsTestJSON-1618218766 tempest-SecurityGroupsTestJSON-1618218766-project-member] Enqueued Resource ID: 4269e0a9-b570-412a-9993-d1965229c186 with Priority: HIGHEST for action security_group_members [ 637.396024] env[65370]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8d9c7efa-60b6-44af-830b-f32145b1b403 with Priority: HIGHEST for action security_group_members [ 637.396186] env[65370]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4269e0a9-b570-412a-9993-d1965229c186 with Priority: HIGHEST for action security_group_members [ 637.398126] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock member-8d9c7efa-60b6-44af-830b-f32145b1b403 taken with stack trace [, , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 637.398126] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8d9c7efa-60b6-44af-830b-f32145b1b403" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 637.398126] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8d9c7efa-60b6-44af-830b-f32145b1b403" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 637.398126] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8d9c7efa-60b6-44af-830b-f32145b1b403" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 637.398126] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 637.398126] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 637.398126] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 637.398126] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 637.398126] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 637.398126] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('8d9c7efa-60b6-44af-830b-f32145b1b403',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 637.401264] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock member-4269e0a9-b570-412a-9993-d1965229c186 taken with stack trace [, , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 637.401507] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4269e0a9-b570-412a-9993-d1965229c186" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 637.401567] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4269e0a9-b570-412a-9993-d1965229c186" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 637.401903] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4269e0a9-b570-412a-9993-d1965229c186" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 637.402160] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 637.402309] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 637.402406] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 637.402603] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 637.402889] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 637.402991] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4269e0a9-b570-412a-9993-d1965229c186',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 637.451365] env[65370]: INFO networking_nsxv3.common.synchronization [req-77f236e1-3322-4af9-bc84-75db2746c333 req-c35ddf6e-77ed-47b3-809b-ddb37e3f6f61 tempest-SecurityGroupsTestJSON-1618218766 tempest-SecurityGroupsTestJSON-1618218766-project-member] Enqueued Resource ID: 4269e0a9-b570-412a-9993-d1965229c186 with Priority: HIGHEST for action security_group_rules [ 637.451538] env[65370]: INFO networking_nsxv3.common.synchronization [req-77f236e1-3322-4af9-bc84-75db2746c333 req-c35ddf6e-77ed-47b3-809b-ddb37e3f6f61 tempest-SecurityGroupsTestJSON-1618218766 tempest-SecurityGroupsTestJSON-1618218766-project-member] Enqueued Resource ID: 4269e0a9-b570-412a-9993-d1965229c186 with Priority: HIGHEST for action security_group_members [ 637.451676] env[65370]: INFO networking_nsxv3.common.synchronization [req-77f236e1-3322-4af9-bc84-75db2746c333 req-c35ddf6e-77ed-47b3-809b-ddb37e3f6f61 tempest-SecurityGroupsTestJSON-1618218766 tempest-SecurityGroupsTestJSON-1618218766-project-member] Enqueued Resource ID: 8d9c7efa-60b6-44af-830b-f32145b1b403 with Priority: HIGHEST for action security_group_rules [ 637.451826] env[65370]: INFO networking_nsxv3.common.synchronization [req-77f236e1-3322-4af9-bc84-75db2746c333 req-c35ddf6e-77ed-47b3-809b-ddb37e3f6f61 tempest-SecurityGroupsTestJSON-1618218766 tempest-SecurityGroupsTestJSON-1618218766-project-member] Enqueued Resource ID: 8d9c7efa-60b6-44af-830b-f32145b1b403 with Priority: HIGHEST for action security_group_members [ 637.451954] env[65370]: INFO networking_nsxv3.common.synchronization [req-77f236e1-3322-4af9-bc84-75db2746c333 req-c35ddf6e-77ed-47b3-809b-ddb37e3f6f61 tempest-SecurityGroupsTestJSON-1618218766 tempest-SecurityGroupsTestJSON-1618218766-project-member] Enqueued Resource ID: e4267dc8-2a84-4783-8ba4-f4b822014fa5 with Priority: HIGHEST for action port [ 637.452723] env[65370]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4269e0a9-b570-412a-9993-d1965229c186 with Priority: HIGHEST for action security_group_rules [ 637.452855] env[65370]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8d9c7efa-60b6-44af-830b-f32145b1b403 with Priority: HIGHEST for action security_group_rules [ 637.453039] env[65370]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e4267dc8-2a84-4783-8ba4-f4b822014fa5 with Priority: HIGHEST for action port [ 637.453147] env[65370]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4269e0a9-b570-412a-9993-d1965229c186 with Priority: HIGHEST for action security_group_members [ 637.453236] env[65370]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8d9c7efa-60b6-44af-830b-f32145b1b403 with Priority: HIGHEST for action security_group_members [ 637.453505] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock rules-4269e0a9-b570-412a-9993-d1965229c186 taken with stack trace [, , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 637.453630] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-4269e0a9-b570-412a-9993-d1965229c186" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 637.453693] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-4269e0a9-b570-412a-9993-d1965229c186" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 637.454172] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-4269e0a9-b570-412a-9993-d1965229c186" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 637.454259] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('4269e0a9-b570-412a-9993-d1965229c186',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 637.455300] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock rules-8d9c7efa-60b6-44af-830b-f32145b1b403 taken with stack trace [, , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 637.455448] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-8d9c7efa-60b6-44af-830b-f32145b1b403" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 637.455522] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-8d9c7efa-60b6-44af-830b-f32145b1b403" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 637.455668] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-8d9c7efa-60b6-44af-830b-f32145b1b403" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 637.455738] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('8d9c7efa-60b6-44af-830b-f32145b1b403',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 637.458515] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock port-e4267dc8-2a84-4783-8ba4-f4b822014fa5 taken with stack trace [, , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 637.458677] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-e4267dc8-2a84-4783-8ba4-f4b822014fa5" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 637.458677] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-e4267dc8-2a84-4783-8ba4-f4b822014fa5" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 637.459022] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-e4267dc8-2a84-4783-8ba4-f4b822014fa5" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 637.459099] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e4267dc8-2a84-4783-8ba4-f4b822014fa5',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 637.459978] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock member-4269e0a9-b570-412a-9993-d1965229c186 taken with stack trace [, , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 637.460090] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4269e0a9-b570-412a-9993-d1965229c186" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 637.460344] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock member-8d9c7efa-60b6-44af-830b-f32145b1b403 taken with stack trace [, , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 637.460430] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8d9c7efa-60b6-44af-830b-f32145b1b403" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 637.537843] env[65370]: DEBUG networking_nsxv3.common.locking [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Lock network-727 taken with stack trace [, , , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 637.538204] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquiring lock "network-727" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 637.538264] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquired lock "network-727" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 637.538533] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquired external semaphore "network-727" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 637.538780] env[65370]: DEBUG networking_nsxv3.common.locking [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 637.538931] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquiring lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 637.539051] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquired lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 637.539265] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquired external semaphore "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 637.539404] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Releasing lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 637.539597] env[65370]: DEBUG dogpile.cache.region [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] No value present for key: 'zone-id' {{(pid=65370) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 637.539703] env[65370]: DEBUG dogpile.lock [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] NeedRegenerationException {{(pid=65370) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 637.539808] env[65370]: DEBUG dogpile.lock [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] no value, waiting for create lock {{(pid=65370) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 637.539933] env[65370]: DEBUG dogpile.lock [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] value creation lock acquired {{(pid=65370) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 637.540059] env[65370]: DEBUG dogpile.cache.region [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] No value present for key: 'zone-id' {{(pid=65370) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 637.540163] env[65370]: DEBUG dogpile.lock [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Calling creation function for not-yet-present value {{(pid=65370) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 637.540270] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 637.563058] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 637.563268] env[65370]: DEBUG dogpile.cache.region [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=65370) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 637.563409] env[65370]: DEBUG dogpile.lock [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Released creation lock {{(pid=65370) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 637.563630] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Releasing lock "network-727" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 637.563953] env[65370]: DEBUG networking_nsxv3.common.locking [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Lock port-da57cc52-a604-4d12-80c7-e45318c1217b taken with stack trace [, , , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 637.564137] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquiring lock "port-da57cc52-a604-4d12-80c7-e45318c1217b" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 637.564251] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquired lock "port-da57cc52-a604-4d12-80c7-e45318c1217b" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 637.564573] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquired external semaphore "port-da57cc52-a604-4d12-80c7-e45318c1217b" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 637.564723] env[65370]: DEBUG networking_nsxv3.api.rpc [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('da57cc52-a604-4d12-80c7-e45318c1217b',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 637.663481] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for e2790d7c-6d0c-45bc-84d1-8cb00d26b9b0: rpc.has_security_group_logging(os_id): False [ 637.663481] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 637.663481] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 637.663481] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 637.663481] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 637.663481] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 637.663481] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 637.663481] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 637.663481] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 637.663481] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 637.663481] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 637.663481] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e01148a4-883d-4ac9-887d-a7302ffdd9d7 already deleted. [ 637.663481] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e01148a4-883d-4ac9-887d-a7302ffdd9d7" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 637.684027] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 637.684027] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 637.684027] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 637.684027] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 637.684027] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 637.684027] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 637.684027] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 637.684027] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 637.684027] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 637.684027] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 637.684027] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 637.684027] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 637.684027] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 637.684027] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 637.684027] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 637.685183] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 637.685482] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 637.685722] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 637.686016] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 637.686372] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 637.686612] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e2790d7c-6d0c-45bc-84d1-8cb00d26b9b0 is going to be created. [ 637.783907] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 637.784135] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 637.784238] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 637.784539] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 637.784775] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 637.797884] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e2790d7c-6d0c-45bc-84d1-8cb00d26b9b0 in Status: IN_PROGRESS for 2s [ 637.878069] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 48cb2a6d-3a04-4700-a0e8-ee3e4e1a679c in Status: SUCCESS [ 637.878069] env[65370]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 48cb2a6d-3a04-4700-a0e8-ee3e4e1a679c deletion is rescheduled due to dependency. [ 637.878069] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-48cb2a6d-3a04-4700-a0e8-ee3e4e1a679c" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 637.908174] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('8d9c7efa-60b6-44af-830b-f32145b1b403',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 637.908232] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('4269e0a9-b570-412a-9993-d1965229c186',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 637.962942] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock member-4269e0a9-b570-412a-9993-d1965229c186 taken with stack trace [, , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 637.963188] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4269e0a9-b570-412a-9993-d1965229c186" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 637.963368] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock member-8d9c7efa-60b6-44af-830b-f32145b1b403 taken with stack trace [, , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 637.963449] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8d9c7efa-60b6-44af-830b-f32145b1b403" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 637.963590] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port e4267dc8-2a84-4783-8ba4-f4b822014fa5 with status ACTIVE [ 637.963742] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 637.963852] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 637.963907] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 637.965034] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 637.965034] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 637.965034] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 637.965034] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 637.965034] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 637.965034] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 637.965034] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 637.965342] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 637.965342] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 637.965342] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 637.965532] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 637.965532] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 637.965594] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: e4267dc8-2a84-4783-8ba4-f4b822014fa5 is going to be updated. [ 637.991302] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 637.991507] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 637.991605] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 637.991875] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 637.992058] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 637.992263] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-e4267dc8-2a84-4783-8ba4-f4b822014fa5" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 638.067289] env[65370]: DEBUG networking_nsxv3.common.locking [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 638.067668] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquiring lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 638.067668] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquired lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 638.068076] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquired external semaphore "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 638.068260] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Releasing lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 638.068468] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Segment Port da57cc52-a604-4d12-80c7-e45318c1217b not found, creating... [ 638.068634] env[65370]: DEBUG networking_nsxv3.common.locking [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 638.068856] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquiring lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 638.069031] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquired lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 638.069278] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquired external semaphore "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 638.069410] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Releasing lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 638.069800] env[65370]: DEBUG networking_nsxv3.common.locking [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 638.070028] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquiring lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 638.070166] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquired lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 638.070435] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquired external semaphore "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 638.070676] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Releasing lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 638.070770] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Resource: SegmentPort with ID: da57cc52-a604-4d12-80c7-e45318c1217b is going to be created. [ 638.094959] env[65370]: DEBUG networking_nsxv3.common.locking [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 638.095196] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquiring lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 638.095294] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquired lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 638.095525] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquired external semaphore "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 638.095804] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Releasing lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 638.096051] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Releasing lock "port-da57cc52-a604-4d12-80c7-e45318c1217b" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 638.410814] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('8d9c7efa-60b6-44af-830b-f32145b1b403',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 638.411551] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('4269e0a9-b570-412a-9993-d1965229c186',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 638.806056] env[65370]: INFO networking_nsxv3.common.synchronization [req-60a409c0-e6c4-4b1f-90b6-ff13583e7066 req-ebb292e2-f975-4aba-bb2c-cb1a64842e07 service nova] Enqueued Resource ID: e01148a4-883d-4ac9-887d-a7302ffdd9d7 with Priority: HIGHEST for action security_group_rules [ 638.806056] env[65370]: INFO networking_nsxv3.common.synchronization [req-60a409c0-e6c4-4b1f-90b6-ff13583e7066 req-ebb292e2-f975-4aba-bb2c-cb1a64842e07 service nova] Enqueued Resource ID: e01148a4-883d-4ac9-887d-a7302ffdd9d7 with Priority: HIGHEST for action security_group_members [ 638.806056] env[65370]: INFO networking_nsxv3.common.synchronization [req-60a409c0-e6c4-4b1f-90b6-ff13583e7066 req-ebb292e2-f975-4aba-bb2c-cb1a64842e07 service nova] Enqueued Resource ID: da57cc52-a604-4d12-80c7-e45318c1217b with Priority: HIGHEST for action port [ 638.806056] env[65370]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e01148a4-883d-4ac9-887d-a7302ffdd9d7 with Priority: HIGHEST for action security_group_rules [ 638.806875] env[65370]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e01148a4-883d-4ac9-887d-a7302ffdd9d7 with Priority: HIGHEST for action security_group_members [ 638.807098] env[65370]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: da57cc52-a604-4d12-80c7-e45318c1217b with Priority: HIGHEST for action port [ 638.807594] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e01148a4-883d-4ac9-887d-a7302ffdd9d7 taken with stack trace [, , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 638.807837] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e01148a4-883d-4ac9-887d-a7302ffdd9d7" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 638.809331] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e01148a4-883d-4ac9-887d-a7302ffdd9d7" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 638.809331] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e01148a4-883d-4ac9-887d-a7302ffdd9d7" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 638.809331] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e01148a4-883d-4ac9-887d-a7302ffdd9d7',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 638.810237] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock member-e01148a4-883d-4ac9-887d-a7302ffdd9d7 taken with stack trace [, , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 638.810508] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e01148a4-883d-4ac9-887d-a7302ffdd9d7" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 638.810730] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e01148a4-883d-4ac9-887d-a7302ffdd9d7" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 638.811052] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e01148a4-883d-4ac9-887d-a7302ffdd9d7" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 638.812032] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 638.812032] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 638.812190] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 638.812348] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 638.812459] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 638.812587] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e01148a4-883d-4ac9-887d-a7302ffdd9d7',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 638.816216] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock port-da57cc52-a604-4d12-80c7-e45318c1217b taken with stack trace [, , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 638.816216] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-da57cc52-a604-4d12-80c7-e45318c1217b" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 638.816216] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-da57cc52-a604-4d12-80c7-e45318c1217b" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 638.816216] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-da57cc52-a604-4d12-80c7-e45318c1217b" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 638.816216] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('da57cc52-a604-4d12-80c7-e45318c1217b',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 638.913424] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 638.913661] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 638.913661] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 638.913854] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 638.913948] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 638.914068] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8d9c7efa-60b6-44af-830b-f32145b1b403 is going to be updated. [ 638.915480] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 638.915606] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 638.915648] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 638.915858] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 638.915994] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 638.915994] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4269e0a9-b570-412a-9993-d1965229c186 is going to be created. [ 638.943022] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 638.943195] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 638.943263] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 638.943840] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 638.943840] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 638.949531] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 638.949771] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 638.949771] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 638.949962] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 638.950106] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 638.957486] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4269e0a9-b570-412a-9993-d1965229c186 in Status: UNINITIALIZED for 2s [ 638.959241] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8d9c7efa-60b6-44af-830b-f32145b1b403 in Status: IN_PROGRESS for 2s [ 639.080890] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ce41a48f-c3f8-4fae-9206-7c7028887496 in Status: SUCCESS [ 639.081123] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ce41a48f-c3f8-4fae-9206-7c7028887496" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 639.081274] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ce41a48f-c3f8-4fae-9206-7c7028887496" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 639.081491] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ce41a48f-c3f8-4fae-9206-7c7028887496" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 639.081678] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 639.081799] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 639.081861] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 639.082019] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 639.082098] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 639.082182] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ce41a48f-c3f8-4fae-9206-7c7028887496" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 639.082274] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('ce41a48f-c3f8-4fae-9206-7c7028887496',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 639.310834] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock member-e01148a4-883d-4ac9-887d-a7302ffdd9d7 taken with stack trace [, , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 639.311069] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e01148a4-883d-4ac9-887d-a7302ffdd9d7" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 639.318879] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('e01148a4-883d-4ac9-887d-a7302ffdd9d7',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 639.319882] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port da57cc52-a604-4d12-80c7-e45318c1217b with status ACTIVE [ 639.320904] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 639.321068] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 639.321142] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 639.321368] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 639.321457] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 639.321656] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 639.321763] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 639.321820] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 639.322434] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 639.322434] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 639.322550] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 639.322635] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 639.322686] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 639.324180] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 639.324263] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 639.324353] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: da57cc52-a604-4d12-80c7-e45318c1217b is going to be updated. [ 639.348008] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 639.348316] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 639.348435] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 639.348757] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 639.348985] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 639.349253] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-da57cc52-a604-4d12-80c7-e45318c1217b" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 639.586485] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock member-ce41a48f-c3f8-4fae-9206-7c7028887496 taken with stack trace [, , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 639.586485] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ce41a48f-c3f8-4fae-9206-7c7028887496" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 639.586485] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ce41a48f-c3f8-4fae-9206-7c7028887496" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 639.586485] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ce41a48f-c3f8-4fae-9206-7c7028887496" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 639.586485] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 639.586485] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 639.586485] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 639.586485] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 639.586485] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 639.586485] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ce41a48f-c3f8-4fae-9206-7c7028887496" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 639.586485] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock member-ce41a48f-c3f8-4fae-9206-7c7028887496 taken with stack trace [, , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 639.586485] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ce41a48f-c3f8-4fae-9206-7c7028887496" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 639.586485] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ce41a48f-c3f8-4fae-9206-7c7028887496" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 639.586485] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ce41a48f-c3f8-4fae-9206-7c7028887496" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 639.586485] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 639.586485] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 639.587912] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 639.587912] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 639.587912] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 639.587912] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ce41a48f-c3f8-4fae-9206-7c7028887496" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 639.587912] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('ce41a48f-c3f8-4fae-9206-7c7028887496',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 639.814129] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e2790d7c-6d0c-45bc-84d1-8cb00d26b9b0 in Status: SUCCESS [ 639.814495] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e2790d7c-6d0c-45bc-84d1-8cb00d26b9b0" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 639.828740] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('e01148a4-883d-4ac9-887d-a7302ffdd9d7',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 639.965978] env[65370]: INFO networking_nsxv3.common.synchronization [req-db933e2f-808c-4723-ae10-2ba98b1fcecc req-7e9e6527-758d-4eb5-affa-ed3af5957844 tempest-DeleteServersAdminTestJSON-1719358462 tempest-DeleteServersAdminTestJSON-1719358462-project-member] Enqueued Resource ID: d1777ef4-6140-42f0-bcd4-a267f85cb990 with Priority: HIGHEST for action security_group_members [ 639.965978] env[65370]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d1777ef4-6140-42f0-bcd4-a267f85cb990 with Priority: HIGHEST for action security_group_members [ 639.966392] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock member-d1777ef4-6140-42f0-bcd4-a267f85cb990 taken with stack trace [, , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 639.966392] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d1777ef4-6140-42f0-bcd4-a267f85cb990" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 639.966536] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d1777ef4-6140-42f0-bcd4-a267f85cb990" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 639.966615] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d1777ef4-6140-42f0-bcd4-a267f85cb990" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 639.968364] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 639.968459] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 639.968929] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 639.968929] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 639.968929] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 639.968929] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d1777ef4-6140-42f0-bcd4-a267f85cb990',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 640.091191] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for ce41a48f-c3f8-4fae-9206-7c7028887496: rpc.has_security_group_logging(os_id): False [ 640.123310] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 640.123499] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 640.123547] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 640.123824] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 640.123993] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 640.124613] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 640.124613] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 640.124613] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 640.125217] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 640.125217] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 640.125217] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 640.125794] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 640.125794] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 640.125882] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 640.126065] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 640.126128] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 640.126228] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 640.126308] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 640.126427] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 640.126502] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 640.126585] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: ce41a48f-c3f8-4fae-9206-7c7028887496 is going to be created. [ 640.207103] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 640.207402] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 640.207402] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 640.207805] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 640.207805] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 640.227741] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ce41a48f-c3f8-4fae-9206-7c7028887496 in Status: IN_PROGRESS for 2s [ 640.332048] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 640.332302] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 640.332302] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 640.332646] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 640.332797] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 640.332938] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e01148a4-883d-4ac9-887d-a7302ffdd9d7 is going to be created. [ 640.375348] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 640.376241] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 640.376494] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 640.378022] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 640.378022] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 640.392394] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e01148a4-883d-4ac9-887d-a7302ffdd9d7 in Status: UNINITIALIZED for 2s [ 640.463437] env[65370]: DEBUG networking_nsxv3.common.locking [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Lock network-449 taken with stack trace [, , , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 640.463635] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquiring lock "network-449" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 640.463744] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquired lock "network-449" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 640.463987] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquired external semaphore "network-449" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 640.464243] env[65370]: DEBUG networking_nsxv3.common.locking [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 640.464392] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquiring lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 640.464500] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquired lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 640.464739] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquired external semaphore "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 640.464888] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Releasing lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 640.465123] env[65370]: DEBUG dogpile.cache.region [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] No value present for key: 'zone-id' {{(pid=65370) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 640.465234] env[65370]: DEBUG dogpile.lock [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] NeedRegenerationException {{(pid=65370) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 640.465345] env[65370]: DEBUG dogpile.lock [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] no value, waiting for create lock {{(pid=65370) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 640.465448] env[65370]: DEBUG dogpile.lock [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] value creation lock acquired {{(pid=65370) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 640.465549] env[65370]: DEBUG dogpile.cache.region [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] No value present for key: 'zone-id' {{(pid=65370) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 640.465658] env[65370]: DEBUG dogpile.lock [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Calling creation function for not-yet-present value {{(pid=65370) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 640.465772] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 640.470324] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 640.470455] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 640.470523] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 640.470698] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 640.471143] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 640.471339] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 640.471440] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 640.471513] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 640.471656] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 640.471754] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 640.471809] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d1777ef4-6140-42f0-bcd4-a267f85cb990 is going to be updated. [ 640.493026] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 640.493026] env[65370]: DEBUG dogpile.cache.region [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Cache value generated in 0.026 seconds for key(s): 'zone-id' {{(pid=65370) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 640.493026] env[65370]: DEBUG dogpile.lock [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Released creation lock {{(pid=65370) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 640.493026] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Releasing lock "network-449" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 640.493026] env[65370]: DEBUG networking_nsxv3.common.locking [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Lock port-26b006ae-ecfb-4e27-a2a2-a58640f9f8b0 taken with stack trace [, , , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 640.493026] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquiring lock "port-26b006ae-ecfb-4e27-a2a2-a58640f9f8b0" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 640.493026] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquired lock "port-26b006ae-ecfb-4e27-a2a2-a58640f9f8b0" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 640.493652] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquired external semaphore "port-26b006ae-ecfb-4e27-a2a2-a58640f9f8b0" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 640.493652] env[65370]: DEBUG networking_nsxv3.api.rpc [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('26b006ae-ecfb-4e27-a2a2-a58640f9f8b0',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 640.506835] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 640.507086] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 640.507185] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 640.507469] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 640.507555] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 640.520248] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d1777ef4-6140-42f0-bcd4-a267f85cb990 in Status: IN_PROGRESS for 2s [ 640.968834] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4269e0a9-b570-412a-9993-d1965229c186 in Status: SUCCESS [ 640.969291] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4269e0a9-b570-412a-9993-d1965229c186" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 640.969291] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4269e0a9-b570-412a-9993-d1965229c186" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 640.969392] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4269e0a9-b570-412a-9993-d1965229c186" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 640.969615] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 640.969744] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 640.969744] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 640.970319] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 640.970319] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 640.970319] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4269e0a9-b570-412a-9993-d1965229c186',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 640.972776] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8d9c7efa-60b6-44af-830b-f32145b1b403 in Status: SUCCESS [ 640.973028] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8d9c7efa-60b6-44af-830b-f32145b1b403" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 640.973125] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8d9c7efa-60b6-44af-830b-f32145b1b403" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 640.974230] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8d9c7efa-60b6-44af-830b-f32145b1b403" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 640.974230] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 640.974230] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 640.974230] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 640.974230] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 640.974230] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 640.974230] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('8d9c7efa-60b6-44af-830b-f32145b1b403',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 640.999028] env[65370]: DEBUG networking_nsxv3.common.locking [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 640.999028] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquiring lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 640.999028] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquired lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 640.999028] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquired external semaphore "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 640.999028] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Releasing lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 640.999028] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Segment Port 26b006ae-ecfb-4e27-a2a2-a58640f9f8b0 not found, creating... [ 640.999028] env[65370]: DEBUG networking_nsxv3.common.locking [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 640.999028] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquiring lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 640.999028] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquired lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 640.999028] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquired external semaphore "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 640.999028] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Releasing lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 641.002945] env[65370]: DEBUG networking_nsxv3.common.locking [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 641.002945] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquiring lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 641.002945] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquired lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 641.002945] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquired external semaphore "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 641.003169] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Releasing lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 641.003384] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Resource: SegmentPort with ID: 26b006ae-ecfb-4e27-a2a2-a58640f9f8b0 is going to be created. [ 641.029228] env[65370]: DEBUG networking_nsxv3.common.locking [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 641.031636] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquiring lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 641.031878] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquired lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 641.032474] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquired external semaphore "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 641.032715] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Releasing lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 641.032989] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Releasing lock "port-26b006ae-ecfb-4e27-a2a2-a58640f9f8b0" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 641.475933] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('4269e0a9-b570-412a-9993-d1965229c186',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 641.477165] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('8d9c7efa-60b6-44af-830b-f32145b1b403',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 641.693212] env[65370]: INFO networking_nsxv3.common.synchronization [req-4b0c8943-177e-4a15-8aaa-462c3a0e2bdc req-049d184e-5b19-4a8d-81dd-03aeedb22a6d tempest-SecurityGroupsTestJSON-1618218766 tempest-SecurityGroupsTestJSON-1618218766-project-member] Enqueued Resource ID: 4269e0a9-b570-412a-9993-d1965229c186 with Priority: HIGHEST for action security_group_members [ 641.694857] env[65370]: INFO networking_nsxv3.common.synchronization [req-4b0c8943-177e-4a15-8aaa-462c3a0e2bdc req-049d184e-5b19-4a8d-81dd-03aeedb22a6d tempest-SecurityGroupsTestJSON-1618218766 tempest-SecurityGroupsTestJSON-1618218766-project-member] Enqueued Resource ID: 1a7b0f53-ef43-4301-97b8-ab12f1f2ae45 with Priority: HIGHEST for action security_group_members [ 641.694857] env[65370]: INFO networking_nsxv3.common.synchronization [req-4b0c8943-177e-4a15-8aaa-462c3a0e2bdc req-049d184e-5b19-4a8d-81dd-03aeedb22a6d tempest-SecurityGroupsTestJSON-1618218766 tempest-SecurityGroupsTestJSON-1618218766-project-member] Enqueued Resource ID: 8d9c7efa-60b6-44af-830b-f32145b1b403 with Priority: HIGHEST for action security_group_members [ 641.694857] env[65370]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4269e0a9-b570-412a-9993-d1965229c186 with Priority: HIGHEST for action security_group_members [ 641.694857] env[65370]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1a7b0f53-ef43-4301-97b8-ab12f1f2ae45 with Priority: HIGHEST for action security_group_members [ 641.694857] env[65370]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8d9c7efa-60b6-44af-830b-f32145b1b403 with Priority: HIGHEST for action security_group_members [ 641.695541] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock member-4269e0a9-b570-412a-9993-d1965229c186 taken with stack trace [, , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 641.695541] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4269e0a9-b570-412a-9993-d1965229c186" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 641.695733] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock member-1a7b0f53-ef43-4301-97b8-ab12f1f2ae45 taken with stack trace [, , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 641.695733] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1a7b0f53-ef43-4301-97b8-ab12f1f2ae45" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 641.695820] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1a7b0f53-ef43-4301-97b8-ab12f1f2ae45" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 641.696482] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1a7b0f53-ef43-4301-97b8-ab12f1f2ae45" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 641.696803] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 641.696803] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 641.696940] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 641.697069] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 641.698395] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 641.698395] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1a7b0f53-ef43-4301-97b8-ab12f1f2ae45',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 641.698872] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock member-8d9c7efa-60b6-44af-830b-f32145b1b403 taken with stack trace [, , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 641.699048] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8d9c7efa-60b6-44af-830b-f32145b1b403" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 641.784964] env[65370]: INFO networking_nsxv3.common.synchronization [req-4b0c8943-177e-4a15-8aaa-462c3a0e2bdc req-049d184e-5b19-4a8d-81dd-03aeedb22a6d tempest-SecurityGroupsTestJSON-1618218766 tempest-SecurityGroupsTestJSON-1618218766-project-member] Enqueued Resource ID: 1a7b0f53-ef43-4301-97b8-ab12f1f2ae45 with Priority: HIGHEST for action security_group_rules [ 641.786108] env[65370]: INFO networking_nsxv3.common.synchronization [req-4b0c8943-177e-4a15-8aaa-462c3a0e2bdc req-049d184e-5b19-4a8d-81dd-03aeedb22a6d tempest-SecurityGroupsTestJSON-1618218766 tempest-SecurityGroupsTestJSON-1618218766-project-member] Enqueued Resource ID: 1a7b0f53-ef43-4301-97b8-ab12f1f2ae45 with Priority: HIGHEST for action security_group_members [ 641.786108] env[65370]: INFO networking_nsxv3.common.synchronization [req-4b0c8943-177e-4a15-8aaa-462c3a0e2bdc req-049d184e-5b19-4a8d-81dd-03aeedb22a6d tempest-SecurityGroupsTestJSON-1618218766 tempest-SecurityGroupsTestJSON-1618218766-project-member] Enqueued Resource ID: 4269e0a9-b570-412a-9993-d1965229c186 with Priority: HIGHEST for action security_group_rules [ 641.786108] env[65370]: INFO networking_nsxv3.common.synchronization [req-4b0c8943-177e-4a15-8aaa-462c3a0e2bdc req-049d184e-5b19-4a8d-81dd-03aeedb22a6d tempest-SecurityGroupsTestJSON-1618218766 tempest-SecurityGroupsTestJSON-1618218766-project-member] Enqueued Resource ID: 4269e0a9-b570-412a-9993-d1965229c186 with Priority: HIGHEST for action security_group_members [ 641.786108] env[65370]: INFO networking_nsxv3.common.synchronization [req-4b0c8943-177e-4a15-8aaa-462c3a0e2bdc req-049d184e-5b19-4a8d-81dd-03aeedb22a6d tempest-SecurityGroupsTestJSON-1618218766 tempest-SecurityGroupsTestJSON-1618218766-project-member] Enqueued Resource ID: 8d9c7efa-60b6-44af-830b-f32145b1b403 with Priority: HIGHEST for action security_group_rules [ 641.786108] env[65370]: INFO networking_nsxv3.common.synchronization [req-4b0c8943-177e-4a15-8aaa-462c3a0e2bdc req-049d184e-5b19-4a8d-81dd-03aeedb22a6d tempest-SecurityGroupsTestJSON-1618218766 tempest-SecurityGroupsTestJSON-1618218766-project-member] Enqueued Resource ID: 8d9c7efa-60b6-44af-830b-f32145b1b403 with Priority: HIGHEST for action security_group_members [ 641.786108] env[65370]: INFO networking_nsxv3.common.synchronization [req-4b0c8943-177e-4a15-8aaa-462c3a0e2bdc req-049d184e-5b19-4a8d-81dd-03aeedb22a6d tempest-SecurityGroupsTestJSON-1618218766 tempest-SecurityGroupsTestJSON-1618218766-project-member] Enqueued Resource ID: e4267dc8-2a84-4783-8ba4-f4b822014fa5 with Priority: HIGHEST for action port [ 641.786491] env[65370]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1a7b0f53-ef43-4301-97b8-ab12f1f2ae45 with Priority: HIGHEST for action security_group_rules [ 641.786632] env[65370]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4269e0a9-b570-412a-9993-d1965229c186 with Priority: HIGHEST for action security_group_rules [ 641.786729] env[65370]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8d9c7efa-60b6-44af-830b-f32145b1b403 with Priority: HIGHEST for action security_group_members [ 641.787205] env[65370]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e4267dc8-2a84-4783-8ba4-f4b822014fa5 with Priority: HIGHEST for action port [ 641.787205] env[65370]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8d9c7efa-60b6-44af-830b-f32145b1b403 with Priority: HIGHEST for action security_group_rules [ 641.787205] env[65370]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1a7b0f53-ef43-4301-97b8-ab12f1f2ae45 with Priority: HIGHEST for action security_group_members [ 641.787205] env[65370]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4269e0a9-b570-412a-9993-d1965229c186 with Priority: HIGHEST for action security_group_members [ 641.787408] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock rules-1a7b0f53-ef43-4301-97b8-ab12f1f2ae45 taken with stack trace [, , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 641.787510] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-1a7b0f53-ef43-4301-97b8-ab12f1f2ae45" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 641.787579] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-1a7b0f53-ef43-4301-97b8-ab12f1f2ae45" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 641.788656] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-1a7b0f53-ef43-4301-97b8-ab12f1f2ae45" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 641.788656] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('1a7b0f53-ef43-4301-97b8-ab12f1f2ae45',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 641.789787] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock rules-4269e0a9-b570-412a-9993-d1965229c186 taken with stack trace [, , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 641.789787] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-4269e0a9-b570-412a-9993-d1965229c186" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 641.789942] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock member-8d9c7efa-60b6-44af-830b-f32145b1b403 taken with stack trace [, , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 641.789994] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8d9c7efa-60b6-44af-830b-f32145b1b403" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 641.792391] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock port-e4267dc8-2a84-4783-8ba4-f4b822014fa5 taken with stack trace [, , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 641.792550] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-e4267dc8-2a84-4783-8ba4-f4b822014fa5" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 641.792649] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-e4267dc8-2a84-4783-8ba4-f4b822014fa5" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 641.793035] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-e4267dc8-2a84-4783-8ba4-f4b822014fa5" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 641.793111] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e4267dc8-2a84-4783-8ba4-f4b822014fa5',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 641.796453] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock rules-8d9c7efa-60b6-44af-830b-f32145b1b403 taken with stack trace [, , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 641.796569] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-8d9c7efa-60b6-44af-830b-f32145b1b403" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 641.797356] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock member-1a7b0f53-ef43-4301-97b8-ab12f1f2ae45 taken with stack trace [, , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 641.797356] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1a7b0f53-ef43-4301-97b8-ab12f1f2ae45" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 641.799038] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock member-4269e0a9-b570-412a-9993-d1965229c186 taken with stack trace [, , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 641.799038] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4269e0a9-b570-412a-9993-d1965229c186" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 641.819337] env[65370]: INFO networking_nsxv3.common.synchronization [req-db933e2f-808c-4723-ae10-2ba98b1fcecc req-bd31ee29-5a64-4e64-b598-680e831dad20 service nova] Enqueued Resource ID: d1777ef4-6140-42f0-bcd4-a267f85cb990 with Priority: HIGHEST for action security_group_rules [ 641.819337] env[65370]: INFO networking_nsxv3.common.synchronization [req-db933e2f-808c-4723-ae10-2ba98b1fcecc req-bd31ee29-5a64-4e64-b598-680e831dad20 service nova] Enqueued Resource ID: d1777ef4-6140-42f0-bcd4-a267f85cb990 with Priority: HIGHEST for action security_group_members [ 641.819337] env[65370]: INFO networking_nsxv3.common.synchronization [req-db933e2f-808c-4723-ae10-2ba98b1fcecc req-bd31ee29-5a64-4e64-b598-680e831dad20 service nova] Enqueued Resource ID: 26b006ae-ecfb-4e27-a2a2-a58640f9f8b0 with Priority: HIGHEST for action port [ 641.819337] env[65370]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d1777ef4-6140-42f0-bcd4-a267f85cb990 with Priority: HIGHEST for action security_group_rules [ 641.819337] env[65370]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d1777ef4-6140-42f0-bcd4-a267f85cb990 with Priority: HIGHEST for action security_group_members [ 641.819699] env[65370]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 26b006ae-ecfb-4e27-a2a2-a58640f9f8b0 with Priority: HIGHEST for action port [ 641.819736] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d1777ef4-6140-42f0-bcd4-a267f85cb990 taken with stack trace [, , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 641.820016] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d1777ef4-6140-42f0-bcd4-a267f85cb990" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 641.820016] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d1777ef4-6140-42f0-bcd4-a267f85cb990" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 641.820694] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d1777ef4-6140-42f0-bcd4-a267f85cb990" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 641.820694] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d1777ef4-6140-42f0-bcd4-a267f85cb990',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 641.822022] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock member-d1777ef4-6140-42f0-bcd4-a267f85cb990 taken with stack trace [, , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 641.822328] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d1777ef4-6140-42f0-bcd4-a267f85cb990" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 641.822482] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock port-26b006ae-ecfb-4e27-a2a2-a58640f9f8b0 taken with stack trace [, , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 641.822588] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-26b006ae-ecfb-4e27-a2a2-a58640f9f8b0" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 641.822651] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-26b006ae-ecfb-4e27-a2a2-a58640f9f8b0" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 641.822839] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-26b006ae-ecfb-4e27-a2a2-a58640f9f8b0" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 641.822961] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('26b006ae-ecfb-4e27-a2a2-a58640f9f8b0',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 641.979033] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('4269e0a9-b570-412a-9993-d1965229c186',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 641.980771] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('8d9c7efa-60b6-44af-830b-f32145b1b403',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 642.199509] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('1a7b0f53-ef43-4301-97b8-ab12f1f2ae45',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 642.245201] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ce41a48f-c3f8-4fae-9206-7c7028887496 in Status: SUCCESS [ 642.245201] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-ce41a48f-c3f8-4fae-9206-7c7028887496" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 642.259476] env[65370]: INFO networking_nsxv3.common.synchronization [req-db42e2e3-d103-489f-a538-064b901dd700 req-86f6cb63-36bf-4598-847e-73ac4f758e2c tempest-ServerAddressesNegativeTestJSON-1684933870 tempest-ServerAddressesNegativeTestJSON-1684933870-project-member] Enqueued Resource ID: aa33d5a3-f440-4aa7-9d41-10cb85d18100 with Priority: HIGHEST for action security_group_members [ 642.260099] env[65370]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: aa33d5a3-f440-4aa7-9d41-10cb85d18100 with Priority: HIGHEST for action security_group_members [ 642.260976] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock member-aa33d5a3-f440-4aa7-9d41-10cb85d18100 taken with stack trace [, , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 642.260976] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-aa33d5a3-f440-4aa7-9d41-10cb85d18100" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 642.260976] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-aa33d5a3-f440-4aa7-9d41-10cb85d18100" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 642.260976] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-aa33d5a3-f440-4aa7-9d41-10cb85d18100" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 642.260976] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 642.261429] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 642.261429] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 642.261532] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 642.261635] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 642.261707] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('aa33d5a3-f440-4aa7-9d41-10cb85d18100',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 642.291835] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock member-1a7b0f53-ef43-4301-97b8-ab12f1f2ae45 taken with stack trace [, , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 642.291835] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1a7b0f53-ef43-4301-97b8-ab12f1f2ae45" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 642.299131] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port e4267dc8-2a84-4783-8ba4-f4b822014fa5 with status ACTIVE [ 642.299412] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 642.299758] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 642.299758] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 642.299847] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 642.299974] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 642.300176] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 642.300288] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 642.300357] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 642.300523] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 642.300603] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 642.300846] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 642.300995] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 642.301055] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 642.301314] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 642.301314] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 642.304225] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: e4267dc8-2a84-4783-8ba4-f4b822014fa5 is going to be updated. [ 642.325512] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 642.325641] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 642.325803] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 642.326040] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 642.326199] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 642.326337] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-e4267dc8-2a84-4783-8ba4-f4b822014fa5" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 642.327423] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock member-d1777ef4-6140-42f0-bcd4-a267f85cb990 taken with stack trace [, , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 642.327552] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d1777ef4-6140-42f0-bcd4-a267f85cb990" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 642.328086] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 26b006ae-ecfb-4e27-a2a2-a58640f9f8b0 with status ACTIVE [ 642.328263] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 642.328507] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 642.328596] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 642.328851] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 642.331039] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 642.331039] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 642.331039] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 642.331039] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 642.331039] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 642.331039] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 642.331039] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 642.331039] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 642.331039] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 642.331039] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 642.331039] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 642.331039] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 26b006ae-ecfb-4e27-a2a2-a58640f9f8b0 is going to be updated. [ 642.354442] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 642.354442] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 642.354442] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 642.354685] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 642.354685] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 642.354880] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-26b006ae-ecfb-4e27-a2a2-a58640f9f8b0" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 642.401731] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e01148a4-883d-4ac9-887d-a7302ffdd9d7 in Status: SUCCESS [ 642.402067] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e01148a4-883d-4ac9-887d-a7302ffdd9d7" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 642.402248] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e01148a4-883d-4ac9-887d-a7302ffdd9d7" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 642.402576] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e01148a4-883d-4ac9-887d-a7302ffdd9d7" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 642.402857] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 642.403026] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 642.403097] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 642.403285] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 642.403416] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 642.403537] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e01148a4-883d-4ac9-887d-a7302ffdd9d7" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 642.403674] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('e01148a4-883d-4ac9-887d-a7302ffdd9d7',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 642.484398] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 642.484398] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 642.484398] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 642.484398] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 642.484398] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 642.484398] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4269e0a9-b570-412a-9993-d1965229c186 is going to be updated. [ 642.485520] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 642.485520] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 642.485638] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 642.485732] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 642.485823] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 642.485912] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8d9c7efa-60b6-44af-830b-f32145b1b403 is going to be updated. [ 642.542480] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 642.542480] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 642.542480] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 642.542902] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 642.542902] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 642.545242] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d1777ef4-6140-42f0-bcd4-a267f85cb990 in Status: SUCCESS [ 642.545423] env[65370]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d1777ef4-6140-42f0-bcd4-a267f85cb990 deletion is rescheduled due to dependency. [ 642.545533] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d1777ef4-6140-42f0-bcd4-a267f85cb990" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 642.546583] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 642.546746] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 642.546848] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 642.547096] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 642.547257] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 642.548660] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d1777ef4-6140-42f0-bcd4-a267f85cb990" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 642.548913] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d1777ef4-6140-42f0-bcd4-a267f85cb990" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 642.549188] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 642.549310] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 642.549394] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 642.549566] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 642.549648] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 642.549739] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d1777ef4-6140-42f0-bcd4-a267f85cb990',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 642.556252] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8d9c7efa-60b6-44af-830b-f32145b1b403 in Status: IN_PROGRESS for 2s [ 642.558082] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4269e0a9-b570-412a-9993-d1965229c186 in Status: IN_PROGRESS for 2s [ 642.702029] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('1a7b0f53-ef43-4301-97b8-ab12f1f2ae45',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 642.764228] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 642.764437] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 642.764485] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 642.764749] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 642.764853] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 642.765073] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 642.765198] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 642.765242] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 642.765402] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 642.765479] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 642.765611] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: aa33d5a3-f440-4aa7-9d41-10cb85d18100 already deleted. [ 642.765671] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-aa33d5a3-f440-4aa7-9d41-10cb85d18100" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 642.875089] env[65370]: DEBUG networking_nsxv3.common.locking [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Lock network-442 taken with stack trace [, , , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 642.875295] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquiring lock "network-442" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 642.875404] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquired lock "network-442" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 642.876160] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquired external semaphore "network-442" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 642.876280] env[65370]: DEBUG networking_nsxv3.common.locking [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 642.876427] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquiring lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 642.876559] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquired lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 642.876819] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquired external semaphore "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 642.877025] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Releasing lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 642.877255] env[65370]: DEBUG dogpile.cache.region [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] No value present for key: 'zone-id' {{(pid=65370) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 642.877371] env[65370]: DEBUG dogpile.lock [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] NeedRegenerationException {{(pid=65370) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 642.877475] env[65370]: DEBUG dogpile.lock [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] no value, waiting for create lock {{(pid=65370) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 642.877577] env[65370]: DEBUG dogpile.lock [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] value creation lock acquired {{(pid=65370) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 642.877679] env[65370]: DEBUG dogpile.cache.region [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] No value present for key: 'zone-id' {{(pid=65370) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 642.877777] env[65370]: DEBUG dogpile.lock [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Calling creation function for not-yet-present value {{(pid=65370) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 642.877905] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 642.898230] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 642.898425] env[65370]: DEBUG dogpile.cache.region [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=65370) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 642.898560] env[65370]: DEBUG dogpile.lock [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Released creation lock {{(pid=65370) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 642.898736] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Releasing lock "network-442" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 642.899508] env[65370]: DEBUG networking_nsxv3.common.locking [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Lock port-b5884fd1-fd16-4ae1-b0cc-f8a5c567f468 taken with stack trace [, , , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 642.899772] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquiring lock "port-b5884fd1-fd16-4ae1-b0cc-f8a5c567f468" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 642.899900] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquired lock "port-b5884fd1-fd16-4ae1-b0cc-f8a5c567f468" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 642.902185] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquired external semaphore "port-b5884fd1-fd16-4ae1-b0cc-f8a5c567f468" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 642.902360] env[65370]: DEBUG networking_nsxv3.api.rpc [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b5884fd1-fd16-4ae1-b0cc-f8a5c567f468',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 642.908670] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock member-e01148a4-883d-4ac9-887d-a7302ffdd9d7 taken with stack trace [, , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 642.908670] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e01148a4-883d-4ac9-887d-a7302ffdd9d7" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 642.908670] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e01148a4-883d-4ac9-887d-a7302ffdd9d7" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 642.908670] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e01148a4-883d-4ac9-887d-a7302ffdd9d7" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 642.908670] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 642.908670] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 642.908670] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 642.908670] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 642.908670] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 642.908670] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e01148a4-883d-4ac9-887d-a7302ffdd9d7" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 642.908670] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock member-e01148a4-883d-4ac9-887d-a7302ffdd9d7 taken with stack trace [, , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 642.908670] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e01148a4-883d-4ac9-887d-a7302ffdd9d7" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 642.908670] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e01148a4-883d-4ac9-887d-a7302ffdd9d7" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 642.910416] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e01148a4-883d-4ac9-887d-a7302ffdd9d7" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 642.910416] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 642.910416] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 642.910416] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 642.910416] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 642.910416] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 642.910416] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e01148a4-883d-4ac9-887d-a7302ffdd9d7" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 642.910416] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('e01148a4-883d-4ac9-887d-a7302ffdd9d7',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 643.053364] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('d1777ef4-6140-42f0-bcd4-a267f85cb990',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 643.205099] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 643.205232] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 643.205305] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 643.205734] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 643.205734] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 643.205734] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1a7b0f53-ef43-4301-97b8-ab12f1f2ae45 is going to be created. [ 643.259110] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 643.259266] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 643.259318] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 643.259542] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 643.259693] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 643.271461] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1a7b0f53-ef43-4301-97b8-ab12f1f2ae45 in Status: UNINITIALIZED for 2s [ 643.410206] env[65370]: DEBUG networking_nsxv3.common.locking [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 643.410206] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquiring lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 643.410206] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquired lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 643.410206] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquired external semaphore "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 643.410206] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Releasing lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 643.410206] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Segment Port b5884fd1-fd16-4ae1-b0cc-f8a5c567f468 not found, creating... [ 643.410206] env[65370]: DEBUG networking_nsxv3.common.locking [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 643.410206] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquiring lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 643.410206] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquired lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 643.414700] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquired external semaphore "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 643.414700] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Releasing lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 643.414700] env[65370]: DEBUG networking_nsxv3.common.locking [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 643.414700] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquiring lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 643.414700] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquired lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 643.414700] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquired external semaphore "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 643.414700] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Releasing lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 643.414700] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Resource: SegmentPort with ID: b5884fd1-fd16-4ae1-b0cc-f8a5c567f468 is going to be created. [ 643.416942] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for e01148a4-883d-4ac9-887d-a7302ffdd9d7: rpc.has_security_group_logging(os_id): False [ 643.436441] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 643.436784] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 643.436784] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 643.437035] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 643.437234] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 643.437475] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 643.437588] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 643.437653] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 643.438079] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 643.438183] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 643.438370] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 643.438538] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 643.438538] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 643.438667] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 643.438855] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 643.439094] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 643.439205] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 643.439266] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 643.439413] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 643.439486] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 643.439575] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e01148a4-883d-4ac9-887d-a7302ffdd9d7 is going to be created. [ 643.441663] env[65370]: DEBUG networking_nsxv3.common.locking [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 643.441792] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquiring lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 643.441843] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquired lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 643.442141] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquired external semaphore "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 643.442424] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Releasing lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 643.442692] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Releasing lock "port-b5884fd1-fd16-4ae1-b0cc-f8a5c567f468" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 643.518485] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 643.518687] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 643.518750] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 643.518952] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 643.519177] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 643.541065] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e01148a4-883d-4ac9-887d-a7302ffdd9d7 in Status: IN_PROGRESS for 2s [ 643.555823] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('d1777ef4-6140-42f0-bcd4-a267f85cb990',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 643.700665] env[65370]: INFO networking_nsxv3.common.synchronization [None req-dcce0356-a3d9-45c1-8163-fdd77bd6e388 None None] Enqueued Resource ID: de0368b9-6471-4831-a669-ecb93da84127 with Priority: HIGHEST for action port [ 643.700665] env[65370]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: de0368b9-6471-4831-a669-ecb93da84127 with Priority: HIGHEST for action port [ 643.700665] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock port-de0368b9-6471-4831-a669-ecb93da84127 taken with stack trace [, , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 643.701259] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-de0368b9-6471-4831-a669-ecb93da84127" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 643.701360] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-de0368b9-6471-4831-a669-ecb93da84127" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 643.701782] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-de0368b9-6471-4831-a669-ecb93da84127" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 643.701881] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('de0368b9-6471-4831-a669-ecb93da84127',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 644.058285] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 644.058658] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 644.058658] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 644.059484] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 644.059484] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 644.059484] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d1777ef4-6140-42f0-bcd4-a267f85cb990 is going to be updated. [ 644.091380] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 644.091566] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 644.091651] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 644.091939] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 644.092152] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 644.101871] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d1777ef4-6140-42f0-bcd4-a267f85cb990 in Status: IN_PROGRESS for 2s [ 644.149347] env[65370]: INFO networking_nsxv3.common.synchronization [req-db42e2e3-d103-489f-a538-064b901dd700 req-02c7e96a-10d0-4d7c-905e-2bb5d2fff533 service nova] Enqueued Resource ID: aa33d5a3-f440-4aa7-9d41-10cb85d18100 with Priority: HIGHEST for action security_group_rules [ 644.149347] env[65370]: INFO networking_nsxv3.common.synchronization [req-db42e2e3-d103-489f-a538-064b901dd700 req-02c7e96a-10d0-4d7c-905e-2bb5d2fff533 service nova] Enqueued Resource ID: aa33d5a3-f440-4aa7-9d41-10cb85d18100 with Priority: HIGHEST for action security_group_members [ 644.149347] env[65370]: INFO networking_nsxv3.common.synchronization [req-db42e2e3-d103-489f-a538-064b901dd700 req-02c7e96a-10d0-4d7c-905e-2bb5d2fff533 service nova] Enqueued Resource ID: b5884fd1-fd16-4ae1-b0cc-f8a5c567f468 with Priority: HIGHEST for action port [ 644.149347] env[65370]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: aa33d5a3-f440-4aa7-9d41-10cb85d18100 with Priority: HIGHEST for action security_group_rules [ 644.149347] env[65370]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: aa33d5a3-f440-4aa7-9d41-10cb85d18100 with Priority: HIGHEST for action security_group_members [ 644.149347] env[65370]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b5884fd1-fd16-4ae1-b0cc-f8a5c567f468 with Priority: HIGHEST for action port [ 644.149347] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock rules-aa33d5a3-f440-4aa7-9d41-10cb85d18100 taken with stack trace [, , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 644.149347] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-aa33d5a3-f440-4aa7-9d41-10cb85d18100" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 644.149347] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-aa33d5a3-f440-4aa7-9d41-10cb85d18100" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 644.149347] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-aa33d5a3-f440-4aa7-9d41-10cb85d18100" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 644.149347] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('aa33d5a3-f440-4aa7-9d41-10cb85d18100',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 644.149347] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock member-aa33d5a3-f440-4aa7-9d41-10cb85d18100 taken with stack trace [, , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 644.149347] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-aa33d5a3-f440-4aa7-9d41-10cb85d18100" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 644.149347] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-aa33d5a3-f440-4aa7-9d41-10cb85d18100" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 644.149347] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-aa33d5a3-f440-4aa7-9d41-10cb85d18100" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 644.150126] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 644.150126] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 644.150126] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 644.150126] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 644.150126] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 644.150126] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('aa33d5a3-f440-4aa7-9d41-10cb85d18100',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 644.150645] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock port-b5884fd1-fd16-4ae1-b0cc-f8a5c567f468 taken with stack trace [, , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 644.150755] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b5884fd1-fd16-4ae1-b0cc-f8a5c567f468" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 644.150847] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b5884fd1-fd16-4ae1-b0cc-f8a5c567f468" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 644.150971] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b5884fd1-fd16-4ae1-b0cc-f8a5c567f468" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 644.151053] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b5884fd1-fd16-4ae1-b0cc-f8a5c567f468',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 644.203751] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port de0368b9-6471-4831-a669-ecb93da84127 [ 644.204047] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 644.204261] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 644.204330] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 644.204543] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 644.204632] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 644.204857] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:de0368b9-6471-4831-a669-ecb93da84127 already deleted. [ 644.204857] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-de0368b9-6471-4831-a669-ecb93da84127" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 644.571109] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8d9c7efa-60b6-44af-830b-f32145b1b403 in Status: SUCCESS [ 644.571371] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8d9c7efa-60b6-44af-830b-f32145b1b403" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 644.572297] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4269e0a9-b570-412a-9993-d1965229c186 in Status: SUCCESS [ 644.572490] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4269e0a9-b570-412a-9993-d1965229c186" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 644.572817] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8d9c7efa-60b6-44af-830b-f32145b1b403" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 644.573553] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8d9c7efa-60b6-44af-830b-f32145b1b403" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 644.573842] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 644.574041] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 644.574156] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 644.574400] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 644.574608] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 644.574816] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8d9c7efa-60b6-44af-830b-f32145b1b403" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 644.575051] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('8d9c7efa-60b6-44af-830b-f32145b1b403',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 644.576146] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4269e0a9-b570-412a-9993-d1965229c186" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 644.576399] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4269e0a9-b570-412a-9993-d1965229c186" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 644.577284] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 644.577441] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 644.577558] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 644.577698] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 644.577802] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 644.577895] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4269e0a9-b570-412a-9993-d1965229c186" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 644.578013] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('4269e0a9-b570-412a-9993-d1965229c186',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 644.579114] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8d9c7efa-60b6-44af-830b-f32145b1b403" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 644.579285] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8d9c7efa-60b6-44af-830b-f32145b1b403" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 644.579459] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 644.579573] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 644.579647] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 644.579797] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 644.579882] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 644.579971] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('8d9c7efa-60b6-44af-830b-f32145b1b403',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 644.580824] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4269e0a9-b570-412a-9993-d1965229c186" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 644.580868] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4269e0a9-b570-412a-9993-d1965229c186" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 644.581434] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 644.581603] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 644.581696] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 644.581916] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 644.582083] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 644.583690] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4269e0a9-b570-412a-9993-d1965229c186',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 644.655022] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock member-aa33d5a3-f440-4aa7-9d41-10cb85d18100 taken with stack trace [, , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 644.655022] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-aa33d5a3-f440-4aa7-9d41-10cb85d18100" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 644.655022] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('aa33d5a3-f440-4aa7-9d41-10cb85d18100',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 644.655022] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port b5884fd1-fd16-4ae1-b0cc-f8a5c567f468 with status ACTIVE [ 644.655022] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 644.655022] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 644.655022] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 644.655022] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 644.655022] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 644.655022] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 644.655022] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 644.655022] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 644.660923] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 644.660923] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 644.660923] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 644.660923] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 644.660923] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 644.660923] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 644.661177] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 644.661177] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: b5884fd1-fd16-4ae1-b0cc-f8a5c567f468 is going to be updated. [ 644.684312] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 644.684512] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 644.684561] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 644.685258] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 644.685258] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 644.685258] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b5884fd1-fd16-4ae1-b0cc-f8a5c567f468" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 645.079906] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock member-8d9c7efa-60b6-44af-830b-f32145b1b403 taken with stack trace [, , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 645.080323] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8d9c7efa-60b6-44af-830b-f32145b1b403" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 645.084771] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('4269e0a9-b570-412a-9993-d1965229c186',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 645.085750] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('8d9c7efa-60b6-44af-830b-f32145b1b403',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 645.087740] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('4269e0a9-b570-412a-9993-d1965229c186',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 645.163193] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('aa33d5a3-f440-4aa7-9d41-10cb85d18100',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 645.283064] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1a7b0f53-ef43-4301-97b8-ab12f1f2ae45 in Status: SUCCESS [ 645.283064] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1a7b0f53-ef43-4301-97b8-ab12f1f2ae45" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 645.283064] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1a7b0f53-ef43-4301-97b8-ab12f1f2ae45" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 645.283064] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1a7b0f53-ef43-4301-97b8-ab12f1f2ae45" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 645.283064] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 645.283064] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 645.284232] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 645.284232] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 645.284322] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 645.284835] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1a7b0f53-ef43-4301-97b8-ab12f1f2ae45',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 645.556153] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e01148a4-883d-4ac9-887d-a7302ffdd9d7 in Status: SUCCESS [ 645.556480] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e01148a4-883d-4ac9-887d-a7302ffdd9d7" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 645.591464] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('4269e0a9-b570-412a-9993-d1965229c186',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 645.592392] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('8d9c7efa-60b6-44af-830b-f32145b1b403',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 645.593401] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 4269e0a9-b570-412a-9993-d1965229c186: rpc.has_security_group_logging(os_id): False [ 645.614248] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 645.614248] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 645.614248] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 645.614248] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 645.614248] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 645.614248] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 645.614248] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 645.614248] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 645.614248] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 645.614799] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 645.614799] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 4269e0a9-b570-412a-9993-d1965229c186 is going to be created. [ 645.670209] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 645.670457] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 645.670531] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 645.671104] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 645.671104] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 645.671104] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: aa33d5a3-f440-4aa7-9d41-10cb85d18100 is going to be created. [ 645.694621] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 645.695595] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 645.695687] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 645.695919] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 645.696135] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 645.702936] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 645.703180] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 645.703239] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 645.703465] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 645.703626] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 645.728425] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: aa33d5a3-f440-4aa7-9d41-10cb85d18100 in Status: UNINITIALIZED for 2s [ 645.732871] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 4269e0a9-b570-412a-9993-d1965229c186 in Status: IN_PROGRESS for 2s [ 645.788519] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('1a7b0f53-ef43-4301-97b8-ab12f1f2ae45',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 646.098058] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 646.098584] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 646.098584] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 646.098584] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 646.098729] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 646.098729] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4269e0a9-b570-412a-9993-d1965229c186 is going to be updated. [ 646.100019] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 646.100733] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 646.100733] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 646.100733] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 646.100733] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 646.100733] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8d9c7efa-60b6-44af-830b-f32145b1b403 is going to be updated. [ 646.116396] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d1777ef4-6140-42f0-bcd4-a267f85cb990 in Status: SUCCESS [ 646.116396] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d1777ef4-6140-42f0-bcd4-a267f85cb990" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 646.116396] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d1777ef4-6140-42f0-bcd4-a267f85cb990" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 646.116656] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d1777ef4-6140-42f0-bcd4-a267f85cb990" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 646.116857] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 646.117197] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 646.117197] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 646.117792] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 646.117792] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 646.117792] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d1777ef4-6140-42f0-bcd4-a267f85cb990" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 646.117792] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('d1777ef4-6140-42f0-bcd4-a267f85cb990',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 646.136205] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 646.136444] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 646.136502] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 646.136783] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 646.136942] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 646.140512] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 646.142149] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 646.143402] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 646.143668] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 646.145872] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 646.158020] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8d9c7efa-60b6-44af-830b-f32145b1b403 in Status: IN_PROGRESS for 2s [ 646.158020] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4269e0a9-b570-412a-9993-d1965229c186 in Status: IN_PROGRESS for 2s [ 646.290671] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('1a7b0f53-ef43-4301-97b8-ab12f1f2ae45',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 646.623225] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock member-d1777ef4-6140-42f0-bcd4-a267f85cb990 taken with stack trace [, , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 646.623225] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d1777ef4-6140-42f0-bcd4-a267f85cb990" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 646.623225] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d1777ef4-6140-42f0-bcd4-a267f85cb990" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 646.623225] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d1777ef4-6140-42f0-bcd4-a267f85cb990" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 646.623225] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 646.623225] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 646.623225] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 646.623225] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 646.623225] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 646.623225] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d1777ef4-6140-42f0-bcd4-a267f85cb990" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 646.623225] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock member-d1777ef4-6140-42f0-bcd4-a267f85cb990 taken with stack trace [, , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 646.623225] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d1777ef4-6140-42f0-bcd4-a267f85cb990" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 646.623225] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d1777ef4-6140-42f0-bcd4-a267f85cb990" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 646.623225] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d1777ef4-6140-42f0-bcd4-a267f85cb990" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 646.623225] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 646.623225] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 646.624033] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 646.624033] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 646.625798] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 646.625798] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d1777ef4-6140-42f0-bcd4-a267f85cb990" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 646.625798] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('d1777ef4-6140-42f0-bcd4-a267f85cb990',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 646.688574] env[65370]: INFO networking_nsxv3.common.synchronization [None req-163a6028-21a1-4b9b-8721-bda961a27f00 None None] Enqueued Resource ID: 41d37c17-4339-442c-8860-8ca58928fae8 with Priority: HIGHEST for action port [ 646.689109] env[65370]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 41d37c17-4339-442c-8860-8ca58928fae8 with Priority: HIGHEST for action port [ 646.689415] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock port-41d37c17-4339-442c-8860-8ca58928fae8 taken with stack trace [, , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 646.689544] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-41d37c17-4339-442c-8860-8ca58928fae8" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 646.689608] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-41d37c17-4339-442c-8860-8ca58928fae8" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 646.694411] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-41d37c17-4339-442c-8860-8ca58928fae8" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 646.694537] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('41d37c17-4339-442c-8860-8ca58928fae8',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 646.797350] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 646.797350] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 646.797350] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 646.797350] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 646.797350] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 646.797350] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1a7b0f53-ef43-4301-97b8-ab12f1f2ae45 is going to be updated. [ 646.843209] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 646.843429] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 646.843429] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 646.843642] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 646.843792] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 646.853617] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1a7b0f53-ef43-4301-97b8-ab12f1f2ae45 in Status: IN_PROGRESS for 2s [ 647.127513] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for d1777ef4-6140-42f0-bcd4-a267f85cb990: rpc.has_security_group_logging(os_id): False [ 647.149185] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 647.149185] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 647.149185] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 647.149185] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 647.149185] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 647.149185] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 647.149185] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 647.149185] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 647.149185] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 647.149185] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 647.149185] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 647.149185] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 647.149185] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 647.150817] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 647.151158] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 647.151609] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 647.151916] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 647.152134] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 647.152485] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 647.152775] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 647.153074] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d1777ef4-6140-42f0-bcd4-a267f85cb990 is going to be updated. [ 647.198852] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 41d37c17-4339-442c-8860-8ca58928fae8 [ 647.198852] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 647.198852] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 647.198852] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 647.198852] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 647.198852] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 647.198852] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:41d37c17-4339-442c-8860-8ca58928fae8 already deleted. [ 647.198852] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-41d37c17-4339-442c-8860-8ca58928fae8" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 647.239569] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 647.239569] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 647.239569] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 647.239569] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 647.240844] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 647.259225] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d1777ef4-6140-42f0-bcd4-a267f85cb990 in Status: IN_PROGRESS for 2s [ 647.742160] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: aa33d5a3-f440-4aa7-9d41-10cb85d18100 in Status: SUCCESS [ 647.742484] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-aa33d5a3-f440-4aa7-9d41-10cb85d18100" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 647.743100] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-aa33d5a3-f440-4aa7-9d41-10cb85d18100" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 647.743435] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-aa33d5a3-f440-4aa7-9d41-10cb85d18100" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 647.743714] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 647.743922] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 647.744043] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 647.744319] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 647.744457] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 647.744627] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-aa33d5a3-f440-4aa7-9d41-10cb85d18100" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 647.746289] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('aa33d5a3-f440-4aa7-9d41-10cb85d18100',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 647.748235] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 4269e0a9-b570-412a-9993-d1965229c186 in Status: SUCCESS [ 647.751027] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-4269e0a9-b570-412a-9993-d1965229c186" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 647.751027] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-4269e0a9-b570-412a-9993-d1965229c186" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 647.751027] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-4269e0a9-b570-412a-9993-d1965229c186" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 647.751027] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('4269e0a9-b570-412a-9993-d1965229c186',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 648.171667] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4269e0a9-b570-412a-9993-d1965229c186 in Status: SUCCESS [ 648.171993] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4269e0a9-b570-412a-9993-d1965229c186" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 648.172066] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4269e0a9-b570-412a-9993-d1965229c186" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 648.172281] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4269e0a9-b570-412a-9993-d1965229c186" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 648.172468] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 648.172719] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 648.172719] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 648.172824] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 648.172911] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 648.173012] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4269e0a9-b570-412a-9993-d1965229c186',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 648.176794] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8d9c7efa-60b6-44af-830b-f32145b1b403 in Status: SUCCESS [ 648.176937] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8d9c7efa-60b6-44af-830b-f32145b1b403" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 648.177108] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8d9c7efa-60b6-44af-830b-f32145b1b403" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 648.177293] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8d9c7efa-60b6-44af-830b-f32145b1b403" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 648.177465] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 648.177579] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 648.177638] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 648.177806] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 648.177900] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 648.177994] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('8d9c7efa-60b6-44af-830b-f32145b1b403',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 648.254432] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock member-aa33d5a3-f440-4aa7-9d41-10cb85d18100 taken with stack trace [, , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 648.254432] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-aa33d5a3-f440-4aa7-9d41-10cb85d18100" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 648.254432] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-aa33d5a3-f440-4aa7-9d41-10cb85d18100" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 648.254432] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-aa33d5a3-f440-4aa7-9d41-10cb85d18100" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 648.254432] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 648.254432] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 648.254432] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 648.254432] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 648.254432] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 648.254432] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-aa33d5a3-f440-4aa7-9d41-10cb85d18100" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 648.255427] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock member-aa33d5a3-f440-4aa7-9d41-10cb85d18100 taken with stack trace [, , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 648.255427] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-aa33d5a3-f440-4aa7-9d41-10cb85d18100" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 648.255427] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-aa33d5a3-f440-4aa7-9d41-10cb85d18100" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 648.255427] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-aa33d5a3-f440-4aa7-9d41-10cb85d18100" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 648.255427] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 648.255821] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 648.255821] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 648.255821] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 648.255974] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 648.255974] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-aa33d5a3-f440-4aa7-9d41-10cb85d18100" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 648.256088] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('aa33d5a3-f440-4aa7-9d41-10cb85d18100',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 648.257183] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock member-4269e0a9-b570-412a-9993-d1965229c186 taken with stack trace [, , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 648.258398] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4269e0a9-b570-412a-9993-d1965229c186" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 648.681118] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('4269e0a9-b570-412a-9993-d1965229c186',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 648.682779] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('8d9c7efa-60b6-44af-830b-f32145b1b403',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 648.758996] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for aa33d5a3-f440-4aa7-9d41-10cb85d18100: rpc.has_security_group_logging(os_id): False [ 648.782080] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 648.782378] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 648.782378] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 648.782888] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 648.782888] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 648.783255] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 648.783414] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 648.783478] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 648.783704] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 648.783896] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 648.784372] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 648.784372] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 648.784651] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 648.785165] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 648.785165] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 648.785536] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 648.785633] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 648.785725] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 648.786979] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 648.787265] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 648.787378] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: aa33d5a3-f440-4aa7-9d41-10cb85d18100 is going to be created. [ 648.860776] env[65370]: INFO networking_nsxv3.common.synchronization [None req-6f65cacf-f85c-4a1a-9a71-5ec7cdc001a5 None None] Enqueued Resource ID: 08892d3b-52d9-4a42-a60e-99d11c1a27bc with Priority: HIGHEST for action port [ 648.861770] env[65370]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 08892d3b-52d9-4a42-a60e-99d11c1a27bc with Priority: HIGHEST for action port [ 648.862487] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock port-08892d3b-52d9-4a42-a60e-99d11c1a27bc taken with stack trace [, , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 648.862797] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-08892d3b-52d9-4a42-a60e-99d11c1a27bc" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 648.862870] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-08892d3b-52d9-4a42-a60e-99d11c1a27bc" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 648.863435] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-08892d3b-52d9-4a42-a60e-99d11c1a27bc" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 648.863435] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('08892d3b-52d9-4a42-a60e-99d11c1a27bc',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 648.865917] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1a7b0f53-ef43-4301-97b8-ab12f1f2ae45 in Status: SUCCESS [ 648.866048] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1a7b0f53-ef43-4301-97b8-ab12f1f2ae45" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 648.866664] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1a7b0f53-ef43-4301-97b8-ab12f1f2ae45" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 648.866870] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1a7b0f53-ef43-4301-97b8-ab12f1f2ae45" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 648.867349] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 648.867349] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 648.867349] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 648.867487] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 648.867531] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 648.867648] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1a7b0f53-ef43-4301-97b8-ab12f1f2ae45" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 648.867724] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('1a7b0f53-ef43-4301-97b8-ab12f1f2ae45',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 648.870737] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 648.870909] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 648.870909] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 648.871089] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 648.871393] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 648.901408] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: aa33d5a3-f440-4aa7-9d41-10cb85d18100 in Status: IN_PROGRESS for 2s [ 649.186251] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('4269e0a9-b570-412a-9993-d1965229c186',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 649.187195] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('8d9c7efa-60b6-44af-830b-f32145b1b403',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 649.277834] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d1777ef4-6140-42f0-bcd4-a267f85cb990 in Status: SUCCESS [ 649.278060] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d1777ef4-6140-42f0-bcd4-a267f85cb990" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 649.369957] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 08892d3b-52d9-4a42-a60e-99d11c1a27bc [ 649.370272] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 649.370426] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 649.370479] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 649.370694] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 649.370778] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 649.370910] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:08892d3b-52d9-4a42-a60e-99d11c1a27bc already deleted. [ 649.371060] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-08892d3b-52d9-4a42-a60e-99d11c1a27bc" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 649.376759] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('1a7b0f53-ef43-4301-97b8-ab12f1f2ae45',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 649.691691] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 649.692617] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 649.692617] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 649.692617] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 649.692617] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 649.692617] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4269e0a9-b570-412a-9993-d1965229c186 is going to be updated. [ 649.696290] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 649.696290] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 649.696290] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 649.696290] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 649.696290] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 649.696290] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8d9c7efa-60b6-44af-830b-f32145b1b403 is going to be updated. [ 649.743705] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 649.743975] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 649.743975] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 649.745387] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 649.745387] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 649.747045] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 649.747221] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 649.747303] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 649.748036] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 649.748273] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 649.775133] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4269e0a9-b570-412a-9993-d1965229c186 in Status: IN_PROGRESS for 2s [ 649.775133] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8d9c7efa-60b6-44af-830b-f32145b1b403 in Status: IN_PROGRESS for 2s [ 649.878984] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 1a7b0f53-ef43-4301-97b8-ab12f1f2ae45: rpc.has_security_group_logging(os_id): False [ 649.899281] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 649.899428] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 649.899497] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 649.899730] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 649.899797] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 649.900039] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 649.900140] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 649.900237] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 649.900357] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 649.900435] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 649.900523] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 1a7b0f53-ef43-4301-97b8-ab12f1f2ae45 is going to be created. [ 649.988097] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 649.988097] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 649.988097] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 649.988097] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 649.988097] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 649.998594] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 1a7b0f53-ef43-4301-97b8-ab12f1f2ae45 in Status: IN_PROGRESS for 2s [ 650.841032] env[65370]: INFO networking_nsxv3.common.synchronization [req-05483f6e-8072-44fb-9702-a1780ad00aa0 req-4d862482-9a79-4645-98e4-d671b4a07439 tempest-ServerActionsTestOtherA-1239332614 tempest-ServerActionsTestOtherA-1239332614-project-member] Enqueued Resource ID: 408a8a38-c326-4f43-84a2-818a13f7e124 with Priority: HIGHEST for action security_group_members [ 650.843082] env[65370]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 408a8a38-c326-4f43-84a2-818a13f7e124 with Priority: HIGHEST for action security_group_members [ 650.843082] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock member-408a8a38-c326-4f43-84a2-818a13f7e124 taken with stack trace [, , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 650.843082] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-408a8a38-c326-4f43-84a2-818a13f7e124" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 650.843082] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-408a8a38-c326-4f43-84a2-818a13f7e124" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 650.843082] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-408a8a38-c326-4f43-84a2-818a13f7e124" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 650.843082] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 650.843082] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 650.843677] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 650.843677] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 650.843677] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 650.843677] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('408a8a38-c326-4f43-84a2-818a13f7e124',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 650.916086] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: aa33d5a3-f440-4aa7-9d41-10cb85d18100 in Status: SUCCESS [ 650.916086] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-aa33d5a3-f440-4aa7-9d41-10cb85d18100" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 651.346407] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 651.346761] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 651.346761] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 651.346887] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 651.346932] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 651.347454] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 651.347454] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 651.347454] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 651.347672] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 651.347672] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 651.347672] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 408a8a38-c326-4f43-84a2-818a13f7e124 already deleted. [ 651.347772] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-408a8a38-c326-4f43-84a2-818a13f7e124" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 651.507418] env[65370]: INFO networking_nsxv3.common.synchronization [None req-6fb6ce4a-de8c-4194-b77f-dbeae1790ffc None None] Enqueued Resource ID: 9581a58e-df92-4784-8aea-52d759b22b7c with Priority: HIGHEST for action port [ 651.507418] env[65370]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9581a58e-df92-4784-8aea-52d759b22b7c with Priority: HIGHEST for action port [ 651.507418] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock port-9581a58e-df92-4784-8aea-52d759b22b7c taken with stack trace [, , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 651.507418] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-9581a58e-df92-4784-8aea-52d759b22b7c" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 651.507418] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-9581a58e-df92-4784-8aea-52d759b22b7c" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 651.507825] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-9581a58e-df92-4784-8aea-52d759b22b7c" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 651.507825] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9581a58e-df92-4784-8aea-52d759b22b7c',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 651.785445] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8d9c7efa-60b6-44af-830b-f32145b1b403 in Status: SUCCESS [ 651.785445] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8d9c7efa-60b6-44af-830b-f32145b1b403" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 651.785445] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8d9c7efa-60b6-44af-830b-f32145b1b403" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 651.785445] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8d9c7efa-60b6-44af-830b-f32145b1b403" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 651.786030] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 651.786030] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 651.786030] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 651.786226] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 651.786226] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 651.786226] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8d9c7efa-60b6-44af-830b-f32145b1b403" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 651.786402] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock member-8d9c7efa-60b6-44af-830b-f32145b1b403 taken with stack trace [, , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 651.786511] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8d9c7efa-60b6-44af-830b-f32145b1b403" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 651.786570] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8d9c7efa-60b6-44af-830b-f32145b1b403" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 651.786727] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8d9c7efa-60b6-44af-830b-f32145b1b403" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 651.786885] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 651.786970] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 651.788896] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 651.788896] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 651.788896] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 651.788896] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8d9c7efa-60b6-44af-830b-f32145b1b403" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 651.788896] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('8d9c7efa-60b6-44af-830b-f32145b1b403',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 651.790801] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4269e0a9-b570-412a-9993-d1965229c186 in Status: SUCCESS [ 651.791140] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4269e0a9-b570-412a-9993-d1965229c186" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 651.791340] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4269e0a9-b570-412a-9993-d1965229c186" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 651.791525] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4269e0a9-b570-412a-9993-d1965229c186" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 651.791741] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 651.791858] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 651.791933] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 651.792159] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 651.792213] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 651.792298] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4269e0a9-b570-412a-9993-d1965229c186" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 651.792396] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('4269e0a9-b570-412a-9993-d1965229c186',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 651.893017] env[65370]: INFO networking_nsxv3.common.synchronization [None req-d587c633-1804-43c3-8a7c-23edc814618a None None] Enqueued Resource ID: a2732d2f-cce4-4141-84ce-97c6540d3bf2 with Priority: HIGHEST for action port [ 651.893671] env[65370]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a2732d2f-cce4-4141-84ce-97c6540d3bf2 with Priority: HIGHEST for action port [ 651.894143] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock port-a2732d2f-cce4-4141-84ce-97c6540d3bf2 taken with stack trace [, , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 651.894251] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-a2732d2f-cce4-4141-84ce-97c6540d3bf2" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 651.894884] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-a2732d2f-cce4-4141-84ce-97c6540d3bf2" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 651.894884] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-a2732d2f-cce4-4141-84ce-97c6540d3bf2" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 651.894884] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a2732d2f-cce4-4141-84ce-97c6540d3bf2',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 652.011821] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 1a7b0f53-ef43-4301-97b8-ab12f1f2ae45 in Status: SUCCESS [ 652.011821] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-1a7b0f53-ef43-4301-97b8-ab12f1f2ae45" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 652.012680] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 9581a58e-df92-4784-8aea-52d759b22b7c [ 652.012680] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 652.013215] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 652.013372] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 652.013929] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 652.014138] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 652.014286] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:9581a58e-df92-4784-8aea-52d759b22b7c already deleted. [ 652.014414] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-9581a58e-df92-4784-8aea-52d759b22b7c" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 652.296215] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 8d9c7efa-60b6-44af-830b-f32145b1b403: rpc.has_security_group_logging(os_id): False [ 652.297395] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('4269e0a9-b570-412a-9993-d1965229c186',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 652.316555] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 652.316777] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 652.318317] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 652.318317] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 652.318317] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 652.318317] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 652.318317] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 652.318317] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 652.318317] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 652.318317] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 652.318739] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 652.318739] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 652.318739] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 652.318856] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 652.318856] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 652.319012] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 652.319181] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 652.319235] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 652.319444] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 652.319526] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 652.319645] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 8d9c7efa-60b6-44af-830b-f32145b1b403 is going to be updated. [ 652.353470] env[65370]: DEBUG networking_nsxv3.common.locking [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Lock network-865 taken with stack trace [, , , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 652.353671] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquiring lock "network-865" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 652.353813] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquired lock "network-865" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 652.354238] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquired external semaphore "network-865" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 652.354498] env[65370]: DEBUG networking_nsxv3.common.locking [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 652.354651] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquiring lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 652.355138] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquired lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 652.355138] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquired external semaphore "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 652.355280] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Releasing lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 652.355492] env[65370]: DEBUG dogpile.cache.region [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] No value present for key: 'zone-id' {{(pid=65370) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 652.355594] env[65370]: DEBUG dogpile.lock [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] NeedRegenerationException {{(pid=65370) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 652.355745] env[65370]: DEBUG dogpile.lock [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] no value, waiting for create lock {{(pid=65370) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 652.355933] env[65370]: DEBUG dogpile.lock [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] value creation lock acquired {{(pid=65370) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 652.356035] env[65370]: DEBUG dogpile.cache.region [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] No value present for key: 'zone-id' {{(pid=65370) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 652.356117] env[65370]: DEBUG dogpile.lock [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Calling creation function for not-yet-present value {{(pid=65370) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 652.356337] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 652.377667] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 652.377667] env[65370]: DEBUG dogpile.cache.region [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=65370) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 652.377858] env[65370]: DEBUG dogpile.lock [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Released creation lock {{(pid=65370) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 652.378569] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Releasing lock "network-865" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 652.379017] env[65370]: DEBUG networking_nsxv3.common.locking [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Lock port-5cde9b6f-a8d2-48aa-8185-9cd30b7f2dab taken with stack trace [, , , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 652.379132] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquiring lock "port-5cde9b6f-a8d2-48aa-8185-9cd30b7f2dab" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 652.379307] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquired lock "port-5cde9b6f-a8d2-48aa-8185-9cd30b7f2dab" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 652.379731] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquired external semaphore "port-5cde9b6f-a8d2-48aa-8185-9cd30b7f2dab" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 652.379919] env[65370]: DEBUG networking_nsxv3.api.rpc [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5cde9b6f-a8d2-48aa-8185-9cd30b7f2dab',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 652.392473] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 652.392473] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 652.392473] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 652.392764] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 652.392803] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 652.399255] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port a2732d2f-cce4-4141-84ce-97c6540d3bf2 [ 652.399488] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 652.399628] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 652.399690] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 652.399893] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 652.400861] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 652.401057] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:a2732d2f-cce4-4141-84ce-97c6540d3bf2 already deleted. [ 652.401123] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-a2732d2f-cce4-4141-84ce-97c6540d3bf2" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 652.412565] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 8d9c7efa-60b6-44af-830b-f32145b1b403 in Status: IN_PROGRESS for 2s [ 652.801153] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 4269e0a9-b570-412a-9993-d1965229c186: rpc.has_security_group_logging(os_id): False [ 652.845468] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 652.845468] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 652.845468] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 652.845745] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 652.845745] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 652.846595] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 652.846595] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 652.846595] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 652.846595] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 652.846595] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 652.846595] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 4269e0a9-b570-412a-9993-d1965229c186 is going to be updated. [ 652.883120] env[65370]: DEBUG networking_nsxv3.common.locking [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 652.883298] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquiring lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 652.883398] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquired lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 652.883680] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquired external semaphore "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 652.883840] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Releasing lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 652.883996] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Segment Port 5cde9b6f-a8d2-48aa-8185-9cd30b7f2dab not found, creating... [ 652.884301] env[65370]: DEBUG networking_nsxv3.common.locking [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 652.884462] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquiring lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 652.884590] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquired lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 652.885086] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquired external semaphore "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 652.885298] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Releasing lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 652.885709] env[65370]: DEBUG networking_nsxv3.common.locking [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 652.885925] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquiring lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 652.886094] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquired lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 652.886494] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquired external semaphore "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 652.886677] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Releasing lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 652.886884] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Resource: SegmentPort with ID: 5cde9b6f-a8d2-48aa-8185-9cd30b7f2dab is going to be created. [ 652.910233] env[65370]: DEBUG networking_nsxv3.common.locking [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 652.910653] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquiring lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 652.910653] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquired lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 652.910832] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquired external semaphore "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 652.911084] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Releasing lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 652.911379] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Releasing lock "port-5cde9b6f-a8d2-48aa-8185-9cd30b7f2dab" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 652.932763] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 652.933061] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 652.933061] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 652.933201] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 652.933321] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 652.949520] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 4269e0a9-b570-412a-9993-d1965229c186 in Status: IN_PROGRESS for 2s [ 653.555332] env[65370]: INFO networking_nsxv3.common.synchronization [None req-787c4e2b-fce5-4798-8c66-0a1470047880 None None] Enqueued Resource ID: fea516c5-7ab5-4929-9511-bd1403a6bb5c with Priority: HIGHEST for action port [ 653.555332] env[65370]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fea516c5-7ab5-4929-9511-bd1403a6bb5c with Priority: HIGHEST for action port [ 653.555332] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock port-fea516c5-7ab5-4929-9511-bd1403a6bb5c taken with stack trace [, , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 653.555332] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-fea516c5-7ab5-4929-9511-bd1403a6bb5c" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 653.555332] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-fea516c5-7ab5-4929-9511-bd1403a6bb5c" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 653.556831] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-fea516c5-7ab5-4929-9511-bd1403a6bb5c" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 653.557129] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('fea516c5-7ab5-4929-9511-bd1403a6bb5c',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 653.765370] env[65370]: INFO networking_nsxv3.common.synchronization [req-05483f6e-8072-44fb-9702-a1780ad00aa0 req-c873c7e1-86e2-4d17-8d8a-ee237112abe4 service nova] Enqueued Resource ID: 408a8a38-c326-4f43-84a2-818a13f7e124 with Priority: HIGHEST for action security_group_rules [ 653.765531] env[65370]: INFO networking_nsxv3.common.synchronization [req-05483f6e-8072-44fb-9702-a1780ad00aa0 req-c873c7e1-86e2-4d17-8d8a-ee237112abe4 service nova] Enqueued Resource ID: 408a8a38-c326-4f43-84a2-818a13f7e124 with Priority: HIGHEST for action security_group_members [ 653.765657] env[65370]: INFO networking_nsxv3.common.synchronization [req-05483f6e-8072-44fb-9702-a1780ad00aa0 req-c873c7e1-86e2-4d17-8d8a-ee237112abe4 service nova] Enqueued Resource ID: 5cde9b6f-a8d2-48aa-8185-9cd30b7f2dab with Priority: HIGHEST for action port [ 653.766368] env[65370]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 408a8a38-c326-4f43-84a2-818a13f7e124 with Priority: HIGHEST for action security_group_rules [ 653.766830] env[65370]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 408a8a38-c326-4f43-84a2-818a13f7e124 with Priority: HIGHEST for action security_group_members [ 653.766947] env[65370]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5cde9b6f-a8d2-48aa-8185-9cd30b7f2dab with Priority: HIGHEST for action port [ 653.767327] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock rules-408a8a38-c326-4f43-84a2-818a13f7e124 taken with stack trace [, , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 653.767448] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-408a8a38-c326-4f43-84a2-818a13f7e124" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 653.767530] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-408a8a38-c326-4f43-84a2-818a13f7e124" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 653.767766] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-408a8a38-c326-4f43-84a2-818a13f7e124" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 653.767872] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('408a8a38-c326-4f43-84a2-818a13f7e124',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 653.770544] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock member-408a8a38-c326-4f43-84a2-818a13f7e124 taken with stack trace [, , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 653.770737] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-408a8a38-c326-4f43-84a2-818a13f7e124" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 653.770822] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-408a8a38-c326-4f43-84a2-818a13f7e124" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 653.773250] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-408a8a38-c326-4f43-84a2-818a13f7e124" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 653.773250] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 653.773250] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 653.773250] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 653.773250] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 653.773250] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 653.773250] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('408a8a38-c326-4f43-84a2-818a13f7e124',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 653.775449] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock port-5cde9b6f-a8d2-48aa-8185-9cd30b7f2dab taken with stack trace [, , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 653.775570] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-5cde9b6f-a8d2-48aa-8185-9cd30b7f2dab" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 653.775636] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-5cde9b6f-a8d2-48aa-8185-9cd30b7f2dab" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 653.775824] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-5cde9b6f-a8d2-48aa-8185-9cd30b7f2dab" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 653.775936] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5cde9b6f-a8d2-48aa-8185-9cd30b7f2dab',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 654.060852] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port fea516c5-7ab5-4929-9511-bd1403a6bb5c [ 654.060852] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 654.060852] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 654.060852] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 654.060852] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 654.060852] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 654.060852] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:fea516c5-7ab5-4929-9511-bd1403a6bb5c already deleted. [ 654.060852] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-fea516c5-7ab5-4929-9511-bd1403a6bb5c" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 654.285187] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('408a8a38-c326-4f43-84a2-818a13f7e124',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 654.285187] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock member-408a8a38-c326-4f43-84a2-818a13f7e124 taken with stack trace [, , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 654.285187] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-408a8a38-c326-4f43-84a2-818a13f7e124" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 654.285187] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 5cde9b6f-a8d2-48aa-8185-9cd30b7f2dab with status ACTIVE [ 654.285187] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 654.285187] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 654.285187] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 654.285187] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 654.285187] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 654.285187] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 654.285187] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 654.285187] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 654.285187] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 654.285187] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 654.285930] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 654.285930] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 654.285930] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 654.285930] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 654.286238] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 654.286470] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 5cde9b6f-a8d2-48aa-8185-9cd30b7f2dab is going to be updated. [ 654.316590] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 654.316730] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 654.316797] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 654.317058] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 654.317216] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 654.317374] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-5cde9b6f-a8d2-48aa-8185-9cd30b7f2dab" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 654.433760] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 8d9c7efa-60b6-44af-830b-f32145b1b403 in Status: SUCCESS [ 654.434076] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-8d9c7efa-60b6-44af-830b-f32145b1b403" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 654.434385] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-8d9c7efa-60b6-44af-830b-f32145b1b403" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 654.434623] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-8d9c7efa-60b6-44af-830b-f32145b1b403" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 654.434750] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('8d9c7efa-60b6-44af-830b-f32145b1b403',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 654.788821] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('408a8a38-c326-4f43-84a2-818a13f7e124',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 654.937435] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock member-8d9c7efa-60b6-44af-830b-f32145b1b403 taken with stack trace [, , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 654.937592] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8d9c7efa-60b6-44af-830b-f32145b1b403" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 654.937658] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8d9c7efa-60b6-44af-830b-f32145b1b403" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 654.938157] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8d9c7efa-60b6-44af-830b-f32145b1b403" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 654.938157] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 654.938157] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 654.938372] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 654.938372] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 654.938444] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 654.938999] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8d9c7efa-60b6-44af-830b-f32145b1b403" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 654.938999] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('8d9c7efa-60b6-44af-830b-f32145b1b403',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 654.963422] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 4269e0a9-b570-412a-9993-d1965229c186 in Status: SUCCESS [ 654.963619] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-4269e0a9-b570-412a-9993-d1965229c186" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 655.291744] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 655.292095] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 655.292095] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 655.292212] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 655.292298] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 655.292394] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 408a8a38-c326-4f43-84a2-818a13f7e124 is going to be created. [ 655.326109] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 655.327830] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 655.328010] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 655.329614] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 655.329614] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 655.357564] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 408a8a38-c326-4f43-84a2-818a13f7e124 in Status: UNINITIALIZED for 2s [ 655.442959] env[65370]: INFO networking_nsxv3.common.synchronization [None req-72251e0f-1bde-4cac-b20a-625883faa59c None None] Enqueued Resource ID: 3c53ac8a-776f-4d5e-9bb4-9beac045e5b0 with Priority: HIGHEST for action port [ 655.443584] env[65370]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3c53ac8a-776f-4d5e-9bb4-9beac045e5b0 with Priority: HIGHEST for action port [ 655.444601] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock port-3c53ac8a-776f-4d5e-9bb4-9beac045e5b0 taken with stack trace [, , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 655.444601] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-3c53ac8a-776f-4d5e-9bb4-9beac045e5b0" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 655.444754] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-3c53ac8a-776f-4d5e-9bb4-9beac045e5b0" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 655.445043] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-3c53ac8a-776f-4d5e-9bb4-9beac045e5b0" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 655.445129] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3c53ac8a-776f-4d5e-9bb4-9beac045e5b0',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 655.446942] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock member-8d9c7efa-60b6-44af-830b-f32145b1b403 taken with stack trace [, , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 655.446942] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8d9c7efa-60b6-44af-830b-f32145b1b403" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 655.447133] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8d9c7efa-60b6-44af-830b-f32145b1b403" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 655.447303] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8d9c7efa-60b6-44af-830b-f32145b1b403" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 655.447495] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 655.447685] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 655.448956] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 655.449172] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 655.449310] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 655.449478] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8d9c7efa-60b6-44af-830b-f32145b1b403" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 655.449531] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock member-8d9c7efa-60b6-44af-830b-f32145b1b403 taken with stack trace [, , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 655.449630] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8d9c7efa-60b6-44af-830b-f32145b1b403" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 655.449702] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8d9c7efa-60b6-44af-830b-f32145b1b403" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 655.449866] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8d9c7efa-60b6-44af-830b-f32145b1b403" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 655.450059] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 655.450174] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 655.450245] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 655.450392] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 655.450614] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 655.450614] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8d9c7efa-60b6-44af-830b-f32145b1b403" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 655.450700] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('8d9c7efa-60b6-44af-830b-f32145b1b403',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 655.953112] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 3c53ac8a-776f-4d5e-9bb4-9beac045e5b0 [ 655.953502] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 655.953502] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 655.953716] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 655.954837] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 655.954837] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 655.954837] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:3c53ac8a-776f-4d5e-9bb4-9beac045e5b0 already deleted. [ 655.954837] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-3c53ac8a-776f-4d5e-9bb4-9beac045e5b0" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 655.955650] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 8d9c7efa-60b6-44af-830b-f32145b1b403: rpc.has_security_group_logging(os_id): False [ 655.979555] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 655.979555] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 655.979555] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 655.979555] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 655.979555] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 655.979555] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 655.979555] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 655.979555] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 655.979555] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 655.979555] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 655.980311] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 655.980311] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 655.980311] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 655.980311] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 655.984118] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 655.984400] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 655.985056] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 655.985056] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 655.985056] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 655.985306] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 655.985306] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 8d9c7efa-60b6-44af-830b-f32145b1b403 is going to be updated. [ 656.040070] env[65370]: INFO networking_nsxv3.common.synchronization [None req-13834c28-5651-43b6-a3da-7bf4741d29c9 None None] Enqueued Resource ID: f007c386-b70b-4aa3-8d56-82b71ccea7c1 with Priority: HIGHEST for action port [ 656.040925] env[65370]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f007c386-b70b-4aa3-8d56-82b71ccea7c1 with Priority: HIGHEST for action port [ 656.043039] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock port-f007c386-b70b-4aa3-8d56-82b71ccea7c1 taken with stack trace [, , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 656.043179] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-f007c386-b70b-4aa3-8d56-82b71ccea7c1" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 656.043228] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-f007c386-b70b-4aa3-8d56-82b71ccea7c1" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 656.044466] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-f007c386-b70b-4aa3-8d56-82b71ccea7c1" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 656.044466] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f007c386-b70b-4aa3-8d56-82b71ccea7c1',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 656.057471] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 656.057471] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 656.057471] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 656.057471] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 656.057471] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 656.078952] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 8d9c7efa-60b6-44af-830b-f32145b1b403 in Status: IN_PROGRESS for 2s [ 656.545675] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port f007c386-b70b-4aa3-8d56-82b71ccea7c1 [ 656.546020] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 656.546020] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 656.546020] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 656.546513] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 656.546629] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 656.546735] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:f007c386-b70b-4aa3-8d56-82b71ccea7c1 already deleted. [ 656.546823] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-f007c386-b70b-4aa3-8d56-82b71ccea7c1" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 656.969486] env[65370]: INFO networking_nsxv3.common.synchronization [req-9f337802-9280-47bc-a141-b25bd054f584 req-668c2c37-f8be-4eb1-9294-f842e6194a56 tempest-ServerExternalEventsTest-616744642 tempest-ServerExternalEventsTest-616744642-project-member] Enqueued Resource ID: 20ca8821-63b1-4a18-a45d-43ad145b3707 with Priority: HIGHEST for action security_group_members [ 656.973908] env[65370]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 20ca8821-63b1-4a18-a45d-43ad145b3707 with Priority: HIGHEST for action security_group_members [ 656.974528] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock member-20ca8821-63b1-4a18-a45d-43ad145b3707 taken with stack trace [, , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 656.974528] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-20ca8821-63b1-4a18-a45d-43ad145b3707" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 656.974714] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-20ca8821-63b1-4a18-a45d-43ad145b3707" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 656.974862] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-20ca8821-63b1-4a18-a45d-43ad145b3707" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 656.975538] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 656.975538] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 656.975538] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 656.975538] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 656.975538] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 656.975986] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('20ca8821-63b1-4a18-a45d-43ad145b3707',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 657.369787] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 408a8a38-c326-4f43-84a2-818a13f7e124 in Status: SUCCESS [ 657.370013] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-408a8a38-c326-4f43-84a2-818a13f7e124" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 657.370194] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-408a8a38-c326-4f43-84a2-818a13f7e124" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 657.375027] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-408a8a38-c326-4f43-84a2-818a13f7e124" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 657.375027] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 657.375027] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 657.375027] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 657.375027] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 657.375027] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 657.375027] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-408a8a38-c326-4f43-84a2-818a13f7e124" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 657.375027] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('408a8a38-c326-4f43-84a2-818a13f7e124',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 657.479221] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 657.479221] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 657.479221] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 657.479221] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 657.479221] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 657.480562] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 657.480756] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 657.480857] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 657.483369] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 657.484057] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 657.484057] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 20ca8821-63b1-4a18-a45d-43ad145b3707 already deleted. [ 657.484057] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-20ca8821-63b1-4a18-a45d-43ad145b3707" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 657.513125] env[65370]: DEBUG networking_nsxv3.common.locking [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Lock network-449 taken with stack trace [, , , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 657.513330] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquiring lock "network-449" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 657.513441] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquired lock "network-449" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 657.513797] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquired external semaphore "network-449" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 657.514078] env[65370]: DEBUG networking_nsxv3.common.locking [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 657.514230] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquiring lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 657.514339] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquired lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 657.514554] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquired external semaphore "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 657.514687] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Releasing lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 657.514916] env[65370]: DEBUG dogpile.cache.region [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] No value present for key: 'zone-id' {{(pid=65370) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 657.515038] env[65370]: DEBUG dogpile.lock [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] NeedRegenerationException {{(pid=65370) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 657.515139] env[65370]: DEBUG dogpile.lock [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] no value, waiting for create lock {{(pid=65370) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 657.515236] env[65370]: DEBUG dogpile.lock [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] value creation lock acquired {{(pid=65370) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 657.515335] env[65370]: DEBUG dogpile.cache.region [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] No value present for key: 'zone-id' {{(pid=65370) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 657.515430] env[65370]: DEBUG dogpile.lock [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Calling creation function for not-yet-present value {{(pid=65370) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 657.515549] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 657.539773] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 657.539773] env[65370]: DEBUG dogpile.cache.region [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Cache value generated in 0.024 seconds for key(s): 'zone-id' {{(pid=65370) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 657.539773] env[65370]: DEBUG dogpile.lock [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Released creation lock {{(pid=65370) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 657.539773] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Releasing lock "network-449" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 657.540549] env[65370]: DEBUG networking_nsxv3.common.locking [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Lock port-c3ca9208-f480-4daf-8b04-db5cca4d75bf taken with stack trace [, , , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 657.540928] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquiring lock "port-c3ca9208-f480-4daf-8b04-db5cca4d75bf" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 657.540928] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquired lock "port-c3ca9208-f480-4daf-8b04-db5cca4d75bf" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 657.541617] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquired external semaphore "port-c3ca9208-f480-4daf-8b04-db5cca4d75bf" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 657.541839] env[65370]: DEBUG networking_nsxv3.api.rpc [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c3ca9208-f480-4daf-8b04-db5cca4d75bf',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 657.619474] env[65370]: INFO networking_nsxv3.common.synchronization [None req-064f0508-580d-4311-9798-797d4004644c None None] Enqueued Resource ID: ca473095-2692-4c17-b5df-54ac2efb05d5 with Priority: HIGHEST for action port [ 657.620351] env[65370]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ca473095-2692-4c17-b5df-54ac2efb05d5 with Priority: HIGHEST for action port [ 657.620404] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock port-ca473095-2692-4c17-b5df-54ac2efb05d5 taken with stack trace [, , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 657.620527] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-ca473095-2692-4c17-b5df-54ac2efb05d5" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 657.620592] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-ca473095-2692-4c17-b5df-54ac2efb05d5" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 657.621194] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-ca473095-2692-4c17-b5df-54ac2efb05d5" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 657.621511] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ca473095-2692-4c17-b5df-54ac2efb05d5',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 657.877026] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('408a8a38-c326-4f43-84a2-818a13f7e124',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 658.044600] env[65370]: DEBUG networking_nsxv3.common.locking [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 658.044838] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquiring lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 658.044961] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquired lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 658.045260] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquired external semaphore "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 658.045397] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Releasing lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 658.045537] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Segment Port c3ca9208-f480-4daf-8b04-db5cca4d75bf not found, creating... [ 658.045772] env[65370]: DEBUG networking_nsxv3.common.locking [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 658.045913] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquiring lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 658.046031] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquired lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 658.046239] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquired external semaphore "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 658.046359] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Releasing lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 658.048066] env[65370]: DEBUG networking_nsxv3.common.locking [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 658.048066] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquiring lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 658.048066] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquired lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 658.048066] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquired external semaphore "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 658.048066] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Releasing lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 658.048066] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Resource: SegmentPort with ID: c3ca9208-f480-4daf-8b04-db5cca4d75bf is going to be created. [ 658.068083] env[65370]: DEBUG networking_nsxv3.common.locking [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 658.068348] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquiring lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 658.068464] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquired lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 658.068724] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquired external semaphore "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 658.068946] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Releasing lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 658.069989] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Releasing lock "port-c3ca9208-f480-4daf-8b04-db5cca4d75bf" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 658.095333] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 8d9c7efa-60b6-44af-830b-f32145b1b403 in Status: SUCCESS [ 658.095573] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-8d9c7efa-60b6-44af-830b-f32145b1b403" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 658.123216] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port ca473095-2692-4c17-b5df-54ac2efb05d5 [ 658.123450] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 658.123589] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 658.123654] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 658.123879] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 658.123977] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 658.124090] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:ca473095-2692-4c17-b5df-54ac2efb05d5 already deleted. [ 658.124172] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-ca473095-2692-4c17-b5df-54ac2efb05d5" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 658.240505] env[65370]: INFO networking_nsxv3.common.synchronization [None req-6d9f36ed-42b9-4375-85b2-fc52142911f0 None None] Enqueued Resource ID: 0be3688e-ff27-4df0-84e1-e051d7de31f9 with Priority: HIGHEST for action port [ 658.241532] env[65370]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0be3688e-ff27-4df0-84e1-e051d7de31f9 with Priority: HIGHEST for action port [ 658.242041] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock port-0be3688e-ff27-4df0-84e1-e051d7de31f9 taken with stack trace [, , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 658.242220] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-0be3688e-ff27-4df0-84e1-e051d7de31f9" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 658.242366] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-0be3688e-ff27-4df0-84e1-e051d7de31f9" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 658.242894] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-0be3688e-ff27-4df0-84e1-e051d7de31f9" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 658.243666] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0be3688e-ff27-4df0-84e1-e051d7de31f9',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 658.380788] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 408a8a38-c326-4f43-84a2-818a13f7e124: rpc.has_security_group_logging(os_id): False [ 658.401436] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 658.401641] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 658.401691] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 658.401874] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 658.401965] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 658.402216] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 658.402318] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 658.402382] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 658.402540] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 658.402621] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 658.402706] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 408a8a38-c326-4f43-84a2-818a13f7e124 is going to be created. [ 658.474271] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 658.474424] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 658.474473] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 658.474962] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 658.474962] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 658.488839] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 408a8a38-c326-4f43-84a2-818a13f7e124 in Status: IN_PROGRESS for 2s [ 658.746604] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 0be3688e-ff27-4df0-84e1-e051d7de31f9 [ 658.746952] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 658.747242] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 658.747412] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 658.747540] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 658.747673] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 658.748260] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:0be3688e-ff27-4df0-84e1-e051d7de31f9 already deleted. [ 658.748260] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-0be3688e-ff27-4df0-84e1-e051d7de31f9" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 658.804990] env[65370]: INFO networking_nsxv3.common.synchronization [req-9f337802-9280-47bc-a141-b25bd054f584 req-ba2b8f8c-8039-438f-878b-cd1dfc46e66a service nova] Enqueued Resource ID: 20ca8821-63b1-4a18-a45d-43ad145b3707 with Priority: HIGHEST for action security_group_rules [ 658.804990] env[65370]: INFO networking_nsxv3.common.synchronization [req-9f337802-9280-47bc-a141-b25bd054f584 req-ba2b8f8c-8039-438f-878b-cd1dfc46e66a service nova] Enqueued Resource ID: 20ca8821-63b1-4a18-a45d-43ad145b3707 with Priority: HIGHEST for action security_group_members [ 658.804990] env[65370]: INFO networking_nsxv3.common.synchronization [req-9f337802-9280-47bc-a141-b25bd054f584 req-ba2b8f8c-8039-438f-878b-cd1dfc46e66a service nova] Enqueued Resource ID: c3ca9208-f480-4daf-8b04-db5cca4d75bf with Priority: HIGHEST for action port [ 658.804990] env[65370]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 20ca8821-63b1-4a18-a45d-43ad145b3707 with Priority: HIGHEST for action security_group_rules [ 658.804990] env[65370]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 20ca8821-63b1-4a18-a45d-43ad145b3707 with Priority: HIGHEST for action security_group_members [ 658.804990] env[65370]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c3ca9208-f480-4daf-8b04-db5cca4d75bf with Priority: HIGHEST for action port [ 658.806750] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock rules-20ca8821-63b1-4a18-a45d-43ad145b3707 taken with stack trace [, , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 658.806935] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-20ca8821-63b1-4a18-a45d-43ad145b3707" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 658.807048] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-20ca8821-63b1-4a18-a45d-43ad145b3707" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 658.807345] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-20ca8821-63b1-4a18-a45d-43ad145b3707" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 658.807473] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('20ca8821-63b1-4a18-a45d-43ad145b3707',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 658.808441] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock member-20ca8821-63b1-4a18-a45d-43ad145b3707 taken with stack trace [, , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 658.808563] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-20ca8821-63b1-4a18-a45d-43ad145b3707" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 658.808668] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-20ca8821-63b1-4a18-a45d-43ad145b3707" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 658.808911] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-20ca8821-63b1-4a18-a45d-43ad145b3707" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 658.809732] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 658.809732] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 658.809732] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 658.809732] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 658.809732] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 658.809732] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('20ca8821-63b1-4a18-a45d-43ad145b3707',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 658.815128] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock port-c3ca9208-f480-4daf-8b04-db5cca4d75bf taken with stack trace [, , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 658.815128] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-c3ca9208-f480-4daf-8b04-db5cca4d75bf" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 658.820418] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-c3ca9208-f480-4daf-8b04-db5cca4d75bf" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 658.820418] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-c3ca9208-f480-4daf-8b04-db5cca4d75bf" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 658.820418] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c3ca9208-f480-4daf-8b04-db5cca4d75bf',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 659.316677] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('20ca8821-63b1-4a18-a45d-43ad145b3707',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 659.318883] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock member-20ca8821-63b1-4a18-a45d-43ad145b3707 taken with stack trace [, , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 659.319085] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-20ca8821-63b1-4a18-a45d-43ad145b3707" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 659.323479] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port c3ca9208-f480-4daf-8b04-db5cca4d75bf with status ACTIVE [ 659.324518] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 659.324669] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 659.324795] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 659.325092] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 659.325197] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 659.325437] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 659.325550] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 659.325632] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 659.325954] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 659.325954] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 659.326398] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 659.326398] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 659.326398] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 659.326398] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 659.326398] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 659.326703] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: c3ca9208-f480-4daf-8b04-db5cca4d75bf is going to be updated. [ 659.350354] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 659.350646] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 659.350646] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 659.350804] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 659.350903] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 659.351106] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-c3ca9208-f480-4daf-8b04-db5cca4d75bf" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 659.751753] env[65370]: INFO networking_nsxv3.common.synchronization [req-90fb4857-542d-4e72-955d-4ad8d96d5a80 req-9798239f-5169-4f91-abdc-f848caaef8c3 tempest-ListImageFiltersTestJSON-1988219331 tempest-ListImageFiltersTestJSON-1988219331-project-member] Enqueued Resource ID: e4c5be7e-6c74-44a0-bf7b-9581ec4636c2 with Priority: HIGHEST for action security_group_members [ 659.752484] env[65370]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e4c5be7e-6c74-44a0-bf7b-9581ec4636c2 with Priority: HIGHEST for action security_group_members [ 659.755578] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock member-e4c5be7e-6c74-44a0-bf7b-9581ec4636c2 taken with stack trace [, , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 659.755773] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e4c5be7e-6c74-44a0-bf7b-9581ec4636c2" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 659.755848] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e4c5be7e-6c74-44a0-bf7b-9581ec4636c2" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 659.756239] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e4c5be7e-6c74-44a0-bf7b-9581ec4636c2" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 659.758025] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 659.758275] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 659.758275] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 659.758394] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 659.759324] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 659.759324] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e4c5be7e-6c74-44a0-bf7b-9581ec4636c2',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 659.819496] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('20ca8821-63b1-4a18-a45d-43ad145b3707',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 660.263482] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 660.263482] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 660.263482] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 660.263482] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 660.263482] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 660.263482] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 660.263482] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 660.263482] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 660.263482] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 660.263482] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 660.263482] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e4c5be7e-6c74-44a0-bf7b-9581ec4636c2 already deleted. [ 660.263482] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e4c5be7e-6c74-44a0-bf7b-9581ec4636c2" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 660.327228] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 660.327228] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 660.327228] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 660.327228] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 660.327228] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 660.327228] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 20ca8821-63b1-4a18-a45d-43ad145b3707 is going to be created. [ 660.404801] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 660.404801] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 660.404801] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 660.404801] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 660.405227] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 660.417383] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 20ca8821-63b1-4a18-a45d-43ad145b3707 in Status: UNINITIALIZED for 2s [ 660.465259] env[65370]: DEBUG networking_nsxv3.common.locking [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Lock network-449 taken with stack trace [, , , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 660.465259] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquiring lock "network-449" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 660.465259] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquired lock "network-449" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 660.465259] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquired external semaphore "network-449" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 660.465259] env[65370]: DEBUG networking_nsxv3.common.locking [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 660.466167] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquiring lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 660.466452] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquired lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 660.466847] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquired external semaphore "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 660.467188] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Releasing lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 660.467528] env[65370]: DEBUG dogpile.cache.region [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] No value present for key: 'zone-id' {{(pid=65370) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 660.467845] env[65370]: DEBUG dogpile.lock [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] NeedRegenerationException {{(pid=65370) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 660.468078] env[65370]: DEBUG dogpile.lock [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] no value, waiting for create lock {{(pid=65370) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 660.468360] env[65370]: DEBUG dogpile.lock [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] value creation lock acquired {{(pid=65370) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 660.470018] env[65370]: DEBUG dogpile.cache.region [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] No value present for key: 'zone-id' {{(pid=65370) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 660.470018] env[65370]: DEBUG dogpile.lock [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Calling creation function for not-yet-present value {{(pid=65370) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 660.470018] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 660.503055] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 408a8a38-c326-4f43-84a2-818a13f7e124 in Status: SUCCESS [ 660.505018] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-408a8a38-c326-4f43-84a2-818a13f7e124" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 660.513697] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 660.514212] env[65370]: DEBUG dogpile.cache.region [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Cache value generated in 0.045 seconds for key(s): 'zone-id' {{(pid=65370) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 660.514212] env[65370]: DEBUG dogpile.lock [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Released creation lock {{(pid=65370) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 660.514212] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Releasing lock "network-449" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 660.516171] env[65370]: DEBUG networking_nsxv3.common.locking [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Lock port-72c9ba7c-1d23-4040-8148-1aff56b691bf taken with stack trace [, , , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 660.516171] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquiring lock "port-72c9ba7c-1d23-4040-8148-1aff56b691bf" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 660.516171] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquired lock "port-72c9ba7c-1d23-4040-8148-1aff56b691bf" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 660.516171] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquired external semaphore "port-72c9ba7c-1d23-4040-8148-1aff56b691bf" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 660.516171] env[65370]: DEBUG networking_nsxv3.api.rpc [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('72c9ba7c-1d23-4040-8148-1aff56b691bf',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 661.018986] env[65370]: DEBUG networking_nsxv3.common.locking [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 661.019373] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquiring lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 661.019586] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquired lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 661.020017] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquired external semaphore "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 661.020264] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Releasing lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 661.020501] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Segment Port 72c9ba7c-1d23-4040-8148-1aff56b691bf not found, creating... [ 661.020906] env[65370]: DEBUG networking_nsxv3.common.locking [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 661.021168] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquiring lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 661.021348] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquired lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 661.021676] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquired external semaphore "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 661.021887] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Releasing lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 661.022450] env[65370]: DEBUG networking_nsxv3.common.locking [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 661.022802] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquiring lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 661.022998] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquired lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 661.023337] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquired external semaphore "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 661.023547] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Releasing lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 661.023759] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Resource: SegmentPort with ID: 72c9ba7c-1d23-4040-8148-1aff56b691bf is going to be created. [ 661.047963] env[65370]: DEBUG networking_nsxv3.common.locking [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 661.048315] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquiring lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 661.048507] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquired lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 661.048916] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquired external semaphore "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 661.049503] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Releasing lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 661.049838] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Releasing lock "port-72c9ba7c-1d23-4040-8148-1aff56b691bf" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 661.319718] env[65370]: INFO networking_nsxv3.common.synchronization [None req-491b7ede-eadc-4459-a207-314333bf0ea7 None None] Enqueued Resource ID: 2432d212-d780-4df7-82cf-9642232f993b with Priority: HIGHEST for action port [ 661.320377] env[65370]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2432d212-d780-4df7-82cf-9642232f993b with Priority: HIGHEST for action port [ 661.321031] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock port-2432d212-d780-4df7-82cf-9642232f993b taken with stack trace [, , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 661.321031] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-2432d212-d780-4df7-82cf-9642232f993b" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 661.321031] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-2432d212-d780-4df7-82cf-9642232f993b" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 661.321276] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-2432d212-d780-4df7-82cf-9642232f993b" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 661.321276] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2432d212-d780-4df7-82cf-9642232f993b',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 661.784332] env[65370]: INFO networking_nsxv3.common.synchronization [req-90fb4857-542d-4e72-955d-4ad8d96d5a80 req-f0cb4252-b32d-4fb6-8301-4293a8e37d8d service nova] Enqueued Resource ID: e4c5be7e-6c74-44a0-bf7b-9581ec4636c2 with Priority: HIGHEST for action security_group_rules [ 661.784332] env[65370]: INFO networking_nsxv3.common.synchronization [req-90fb4857-542d-4e72-955d-4ad8d96d5a80 req-f0cb4252-b32d-4fb6-8301-4293a8e37d8d service nova] Enqueued Resource ID: e4c5be7e-6c74-44a0-bf7b-9581ec4636c2 with Priority: HIGHEST for action security_group_members [ 661.784332] env[65370]: INFO networking_nsxv3.common.synchronization [req-90fb4857-542d-4e72-955d-4ad8d96d5a80 req-f0cb4252-b32d-4fb6-8301-4293a8e37d8d service nova] Enqueued Resource ID: 72c9ba7c-1d23-4040-8148-1aff56b691bf with Priority: HIGHEST for action port [ 661.784332] env[65370]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e4c5be7e-6c74-44a0-bf7b-9581ec4636c2 with Priority: HIGHEST for action security_group_rules [ 661.784332] env[65370]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e4c5be7e-6c74-44a0-bf7b-9581ec4636c2 with Priority: HIGHEST for action security_group_members [ 661.784332] env[65370]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 72c9ba7c-1d23-4040-8148-1aff56b691bf with Priority: HIGHEST for action port [ 661.784332] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e4c5be7e-6c74-44a0-bf7b-9581ec4636c2 taken with stack trace [, , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 661.784332] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e4c5be7e-6c74-44a0-bf7b-9581ec4636c2" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 661.784332] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e4c5be7e-6c74-44a0-bf7b-9581ec4636c2" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 661.784332] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e4c5be7e-6c74-44a0-bf7b-9581ec4636c2" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 661.785587] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e4c5be7e-6c74-44a0-bf7b-9581ec4636c2',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 661.788056] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock member-e4c5be7e-6c74-44a0-bf7b-9581ec4636c2 taken with stack trace [, , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 661.788796] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e4c5be7e-6c74-44a0-bf7b-9581ec4636c2" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 661.788796] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e4c5be7e-6c74-44a0-bf7b-9581ec4636c2" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 661.789223] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e4c5be7e-6c74-44a0-bf7b-9581ec4636c2" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 661.790064] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 661.790064] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 661.790064] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 661.790064] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 661.790303] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 661.790405] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e4c5be7e-6c74-44a0-bf7b-9581ec4636c2',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 661.791968] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock port-72c9ba7c-1d23-4040-8148-1aff56b691bf taken with stack trace [, , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 661.792143] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-72c9ba7c-1d23-4040-8148-1aff56b691bf" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 661.792212] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-72c9ba7c-1d23-4040-8148-1aff56b691bf" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 661.792522] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-72c9ba7c-1d23-4040-8148-1aff56b691bf" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 661.792611] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('72c9ba7c-1d23-4040-8148-1aff56b691bf',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 661.822702] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 2432d212-d780-4df7-82cf-9642232f993b [ 661.823717] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 661.823717] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 661.823717] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 661.823717] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 661.823717] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 661.823717] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:2432d212-d780-4df7-82cf-9642232f993b already deleted. [ 661.823717] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-2432d212-d780-4df7-82cf-9642232f993b" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 662.300177] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock member-e4c5be7e-6c74-44a0-bf7b-9581ec4636c2 taken with stack trace [, , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 662.300177] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e4c5be7e-6c74-44a0-bf7b-9581ec4636c2" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 662.300177] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('e4c5be7e-6c74-44a0-bf7b-9581ec4636c2',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 662.300177] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 72c9ba7c-1d23-4040-8148-1aff56b691bf with status ACTIVE [ 662.300177] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 662.300177] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 662.300177] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 662.300177] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 662.300177] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 662.300177] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 662.300177] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 662.300177] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 662.300177] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 662.300177] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 662.301142] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 662.301142] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 662.301142] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 662.301142] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 662.301142] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 662.301142] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 72c9ba7c-1d23-4040-8148-1aff56b691bf is going to be updated. [ 662.323648] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 662.323648] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 662.323648] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 662.323648] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 662.323879] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 662.323879] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-72c9ba7c-1d23-4040-8148-1aff56b691bf" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 662.437402] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 20ca8821-63b1-4a18-a45d-43ad145b3707 in Status: SUCCESS [ 662.438292] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-20ca8821-63b1-4a18-a45d-43ad145b3707" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 662.438292] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-20ca8821-63b1-4a18-a45d-43ad145b3707" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 662.438292] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-20ca8821-63b1-4a18-a45d-43ad145b3707" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 662.438292] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 662.438595] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 662.438595] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 662.438669] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 662.438756] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 662.438845] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-20ca8821-63b1-4a18-a45d-43ad145b3707" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 662.438944] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('20ca8821-63b1-4a18-a45d-43ad145b3707',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 662.800862] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('e4c5be7e-6c74-44a0-bf7b-9581ec4636c2',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 662.946120] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock member-20ca8821-63b1-4a18-a45d-43ad145b3707 taken with stack trace [, , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 662.946286] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-20ca8821-63b1-4a18-a45d-43ad145b3707" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 662.946328] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-20ca8821-63b1-4a18-a45d-43ad145b3707" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 662.946532] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-20ca8821-63b1-4a18-a45d-43ad145b3707" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 662.946692] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 662.946815] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 662.946875] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 662.947009] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 662.947133] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 662.947208] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-20ca8821-63b1-4a18-a45d-43ad145b3707" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 662.947327] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock member-20ca8821-63b1-4a18-a45d-43ad145b3707 taken with stack trace [, , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 662.947419] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-20ca8821-63b1-4a18-a45d-43ad145b3707" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 662.947473] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-20ca8821-63b1-4a18-a45d-43ad145b3707" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 662.947612] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-20ca8821-63b1-4a18-a45d-43ad145b3707" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 662.947760] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 662.947820] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 662.947961] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 662.947997] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 662.948177] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 662.948177] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-20ca8821-63b1-4a18-a45d-43ad145b3707" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 662.948335] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('20ca8821-63b1-4a18-a45d-43ad145b3707',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 663.303878] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 663.303878] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 663.304237] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 663.304237] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 663.304310] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 663.305640] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e4c5be7e-6c74-44a0-bf7b-9581ec4636c2 is going to be created. [ 663.330340] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 663.330524] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 663.330609] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 663.330863] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 663.331042] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 663.342174] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e4c5be7e-6c74-44a0-bf7b-9581ec4636c2 in Status: UNINITIALIZED for 2s [ 663.347520] env[65370]: INFO networking_nsxv3.common.synchronization [None req-4a546468-3c7f-4a44-9d49-9dc3197af62d None None] Enqueued Resource ID: 0d08b3e0-674d-42a0-9a84-fa6a66c08170 with Priority: HIGHEST for action port [ 663.347801] env[65370]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0d08b3e0-674d-42a0-9a84-fa6a66c08170 with Priority: HIGHEST for action port [ 663.348426] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock port-0d08b3e0-674d-42a0-9a84-fa6a66c08170 taken with stack trace [, , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 663.348555] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-0d08b3e0-674d-42a0-9a84-fa6a66c08170" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 663.348615] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-0d08b3e0-674d-42a0-9a84-fa6a66c08170" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 663.348873] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-0d08b3e0-674d-42a0-9a84-fa6a66c08170" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 663.348949] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0d08b3e0-674d-42a0-9a84-fa6a66c08170',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 663.451844] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 20ca8821-63b1-4a18-a45d-43ad145b3707: rpc.has_security_group_logging(os_id): False [ 663.471681] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 663.471900] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 663.471976] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 663.472210] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 663.472305] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 663.472631] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 663.472812] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 663.473285] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 663.473285] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 663.473285] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 663.473438] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 663.473536] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 663.473627] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 663.473808] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 663.473911] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 663.474141] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 663.474269] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 663.474351] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 663.474513] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 663.474612] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 663.474863] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 20ca8821-63b1-4a18-a45d-43ad145b3707 is going to be created. [ 663.520986] env[65370]: INFO networking_nsxv3.common.synchronization [req-0e838c29-262c-4b0d-99e5-3fddbafc1f47 req-2b0884f4-0d1c-44ed-8153-5a22cb84d3c2 tempest-InstanceActionsTestJSON-805513987 tempest-InstanceActionsTestJSON-805513987-project-member] Enqueued Resource ID: d65082c9-0b60-42be-a86a-b728b05e4ca4 with Priority: HIGHEST for action security_group_members [ 663.520986] env[65370]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d65082c9-0b60-42be-a86a-b728b05e4ca4 with Priority: HIGHEST for action security_group_members [ 663.520986] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock member-d65082c9-0b60-42be-a86a-b728b05e4ca4 taken with stack trace [, , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 663.521187] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d65082c9-0b60-42be-a86a-b728b05e4ca4" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 663.521187] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d65082c9-0b60-42be-a86a-b728b05e4ca4" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 663.521981] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d65082c9-0b60-42be-a86a-b728b05e4ca4" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 663.523148] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 663.523340] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 663.523509] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 663.523691] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 663.523802] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 663.523964] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d65082c9-0b60-42be-a86a-b728b05e4ca4',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 663.530964] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 663.531221] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 663.531486] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 663.531945] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 663.531945] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 663.542530] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 20ca8821-63b1-4a18-a45d-43ad145b3707 in Status: IN_PROGRESS for 2s [ 663.757696] env[65370]: INFO networking_nsxv3.common.synchronization [None req-ef480cfb-4ced-4369-b680-4a6739577912 None None] Enqueued Resource ID: 84800a32-a203-4441-9e79-68b02070248f with Priority: HIGHEST for action port [ 663.762135] env[65370]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 84800a32-a203-4441-9e79-68b02070248f with Priority: HIGHEST for action port [ 663.763646] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock port-84800a32-a203-4441-9e79-68b02070248f taken with stack trace [, , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 663.763819] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-84800a32-a203-4441-9e79-68b02070248f" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 663.763969] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-84800a32-a203-4441-9e79-68b02070248f" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 663.764248] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-84800a32-a203-4441-9e79-68b02070248f" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 663.764335] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('84800a32-a203-4441-9e79-68b02070248f',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 663.857392] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 0d08b3e0-674d-42a0-9a84-fa6a66c08170 [ 663.857392] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 663.857392] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 663.857392] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 663.857392] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 663.857392] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 663.857392] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:0d08b3e0-674d-42a0-9a84-fa6a66c08170 already deleted. [ 663.857392] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-0d08b3e0-674d-42a0-9a84-fa6a66c08170" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 664.027033] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 664.027241] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 664.027319] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 664.027536] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 664.027630] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 664.027848] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 664.027951] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 664.028035] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 664.028193] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 664.028270] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 664.028355] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d65082c9-0b60-42be-a86a-b728b05e4ca4 already deleted. [ 664.028452] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d65082c9-0b60-42be-a86a-b728b05e4ca4" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 664.276494] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 84800a32-a203-4441-9e79-68b02070248f [ 664.276494] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 664.276494] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 664.276494] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 664.276494] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 664.276494] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 664.276494] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:84800a32-a203-4441-9e79-68b02070248f already deleted. [ 664.276494] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-84800a32-a203-4441-9e79-68b02070248f" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 664.304779] env[65370]: DEBUG networking_nsxv3.common.locking [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Lock network-65 taken with stack trace [, , , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 664.306041] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquiring lock "network-65" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 664.306041] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquired lock "network-65" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 664.306041] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquired external semaphore "network-65" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 664.306471] env[65370]: DEBUG networking_nsxv3.common.locking [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 664.306771] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquiring lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 664.307009] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquired lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 664.308814] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquired external semaphore "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 664.308814] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Releasing lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 664.308814] env[65370]: DEBUG dogpile.cache.region [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] No value present for key: 'zone-id' {{(pid=65370) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 664.308814] env[65370]: DEBUG dogpile.lock [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] NeedRegenerationException {{(pid=65370) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 664.308814] env[65370]: DEBUG dogpile.lock [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] no value, waiting for create lock {{(pid=65370) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 664.308814] env[65370]: DEBUG dogpile.lock [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] value creation lock acquired {{(pid=65370) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 664.308814] env[65370]: DEBUG dogpile.cache.region [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] No value present for key: 'zone-id' {{(pid=65370) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 664.308814] env[65370]: DEBUG dogpile.lock [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Calling creation function for not-yet-present value {{(pid=65370) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 664.308814] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 664.329958] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 664.330659] env[65370]: DEBUG dogpile.cache.region [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=65370) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 664.330659] env[65370]: DEBUG dogpile.lock [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Released creation lock {{(pid=65370) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 664.330659] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Releasing lock "network-65" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 664.330845] env[65370]: DEBUG networking_nsxv3.common.locking [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Lock port-87900514-1a39-469f-97a9-36a044fcbbd6 taken with stack trace [, , , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 664.330845] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquiring lock "port-87900514-1a39-469f-97a9-36a044fcbbd6" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 664.331048] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquired lock "port-87900514-1a39-469f-97a9-36a044fcbbd6" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 664.331288] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquired external semaphore "port-87900514-1a39-469f-97a9-36a044fcbbd6" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 664.331419] env[65370]: DEBUG networking_nsxv3.api.rpc [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('87900514-1a39-469f-97a9-36a044fcbbd6',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 664.834831] env[65370]: DEBUG networking_nsxv3.common.locking [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 664.837942] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquiring lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 664.837942] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquired lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 664.837942] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquired external semaphore "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 664.837942] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Releasing lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 664.837942] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Segment Port 87900514-1a39-469f-97a9-36a044fcbbd6 not found, creating... [ 664.837942] env[65370]: DEBUG networking_nsxv3.common.locking [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 664.837942] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquiring lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 664.837942] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquired lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 664.837942] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquired external semaphore "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 664.837942] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Releasing lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 664.839557] env[65370]: DEBUG networking_nsxv3.common.locking [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 664.842012] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquiring lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 664.842012] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquired lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 664.842012] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquired external semaphore "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 664.842012] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Releasing lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 664.842012] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Resource: SegmentPort with ID: 87900514-1a39-469f-97a9-36a044fcbbd6 is going to be created. [ 664.846765] env[65370]: INFO networking_nsxv3.common.synchronization [None req-27115455-72de-4884-b21f-32c9bedb5a56 tempest-ServersTestManualDisk-1265226149 tempest-ServersTestManualDisk-1265226149-project-member] Enqueued Resource ID: 23979820-ccb5-4fdf-8d1a-316ad4242d32 with Priority: HIGHEST for action security_group_rules [ 664.848393] env[65370]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 23979820-ccb5-4fdf-8d1a-316ad4242d32 with Priority: HIGHEST for action security_group_rules [ 664.848659] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock rules-23979820-ccb5-4fdf-8d1a-316ad4242d32 taken with stack trace [, , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 664.848779] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-23979820-ccb5-4fdf-8d1a-316ad4242d32" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 664.848854] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-23979820-ccb5-4fdf-8d1a-316ad4242d32" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 664.849218] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-23979820-ccb5-4fdf-8d1a-316ad4242d32" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 664.849324] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('23979820-ccb5-4fdf-8d1a-316ad4242d32',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 664.870081] env[65370]: DEBUG networking_nsxv3.common.locking [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 664.870081] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquiring lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 664.870081] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquired lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 664.870081] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquired external semaphore "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 664.870425] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Releasing lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 664.870425] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Releasing lock "port-87900514-1a39-469f-97a9-36a044fcbbd6" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 665.305987] env[65370]: INFO networking_nsxv3.common.synchronization [None req-5726e3ca-2ae8-4c70-a2cd-90691d793abb None None] Enqueued Resource ID: 979fd688-2b85-4539-a09f-586e2d99fc25 with Priority: HIGHEST for action port [ 665.306589] env[65370]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 979fd688-2b85-4539-a09f-586e2d99fc25 with Priority: HIGHEST for action port [ 665.307290] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock port-979fd688-2b85-4539-a09f-586e2d99fc25 taken with stack trace [, , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 665.307465] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-979fd688-2b85-4539-a09f-586e2d99fc25" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 665.307532] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-979fd688-2b85-4539-a09f-586e2d99fc25" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 665.307957] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-979fd688-2b85-4539-a09f-586e2d99fc25" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 665.308057] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('979fd688-2b85-4539-a09f-586e2d99fc25',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 665.355160] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e4c5be7e-6c74-44a0-bf7b-9581ec4636c2 in Status: SUCCESS [ 665.355599] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e4c5be7e-6c74-44a0-bf7b-9581ec4636c2" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 665.357404] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e4c5be7e-6c74-44a0-bf7b-9581ec4636c2" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 665.357661] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e4c5be7e-6c74-44a0-bf7b-9581ec4636c2" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 665.358327] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 665.358478] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 665.358530] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 665.358732] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 665.358822] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 665.359095] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e4c5be7e-6c74-44a0-bf7b-9581ec4636c2" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 665.359297] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('e4c5be7e-6c74-44a0-bf7b-9581ec4636c2',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 665.386854] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 665.387015] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 665.387102] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 665.387372] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 665.387491] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 665.387571] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 23979820-ccb5-4fdf-8d1a-316ad4242d32 already deleted. [ 665.387909] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-23979820-ccb5-4fdf-8d1a-316ad4242d32" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 665.410375] env[65370]: INFO networking_nsxv3.common.synchronization [None req-24a0dac6-7429-4677-b926-69453edee266 None None] Enqueued Resource ID: edfe3596-ee5e-431e-8e00-391424cfeca5 with Priority: HIGHEST for action port [ 665.410621] env[65370]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: edfe3596-ee5e-431e-8e00-391424cfeca5 with Priority: HIGHEST for action port [ 665.411164] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock port-edfe3596-ee5e-431e-8e00-391424cfeca5 taken with stack trace [, , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 665.411320] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-edfe3596-ee5e-431e-8e00-391424cfeca5" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 665.411396] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-edfe3596-ee5e-431e-8e00-391424cfeca5" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 665.411645] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-edfe3596-ee5e-431e-8e00-391424cfeca5" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 665.411725] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('edfe3596-ee5e-431e-8e00-391424cfeca5',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 665.557437] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 20ca8821-63b1-4a18-a45d-43ad145b3707 in Status: SUCCESS [ 665.557437] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-20ca8821-63b1-4a18-a45d-43ad145b3707" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 665.579093] env[65370]: INFO networking_nsxv3.common.synchronization [req-0e838c29-262c-4b0d-99e5-3fddbafc1f47 req-89d01ef8-1404-490d-be1c-45e75d24f91d service nova] Enqueued Resource ID: d65082c9-0b60-42be-a86a-b728b05e4ca4 with Priority: HIGHEST for action security_group_rules [ 665.579093] env[65370]: INFO networking_nsxv3.common.synchronization [req-0e838c29-262c-4b0d-99e5-3fddbafc1f47 req-89d01ef8-1404-490d-be1c-45e75d24f91d service nova] Enqueued Resource ID: d65082c9-0b60-42be-a86a-b728b05e4ca4 with Priority: HIGHEST for action security_group_members [ 665.579093] env[65370]: INFO networking_nsxv3.common.synchronization [req-0e838c29-262c-4b0d-99e5-3fddbafc1f47 req-89d01ef8-1404-490d-be1c-45e75d24f91d service nova] Enqueued Resource ID: 87900514-1a39-469f-97a9-36a044fcbbd6 with Priority: HIGHEST for action port [ 665.579093] env[65370]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d65082c9-0b60-42be-a86a-b728b05e4ca4 with Priority: HIGHEST for action security_group_rules [ 665.579093] env[65370]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d65082c9-0b60-42be-a86a-b728b05e4ca4 with Priority: HIGHEST for action security_group_members [ 665.579093] env[65370]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 87900514-1a39-469f-97a9-36a044fcbbd6 with Priority: HIGHEST for action port [ 665.579093] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d65082c9-0b60-42be-a86a-b728b05e4ca4 taken with stack trace [, , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 665.579093] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d65082c9-0b60-42be-a86a-b728b05e4ca4" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 665.582210] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d65082c9-0b60-42be-a86a-b728b05e4ca4" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 665.582503] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d65082c9-0b60-42be-a86a-b728b05e4ca4" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 665.582587] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d65082c9-0b60-42be-a86a-b728b05e4ca4',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 665.583627] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock member-d65082c9-0b60-42be-a86a-b728b05e4ca4 taken with stack trace [, , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 665.583789] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d65082c9-0b60-42be-a86a-b728b05e4ca4" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 665.583847] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d65082c9-0b60-42be-a86a-b728b05e4ca4" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 665.583993] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d65082c9-0b60-42be-a86a-b728b05e4ca4" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 665.584166] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 665.584264] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 665.584344] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 665.585092] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 665.585092] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 665.585092] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d65082c9-0b60-42be-a86a-b728b05e4ca4',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 665.585657] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock port-87900514-1a39-469f-97a9-36a044fcbbd6 taken with stack trace [, , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 665.588829] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-87900514-1a39-469f-97a9-36a044fcbbd6" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 665.588964] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-87900514-1a39-469f-97a9-36a044fcbbd6" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 665.589082] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-87900514-1a39-469f-97a9-36a044fcbbd6" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 665.589161] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('87900514-1a39-469f-97a9-36a044fcbbd6',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 665.813023] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 979fd688-2b85-4539-a09f-586e2d99fc25 [ 665.813023] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 665.813023] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 665.813023] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 665.813023] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 665.813023] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 665.813573] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:979fd688-2b85-4539-a09f-586e2d99fc25 already deleted. [ 665.813573] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-979fd688-2b85-4539-a09f-586e2d99fc25" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 665.863528] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock member-e4c5be7e-6c74-44a0-bf7b-9581ec4636c2 taken with stack trace [, , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 665.863772] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e4c5be7e-6c74-44a0-bf7b-9581ec4636c2" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 665.863772] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e4c5be7e-6c74-44a0-bf7b-9581ec4636c2" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 665.864687] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e4c5be7e-6c74-44a0-bf7b-9581ec4636c2" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 665.864687] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 665.864687] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 665.864687] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 665.864687] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 665.864687] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 665.864687] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e4c5be7e-6c74-44a0-bf7b-9581ec4636c2" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 665.865161] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock member-e4c5be7e-6c74-44a0-bf7b-9581ec4636c2 taken with stack trace [, , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 665.865161] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e4c5be7e-6c74-44a0-bf7b-9581ec4636c2" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 665.865161] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e4c5be7e-6c74-44a0-bf7b-9581ec4636c2" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 665.865161] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e4c5be7e-6c74-44a0-bf7b-9581ec4636c2" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 665.865323] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 665.865381] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 665.865433] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 665.865668] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 665.865668] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 665.865836] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e4c5be7e-6c74-44a0-bf7b-9581ec4636c2" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 665.865878] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('e4c5be7e-6c74-44a0-bf7b-9581ec4636c2',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 665.915177] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port edfe3596-ee5e-431e-8e00-391424cfeca5 [ 665.915729] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 665.915729] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 665.915729] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 665.916094] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 665.916094] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 665.916201] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:edfe3596-ee5e-431e-8e00-391424cfeca5 already deleted. [ 665.916268] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-edfe3596-ee5e-431e-8e00-391424cfeca5" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 665.923028] env[65370]: INFO networking_nsxv3.common.synchronization [None req-63cf5f58-c5f7-41b5-81a3-8d0f46a76858 tempest-ServersTestManualDisk-1265226149 tempest-ServersTestManualDisk-1265226149-project-member] Enqueued Resource ID: 23979820-ccb5-4fdf-8d1a-316ad4242d32 with Priority: HIGHEST for action security_group_rules [ 665.924446] env[65370]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 23979820-ccb5-4fdf-8d1a-316ad4242d32 with Priority: HIGHEST for action security_group_rules [ 665.924985] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock rules-23979820-ccb5-4fdf-8d1a-316ad4242d32 taken with stack trace [, , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 665.925298] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-23979820-ccb5-4fdf-8d1a-316ad4242d32" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 665.925487] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-23979820-ccb5-4fdf-8d1a-316ad4242d32" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 665.927159] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-23979820-ccb5-4fdf-8d1a-316ad4242d32" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 665.927159] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('23979820-ccb5-4fdf-8d1a-316ad4242d32',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 666.091656] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock member-d65082c9-0b60-42be-a86a-b728b05e4ca4 taken with stack trace [, , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 666.091785] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d65082c9-0b60-42be-a86a-b728b05e4ca4" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 666.091986] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('d65082c9-0b60-42be-a86a-b728b05e4ca4',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 666.093856] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 87900514-1a39-469f-97a9-36a044fcbbd6 with status ACTIVE [ 666.094077] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 666.094396] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 666.094396] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 666.095448] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 666.095590] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 666.095831] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 666.102209] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 666.102209] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 666.102209] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 666.102209] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 666.102209] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 666.102209] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 666.102209] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 666.102209] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 666.102209] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 666.102209] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 87900514-1a39-469f-97a9-36a044fcbbd6 is going to be updated. [ 666.129569] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 666.129857] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 666.129857] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 666.130014] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 666.130118] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 666.130749] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-87900514-1a39-469f-97a9-36a044fcbbd6" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 666.372613] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for e4c5be7e-6c74-44a0-bf7b-9581ec4636c2: rpc.has_security_group_logging(os_id): False [ 666.394139] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 666.394139] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 666.394139] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 666.394139] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 666.394139] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 666.394139] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 666.394139] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 666.394139] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 666.394139] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 666.394139] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 666.394139] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 666.394139] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 666.394139] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 666.394139] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 666.394139] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 666.395075] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 666.395075] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 666.395075] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 666.395075] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 666.396556] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 666.396556] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e4c5be7e-6c74-44a0-bf7b-9581ec4636c2 is going to be created. [ 666.450262] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 666.450447] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 666.450499] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 666.450678] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 666.450765] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 666.450854] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 23979820-ccb5-4fdf-8d1a-316ad4242d32 already deleted. [ 666.450929] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-23979820-ccb5-4fdf-8d1a-316ad4242d32" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 666.466050] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 666.466227] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 666.466296] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 666.466547] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 666.466760] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 666.476249] env[65370]: INFO networking_nsxv3.common.synchronization [req-4ea3a961-cf25-4740-83ef-9fe8750b1ecd req-52eb2d5c-439a-4e4f-8874-df87b2b5b425 tempest-ListImageFiltersTestJSON-1988219331 tempest-ListImageFiltersTestJSON-1988219331-project-member] Enqueued Resource ID: e4c5be7e-6c74-44a0-bf7b-9581ec4636c2 with Priority: HIGHEST for action security_group_members [ 666.476944] env[65370]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e4c5be7e-6c74-44a0-bf7b-9581ec4636c2 with Priority: HIGHEST for action security_group_members [ 666.477370] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock member-e4c5be7e-6c74-44a0-bf7b-9581ec4636c2 taken with stack trace [, , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 666.477552] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e4c5be7e-6c74-44a0-bf7b-9581ec4636c2" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 666.477653] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e4c5be7e-6c74-44a0-bf7b-9581ec4636c2" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 666.477916] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e4c5be7e-6c74-44a0-bf7b-9581ec4636c2" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 666.478176] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 666.478399] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 666.478513] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 666.478827] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 666.478983] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 666.479140] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e4c5be7e-6c74-44a0-bf7b-9581ec4636c2',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 666.481227] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e4c5be7e-6c74-44a0-bf7b-9581ec4636c2 in Status: IN_PROGRESS for 2s [ 666.605939] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('d65082c9-0b60-42be-a86a-b728b05e4ca4',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 666.981121] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('e4c5be7e-6c74-44a0-bf7b-9581ec4636c2',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 667.013037] env[65370]: DEBUG networking_nsxv3.common.locking [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Lock network-449 taken with stack trace [, , , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 667.013037] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquiring lock "network-449" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 667.013226] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquired lock "network-449" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 667.013354] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquired external semaphore "network-449" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 667.013612] env[65370]: DEBUG networking_nsxv3.common.locking [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 667.013758] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquiring lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 667.013867] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquired lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 667.014148] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquired external semaphore "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 667.014223] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Releasing lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 667.014408] env[65370]: DEBUG dogpile.cache.region [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] No value present for key: 'zone-id' {{(pid=65370) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 667.014515] env[65370]: DEBUG dogpile.lock [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] NeedRegenerationException {{(pid=65370) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 667.014614] env[65370]: DEBUG dogpile.lock [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] no value, waiting for create lock {{(pid=65370) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 667.017258] env[65370]: DEBUG dogpile.lock [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] value creation lock acquired {{(pid=65370) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 667.017258] env[65370]: DEBUG dogpile.cache.region [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] No value present for key: 'zone-id' {{(pid=65370) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 667.017258] env[65370]: DEBUG dogpile.lock [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Calling creation function for not-yet-present value {{(pid=65370) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 667.017258] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 667.037845] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 667.037845] env[65370]: DEBUG dogpile.cache.region [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=65370) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 667.037845] env[65370]: DEBUG dogpile.lock [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Released creation lock {{(pid=65370) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 667.037845] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Releasing lock "network-449" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 667.038156] env[65370]: DEBUG networking_nsxv3.common.locking [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Lock port-b4d5c239-b6b8-479c-b364-ab43cf5797d5 taken with stack trace [, , , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 667.038156] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquiring lock "port-b4d5c239-b6b8-479c-b364-ab43cf5797d5" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 667.038282] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquired lock "port-b4d5c239-b6b8-479c-b364-ab43cf5797d5" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 667.038525] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquired external semaphore "port-b4d5c239-b6b8-479c-b364-ab43cf5797d5" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 667.038658] env[65370]: DEBUG networking_nsxv3.api.rpc [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b4d5c239-b6b8-479c-b364-ab43cf5797d5',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 667.107784] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 667.107948] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 667.108028] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 667.108248] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 667.108339] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 667.108437] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d65082c9-0b60-42be-a86a-b728b05e4ca4 is going to be created. [ 667.134035] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 667.134405] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 667.134405] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 667.134405] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 667.134653] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 667.146735] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d65082c9-0b60-42be-a86a-b728b05e4ca4 in Status: UNINITIALIZED for 2s [ 667.483943] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('e4c5be7e-6c74-44a0-bf7b-9581ec4636c2',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 667.542942] env[65370]: DEBUG networking_nsxv3.common.locking [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 667.542942] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquiring lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 667.543226] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquired lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 667.543596] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquired external semaphore "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 667.544481] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Releasing lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 667.544481] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Segment Port b4d5c239-b6b8-479c-b364-ab43cf5797d5 not found, creating... [ 667.544481] env[65370]: DEBUG networking_nsxv3.common.locking [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 667.544481] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquiring lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 667.544481] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquired lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 667.544818] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquired external semaphore "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 667.544976] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Releasing lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 667.545262] env[65370]: DEBUG networking_nsxv3.common.locking [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 667.546157] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquiring lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 667.546293] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquired lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 667.546530] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquired external semaphore "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 667.546666] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Releasing lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 667.546760] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Resource: SegmentPort with ID: b4d5c239-b6b8-479c-b364-ab43cf5797d5 is going to be created. [ 667.573349] env[65370]: DEBUG networking_nsxv3.common.locking [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 667.573865] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquiring lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 667.573865] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquired lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 667.575400] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquired external semaphore "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 667.575400] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Releasing lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 667.575400] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Releasing lock "port-b4d5c239-b6b8-479c-b364-ab43cf5797d5" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 667.988230] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 667.988388] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 667.988456] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 667.988666] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 667.988759] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 667.988857] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e4c5be7e-6c74-44a0-bf7b-9581ec4636c2 is going to be updated. [ 668.031529] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 668.031678] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 668.031746] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 668.031991] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 668.034556] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 668.048540] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e4c5be7e-6c74-44a0-bf7b-9581ec4636c2 in Status: IN_PROGRESS for 2s [ 668.258159] env[65370]: INFO networking_nsxv3.common.synchronization [None req-99d2db42-8dc8-4ee8-b37d-40fcf35425ef None None] Enqueued Resource ID: ae960a76-065d-41eb-a501-da84d1b8ed41 with Priority: HIGHEST for action port [ 668.258626] env[65370]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ae960a76-065d-41eb-a501-da84d1b8ed41 with Priority: HIGHEST for action port [ 668.258963] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock port-ae960a76-065d-41eb-a501-da84d1b8ed41 taken with stack trace [, , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 668.259115] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-ae960a76-065d-41eb-a501-da84d1b8ed41" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 668.259164] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-ae960a76-065d-41eb-a501-da84d1b8ed41" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 668.259413] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-ae960a76-065d-41eb-a501-da84d1b8ed41" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 668.260291] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ae960a76-065d-41eb-a501-da84d1b8ed41',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 668.327286] env[65370]: INFO networking_nsxv3.common.synchronization [req-4ea3a961-cf25-4740-83ef-9fe8750b1ecd req-b02a639e-a706-4ff5-bbe8-80de45fcabf2 service nova] Enqueued Resource ID: e4c5be7e-6c74-44a0-bf7b-9581ec4636c2 with Priority: HIGHEST for action security_group_rules [ 668.327448] env[65370]: INFO networking_nsxv3.common.synchronization [req-4ea3a961-cf25-4740-83ef-9fe8750b1ecd req-b02a639e-a706-4ff5-bbe8-80de45fcabf2 service nova] Enqueued Resource ID: e4c5be7e-6c74-44a0-bf7b-9581ec4636c2 with Priority: HIGHEST for action security_group_members [ 668.329208] env[65370]: INFO networking_nsxv3.common.synchronization [req-4ea3a961-cf25-4740-83ef-9fe8750b1ecd req-b02a639e-a706-4ff5-bbe8-80de45fcabf2 service nova] Enqueued Resource ID: b4d5c239-b6b8-479c-b364-ab43cf5797d5 with Priority: HIGHEST for action port [ 668.329868] env[65370]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e4c5be7e-6c74-44a0-bf7b-9581ec4636c2 with Priority: HIGHEST for action security_group_rules [ 668.330074] env[65370]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e4c5be7e-6c74-44a0-bf7b-9581ec4636c2 with Priority: HIGHEST for action security_group_members [ 668.330209] env[65370]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b4d5c239-b6b8-479c-b364-ab43cf5797d5 with Priority: HIGHEST for action port [ 668.330561] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e4c5be7e-6c74-44a0-bf7b-9581ec4636c2 taken with stack trace [, , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 668.330735] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e4c5be7e-6c74-44a0-bf7b-9581ec4636c2" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 668.331264] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock member-e4c5be7e-6c74-44a0-bf7b-9581ec4636c2 taken with stack trace [, , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 668.331345] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e4c5be7e-6c74-44a0-bf7b-9581ec4636c2" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 668.331575] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock port-b4d5c239-b6b8-479c-b364-ab43cf5797d5 taken with stack trace [, , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 668.331777] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b4d5c239-b6b8-479c-b364-ab43cf5797d5" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 668.331880] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b4d5c239-b6b8-479c-b364-ab43cf5797d5" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 668.332164] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b4d5c239-b6b8-479c-b364-ab43cf5797d5" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 668.332301] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b4d5c239-b6b8-479c-b364-ab43cf5797d5',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 668.493373] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e4c5be7e-6c74-44a0-bf7b-9581ec4636c2 in Status: SUCCESS [ 668.493690] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e4c5be7e-6c74-44a0-bf7b-9581ec4636c2" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 668.493809] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e4c5be7e-6c74-44a0-bf7b-9581ec4636c2" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 668.494087] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e4c5be7e-6c74-44a0-bf7b-9581ec4636c2" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 668.494188] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e4c5be7e-6c74-44a0-bf7b-9581ec4636c2',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 668.762260] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port ae960a76-065d-41eb-a501-da84d1b8ed41 [ 668.763622] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 668.763895] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 668.763979] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 668.764268] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 668.764368] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 668.764477] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:ae960a76-065d-41eb-a501-da84d1b8ed41 already deleted. [ 668.764593] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-ae960a76-065d-41eb-a501-da84d1b8ed41" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 668.835428] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port b4d5c239-b6b8-479c-b364-ab43cf5797d5 with status ACTIVE [ 668.835428] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 668.835716] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 668.835716] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 668.836182] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 668.836182] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 668.836295] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 668.836488] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 668.836488] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 668.839160] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 668.839160] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 668.839160] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 668.839160] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 668.839160] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 668.839160] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 668.839160] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 668.839160] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: b4d5c239-b6b8-479c-b364-ab43cf5797d5 is going to be updated. [ 668.862455] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 668.862649] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 668.862817] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 668.862915] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 668.863138] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 668.863238] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b4d5c239-b6b8-479c-b364-ab43cf5797d5" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 668.996406] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock member-e4c5be7e-6c74-44a0-bf7b-9581ec4636c2 taken with stack trace [, , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 668.996591] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e4c5be7e-6c74-44a0-bf7b-9581ec4636c2" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 669.158363] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d65082c9-0b60-42be-a86a-b728b05e4ca4 in Status: SUCCESS [ 669.158363] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d65082c9-0b60-42be-a86a-b728b05e4ca4" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 669.158363] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d65082c9-0b60-42be-a86a-b728b05e4ca4" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 669.158363] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d65082c9-0b60-42be-a86a-b728b05e4ca4" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 669.158363] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 669.158668] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 669.158668] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 669.158782] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 669.158782] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 669.158894] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d65082c9-0b60-42be-a86a-b728b05e4ca4" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 669.158999] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('d65082c9-0b60-42be-a86a-b728b05e4ca4',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 669.663330] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock member-d65082c9-0b60-42be-a86a-b728b05e4ca4 taken with stack trace [, , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 669.663646] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d65082c9-0b60-42be-a86a-b728b05e4ca4" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 669.663646] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d65082c9-0b60-42be-a86a-b728b05e4ca4" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 669.663799] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d65082c9-0b60-42be-a86a-b728b05e4ca4" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 669.663984] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 669.665666] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 669.665666] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 669.665666] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 669.665666] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 669.665666] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d65082c9-0b60-42be-a86a-b728b05e4ca4" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 669.665666] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock member-d65082c9-0b60-42be-a86a-b728b05e4ca4 taken with stack trace [, , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 669.665666] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d65082c9-0b60-42be-a86a-b728b05e4ca4" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 669.665666] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d65082c9-0b60-42be-a86a-b728b05e4ca4" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 669.665666] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d65082c9-0b60-42be-a86a-b728b05e4ca4" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 669.665666] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 669.665666] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 669.666193] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 669.666193] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 669.666193] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 669.667339] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d65082c9-0b60-42be-a86a-b728b05e4ca4" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 669.667458] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('d65082c9-0b60-42be-a86a-b728b05e4ca4',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 670.060318] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e4c5be7e-6c74-44a0-bf7b-9581ec4636c2 in Status: SUCCESS [ 670.060664] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e4c5be7e-6c74-44a0-bf7b-9581ec4636c2" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 670.061076] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e4c5be7e-6c74-44a0-bf7b-9581ec4636c2" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 670.061416] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e4c5be7e-6c74-44a0-bf7b-9581ec4636c2" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 670.061723] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 670.061915] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 670.062035] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 670.062281] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 670.062406] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 670.062551] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e4c5be7e-6c74-44a0-bf7b-9581ec4636c2',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 670.170957] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for d65082c9-0b60-42be-a86a-b728b05e4ca4: rpc.has_security_group_logging(os_id): False [ 670.192049] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 670.192284] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 670.192284] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 670.192810] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 670.192810] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 670.192916] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 670.193188] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 670.193258] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 670.193478] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 670.193581] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 670.193888] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 670.194060] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 670.194060] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 670.194197] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 670.194281] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 670.194472] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 670.194605] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 670.194675] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 670.195153] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 670.195153] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 670.195153] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d65082c9-0b60-42be-a86a-b728b05e4ca4 is going to be created. [ 670.262508] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 670.262727] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 670.262837] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 670.263110] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 670.263345] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 670.277133] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d65082c9-0b60-42be-a86a-b728b05e4ca4 in Status: IN_PROGRESS for 2s [ 670.564393] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('e4c5be7e-6c74-44a0-bf7b-9581ec4636c2',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 671.072837] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('e4c5be7e-6c74-44a0-bf7b-9581ec4636c2',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 671.576565] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 671.576565] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 671.576565] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 671.576565] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 671.576565] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 671.576565] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e4c5be7e-6c74-44a0-bf7b-9581ec4636c2 is going to be updated. [ 671.611949] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 671.611949] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 671.611949] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 671.611949] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 671.611949] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 671.621494] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e4c5be7e-6c74-44a0-bf7b-9581ec4636c2 in Status: IN_PROGRESS for 2s [ 672.273928] env[65370]: INFO networking_nsxv3.common.synchronization [req-9e713f9c-c108-4214-9c00-310404492381 req-53656ff4-3b9f-4381-8666-4286d8291b66 tempest-SecurityGroupRulesNegativeTestJSON-410937182 tempest-SecurityGroupRulesNegativeTestJSON-410937182-project-member] Enqueued Resource ID: 52826a4a-c1e4-42a8-9a24-16cd234bb1de with Priority: HIGHEST for action security_group_rules [ 672.274892] env[65370]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 52826a4a-c1e4-42a8-9a24-16cd234bb1de with Priority: HIGHEST for action security_group_rules [ 672.275254] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock rules-52826a4a-c1e4-42a8-9a24-16cd234bb1de taken with stack trace [, , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 672.275644] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-52826a4a-c1e4-42a8-9a24-16cd234bb1de" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 672.275741] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-52826a4a-c1e4-42a8-9a24-16cd234bb1de" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 672.276098] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-52826a4a-c1e4-42a8-9a24-16cd234bb1de" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 672.276204] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('52826a4a-c1e4-42a8-9a24-16cd234bb1de',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 672.291024] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d65082c9-0b60-42be-a86a-b728b05e4ca4 in Status: SUCCESS [ 672.291269] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d65082c9-0b60-42be-a86a-b728b05e4ca4" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 672.613186] env[65370]: INFO networking_nsxv3.common.synchronization [req-d33fa3fc-db1a-4682-be4f-bb7f209bb2e6 req-a2ff6c8a-ce4d-44cc-81f7-17d411aee62c tempest-ServersAdminTestJSON-387254877 tempest-ServersAdminTestJSON-387254877-project-member] Enqueued Resource ID: feaf18c3-295c-41df-89f1-309931cdeca1 with Priority: HIGHEST for action security_group_members [ 672.613698] env[65370]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: feaf18c3-295c-41df-89f1-309931cdeca1 with Priority: HIGHEST for action security_group_members [ 672.613994] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock member-feaf18c3-295c-41df-89f1-309931cdeca1 taken with stack trace [, , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 672.614134] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-feaf18c3-295c-41df-89f1-309931cdeca1" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 672.614204] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-feaf18c3-295c-41df-89f1-309931cdeca1" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 672.614451] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-feaf18c3-295c-41df-89f1-309931cdeca1" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 672.614609] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 672.614709] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 672.614771] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 672.614960] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 672.618778] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 672.618942] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('feaf18c3-295c-41df-89f1-309931cdeca1',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 672.912144] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 672.912371] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 672.912424] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 672.913189] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 672.913189] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 672.913189] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 52826a4a-c1e4-42a8-9a24-16cd234bb1de already deleted. [ 672.913189] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-52826a4a-c1e4-42a8-9a24-16cd234bb1de" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 673.125483] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 673.125690] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 673.126821] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 673.127196] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 673.127307] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 673.127640] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 673.127812] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 673.127899] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 673.128119] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 673.128220] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 673.128321] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: feaf18c3-295c-41df-89f1-309931cdeca1 already deleted. [ 673.128674] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-feaf18c3-295c-41df-89f1-309931cdeca1" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 673.164199] env[65370]: DEBUG networking_nsxv3.common.locking [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Lock network-571 taken with stack trace [, , , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 673.164199] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquiring lock "network-571" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 673.164199] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquired lock "network-571" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 673.164199] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquired external semaphore "network-571" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 673.164199] env[65370]: DEBUG networking_nsxv3.common.locking [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 673.164199] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquiring lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 673.164199] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquired lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 673.164199] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquired external semaphore "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 673.164199] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Releasing lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 673.165017] env[65370]: DEBUG dogpile.cache.region [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] No value present for key: 'zone-id' {{(pid=65370) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 673.165346] env[65370]: DEBUG dogpile.lock [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] NeedRegenerationException {{(pid=65370) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 673.165578] env[65370]: DEBUG dogpile.lock [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] no value, waiting for create lock {{(pid=65370) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 673.165839] env[65370]: DEBUG dogpile.lock [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] value creation lock acquired {{(pid=65370) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 673.166103] env[65370]: DEBUG dogpile.cache.region [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] No value present for key: 'zone-id' {{(pid=65370) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 673.166306] env[65370]: DEBUG dogpile.lock [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Calling creation function for not-yet-present value {{(pid=65370) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 673.166651] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 673.192178] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 673.192178] env[65370]: DEBUG dogpile.cache.region [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Cache value generated in 0.024 seconds for key(s): 'zone-id' {{(pid=65370) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 673.192178] env[65370]: DEBUG dogpile.lock [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Released creation lock {{(pid=65370) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 673.192178] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Releasing lock "network-571" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 673.192178] env[65370]: DEBUG networking_nsxv3.common.locking [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Lock port-266ae5fb-70aa-44f3-b8a6-db6efa306833 taken with stack trace [, , , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 673.192178] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquiring lock "port-266ae5fb-70aa-44f3-b8a6-db6efa306833" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 673.192178] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquired lock "port-266ae5fb-70aa-44f3-b8a6-db6efa306833" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 673.192178] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquired external semaphore "port-266ae5fb-70aa-44f3-b8a6-db6efa306833" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 673.192178] env[65370]: DEBUG networking_nsxv3.api.rpc [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('266ae5fb-70aa-44f3-b8a6-db6efa306833',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 673.632624] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e4c5be7e-6c74-44a0-bf7b-9581ec4636c2 in Status: SUCCESS [ 673.632800] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e4c5be7e-6c74-44a0-bf7b-9581ec4636c2" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 673.632800] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e4c5be7e-6c74-44a0-bf7b-9581ec4636c2" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 673.633097] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e4c5be7e-6c74-44a0-bf7b-9581ec4636c2" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 673.633311] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 673.633418] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 673.633475] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 673.633658] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 673.633761] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 673.633873] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e4c5be7e-6c74-44a0-bf7b-9581ec4636c2" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 673.633964] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('e4c5be7e-6c74-44a0-bf7b-9581ec4636c2',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 673.695828] env[65370]: DEBUG networking_nsxv3.common.locking [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 673.696124] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquiring lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 673.696168] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquired lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 673.697256] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquired external semaphore "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 673.697256] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Releasing lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 673.697256] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Segment Port 266ae5fb-70aa-44f3-b8a6-db6efa306833 not found, creating... [ 673.697256] env[65370]: DEBUG networking_nsxv3.common.locking [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 673.697256] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquiring lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 673.697256] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquired lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 673.697664] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquired external semaphore "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 673.697664] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Releasing lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 673.697928] env[65370]: DEBUG networking_nsxv3.common.locking [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 673.698039] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquiring lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 673.698142] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquired lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 673.698349] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquired external semaphore "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 673.698465] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Releasing lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 673.698589] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Resource: SegmentPort with ID: 266ae5fb-70aa-44f3-b8a6-db6efa306833 is going to be created. [ 673.725422] env[65370]: DEBUG networking_nsxv3.common.locking [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 673.726392] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquiring lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 673.726392] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquired lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 673.726392] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquired external semaphore "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 673.726581] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Releasing lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 673.727576] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Releasing lock "port-266ae5fb-70aa-44f3-b8a6-db6efa306833" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 674.138051] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock member-e4c5be7e-6c74-44a0-bf7b-9581ec4636c2 taken with stack trace [, , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 674.138329] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e4c5be7e-6c74-44a0-bf7b-9581ec4636c2" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 674.138394] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e4c5be7e-6c74-44a0-bf7b-9581ec4636c2" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 674.138585] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e4c5be7e-6c74-44a0-bf7b-9581ec4636c2" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 674.138788] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 674.138908] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 674.138968] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 674.139172] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 674.139266] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 674.139355] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e4c5be7e-6c74-44a0-bf7b-9581ec4636c2" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 674.139509] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock member-e4c5be7e-6c74-44a0-bf7b-9581ec4636c2 taken with stack trace [, , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 674.139643] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e4c5be7e-6c74-44a0-bf7b-9581ec4636c2" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 674.139713] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e4c5be7e-6c74-44a0-bf7b-9581ec4636c2" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 674.139895] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e4c5be7e-6c74-44a0-bf7b-9581ec4636c2" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 674.140075] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 674.140245] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 674.140245] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 674.140390] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 674.140493] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 674.140608] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e4c5be7e-6c74-44a0-bf7b-9581ec4636c2" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 674.140709] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('e4c5be7e-6c74-44a0-bf7b-9581ec4636c2',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 674.453472] env[65370]: INFO networking_nsxv3.common.synchronization [req-d33fa3fc-db1a-4682-be4f-bb7f209bb2e6 req-7d4b5a10-9f23-486f-81b6-e03aa57dec39 service nova] Enqueued Resource ID: feaf18c3-295c-41df-89f1-309931cdeca1 with Priority: HIGHEST for action security_group_rules [ 674.453472] env[65370]: INFO networking_nsxv3.common.synchronization [req-d33fa3fc-db1a-4682-be4f-bb7f209bb2e6 req-7d4b5a10-9f23-486f-81b6-e03aa57dec39 service nova] Enqueued Resource ID: feaf18c3-295c-41df-89f1-309931cdeca1 with Priority: HIGHEST for action security_group_members [ 674.453472] env[65370]: INFO networking_nsxv3.common.synchronization [req-d33fa3fc-db1a-4682-be4f-bb7f209bb2e6 req-7d4b5a10-9f23-486f-81b6-e03aa57dec39 service nova] Enqueued Resource ID: 266ae5fb-70aa-44f3-b8a6-db6efa306833 with Priority: HIGHEST for action port [ 674.453472] env[65370]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: feaf18c3-295c-41df-89f1-309931cdeca1 with Priority: HIGHEST for action security_group_rules [ 674.453472] env[65370]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: feaf18c3-295c-41df-89f1-309931cdeca1 with Priority: HIGHEST for action security_group_members [ 674.453472] env[65370]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 266ae5fb-70aa-44f3-b8a6-db6efa306833 with Priority: HIGHEST for action port [ 674.453472] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock rules-feaf18c3-295c-41df-89f1-309931cdeca1 taken with stack trace [, , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 674.453472] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-feaf18c3-295c-41df-89f1-309931cdeca1" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 674.454210] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-feaf18c3-295c-41df-89f1-309931cdeca1" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 674.454210] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-feaf18c3-295c-41df-89f1-309931cdeca1" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 674.454210] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('feaf18c3-295c-41df-89f1-309931cdeca1',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 674.457198] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock member-feaf18c3-295c-41df-89f1-309931cdeca1 taken with stack trace [, , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 674.457198] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-feaf18c3-295c-41df-89f1-309931cdeca1" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 674.457198] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-feaf18c3-295c-41df-89f1-309931cdeca1" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 674.457198] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-feaf18c3-295c-41df-89f1-309931cdeca1" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 674.457198] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 674.457198] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 674.457198] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 674.457198] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 674.457198] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 674.457198] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('feaf18c3-295c-41df-89f1-309931cdeca1',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 674.459792] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock port-266ae5fb-70aa-44f3-b8a6-db6efa306833 taken with stack trace [, , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 674.459792] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-266ae5fb-70aa-44f3-b8a6-db6efa306833" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 674.459792] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-266ae5fb-70aa-44f3-b8a6-db6efa306833" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 674.459792] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-266ae5fb-70aa-44f3-b8a6-db6efa306833" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 674.459792] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('266ae5fb-70aa-44f3-b8a6-db6efa306833',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 674.643606] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for e4c5be7e-6c74-44a0-bf7b-9581ec4636c2: rpc.has_security_group_logging(os_id): False [ 674.666574] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 674.666837] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 674.666945] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 674.668224] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 674.668224] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 674.668435] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 674.668643] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 674.668777] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 674.669129] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 674.669317] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 674.669680] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 674.669864] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 674.669996] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 674.670281] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 674.670430] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 674.670732] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 674.670885] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 674.670982] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 674.671233] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 674.671386] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 674.671541] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e4c5be7e-6c74-44a0-bf7b-9581ec4636c2 is going to be updated. [ 674.751459] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 674.751633] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 674.751695] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 674.751907] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 674.752079] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 674.767862] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e4c5be7e-6c74-44a0-bf7b-9581ec4636c2 in Status: IN_PROGRESS for 2s [ 674.957857] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock member-feaf18c3-295c-41df-89f1-309931cdeca1 taken with stack trace [, , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 674.957857] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-feaf18c3-295c-41df-89f1-309931cdeca1" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 674.962441] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('feaf18c3-295c-41df-89f1-309931cdeca1',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 674.962441] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 266ae5fb-70aa-44f3-b8a6-db6efa306833 with status ACTIVE [ 674.962606] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 674.962696] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 674.962696] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 674.962949] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 674.963063] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 674.964935] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 674.964935] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 674.964935] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 674.964935] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 674.964935] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 674.964935] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 674.964935] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 674.964935] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 674.964935] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 674.964935] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 674.964935] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 266ae5fb-70aa-44f3-b8a6-db6efa306833 is going to be updated. [ 674.991497] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 674.991896] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 674.991896] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 674.991965] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 674.992069] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 674.992245] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-266ae5fb-70aa-44f3-b8a6-db6efa306833" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 675.326265] env[65370]: INFO networking_nsxv3.common.synchronization [req-f3f805f2-5798-458c-afe4-600faf949e26 req-53d4927d-10f1-4975-9d74-67dbd585342d tempest-ServerRescueTestJSONUnderV235-1438794252 tempest-ServerRescueTestJSONUnderV235-1438794252-project-member] Enqueued Resource ID: 5132c293-b680-4491-ba2b-122515a71eaf with Priority: HIGHEST for action security_group_members [ 675.327616] env[65370]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5132c293-b680-4491-ba2b-122515a71eaf with Priority: HIGHEST for action security_group_members [ 675.328436] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock member-5132c293-b680-4491-ba2b-122515a71eaf taken with stack trace [, , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 675.328854] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5132c293-b680-4491-ba2b-122515a71eaf" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 675.329157] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5132c293-b680-4491-ba2b-122515a71eaf" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 675.330071] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5132c293-b680-4491-ba2b-122515a71eaf" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 675.332023] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 675.332023] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 675.332023] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 675.332023] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 675.332023] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 675.332023] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5132c293-b680-4491-ba2b-122515a71eaf',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 675.467420] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('feaf18c3-295c-41df-89f1-309931cdeca1',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 675.782740] env[65370]: DEBUG networking_nsxv3.common.locking [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Lock network-454 taken with stack trace [, , , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 675.783252] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquiring lock "network-454" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 675.783252] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquired lock "network-454" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 675.783461] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquired external semaphore "network-454" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 675.783664] env[65370]: DEBUG networking_nsxv3.common.locking [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 675.783806] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquiring lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 675.783915] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquired lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 675.784126] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquired external semaphore "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 675.784261] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Releasing lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 675.785051] env[65370]: DEBUG dogpile.cache.region [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] No value present for key: 'zone-id' {{(pid=65370) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 675.785206] env[65370]: DEBUG dogpile.lock [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] NeedRegenerationException {{(pid=65370) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 675.785311] env[65370]: DEBUG dogpile.lock [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] no value, waiting for create lock {{(pid=65370) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 675.785431] env[65370]: DEBUG dogpile.lock [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] value creation lock acquired {{(pid=65370) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 675.785576] env[65370]: DEBUG dogpile.cache.region [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] No value present for key: 'zone-id' {{(pid=65370) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 675.785687] env[65370]: DEBUG dogpile.lock [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Calling creation function for not-yet-present value {{(pid=65370) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 675.785836] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 675.810936] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 675.811171] env[65370]: DEBUG dogpile.cache.region [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Cache value generated in 0.025 seconds for key(s): 'zone-id' {{(pid=65370) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 675.811333] env[65370]: DEBUG dogpile.lock [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Released creation lock {{(pid=65370) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 675.811517] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Releasing lock "network-454" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 675.811991] env[65370]: DEBUG networking_nsxv3.common.locking [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Lock port-cfc2bf8b-b1ac-4f6d-bb6f-abcee630e229 taken with stack trace [, , , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 675.812284] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquiring lock "port-cfc2bf8b-b1ac-4f6d-bb6f-abcee630e229" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 675.812442] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquired lock "port-cfc2bf8b-b1ac-4f6d-bb6f-abcee630e229" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 675.812775] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquired external semaphore "port-cfc2bf8b-b1ac-4f6d-bb6f-abcee630e229" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 675.812894] env[65370]: DEBUG networking_nsxv3.api.rpc [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('cfc2bf8b-b1ac-4f6d-bb6f-abcee630e229',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 675.838524] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 675.838693] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 675.838777] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 675.838987] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 675.839105] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 675.839306] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 675.839415] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 675.839499] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 675.839612] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 675.839679] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 675.839765] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5132c293-b680-4491-ba2b-122515a71eaf already deleted. [ 675.839842] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5132c293-b680-4491-ba2b-122515a71eaf" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 675.975604] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 675.975879] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 675.975947] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 675.976252] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 675.976353] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 675.976459] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: feaf18c3-295c-41df-89f1-309931cdeca1 is going to be created. [ 676.041097] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 676.044030] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 676.044227] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 676.044472] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 676.044647] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 676.060578] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: feaf18c3-295c-41df-89f1-309931cdeca1 in Status: UNINITIALIZED for 2s [ 676.318362] env[65370]: DEBUG networking_nsxv3.common.locking [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 676.318362] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquiring lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 676.318362] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquired lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 676.318362] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquired external semaphore "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 676.318362] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Releasing lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 676.318362] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Segment Port cfc2bf8b-b1ac-4f6d-bb6f-abcee630e229 not found, creating... [ 676.318362] env[65370]: DEBUG networking_nsxv3.common.locking [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 676.318362] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquiring lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 676.318362] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquired lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 676.318362] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquired external semaphore "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 676.318362] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Releasing lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 676.319500] env[65370]: DEBUG networking_nsxv3.common.locking [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 676.319859] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquiring lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 676.320293] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquired lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 676.320656] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquired external semaphore "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 676.320997] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Releasing lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 676.321281] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Resource: SegmentPort with ID: cfc2bf8b-b1ac-4f6d-bb6f-abcee630e229 is going to be created. [ 676.347149] env[65370]: DEBUG networking_nsxv3.common.locking [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 676.347149] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquiring lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 676.347149] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquired lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 676.347149] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquired external semaphore "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 676.347149] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Releasing lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 676.347149] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Releasing lock "port-cfc2bf8b-b1ac-4f6d-bb6f-abcee630e229" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 676.783509] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e4c5be7e-6c74-44a0-bf7b-9581ec4636c2 in Status: SUCCESS [ 676.784042] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e4c5be7e-6c74-44a0-bf7b-9581ec4636c2" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 677.082225] env[65370]: INFO networking_nsxv3.common.synchronization [req-f3f805f2-5798-458c-afe4-600faf949e26 req-efb88356-c57f-41ba-b009-37f4c155c62f service nova] Enqueued Resource ID: 5132c293-b680-4491-ba2b-122515a71eaf with Priority: HIGHEST for action security_group_rules [ 677.082402] env[65370]: INFO networking_nsxv3.common.synchronization [req-f3f805f2-5798-458c-afe4-600faf949e26 req-efb88356-c57f-41ba-b009-37f4c155c62f service nova] Enqueued Resource ID: 5132c293-b680-4491-ba2b-122515a71eaf with Priority: HIGHEST for action security_group_members [ 677.082529] env[65370]: INFO networking_nsxv3.common.synchronization [req-f3f805f2-5798-458c-afe4-600faf949e26 req-efb88356-c57f-41ba-b009-37f4c155c62f service nova] Enqueued Resource ID: cfc2bf8b-b1ac-4f6d-bb6f-abcee630e229 with Priority: HIGHEST for action port [ 677.082877] env[65370]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5132c293-b680-4491-ba2b-122515a71eaf with Priority: HIGHEST for action security_group_rules [ 677.083175] env[65370]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5132c293-b680-4491-ba2b-122515a71eaf with Priority: HIGHEST for action security_group_members [ 677.083175] env[65370]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cfc2bf8b-b1ac-4f6d-bb6f-abcee630e229 with Priority: HIGHEST for action port [ 677.083703] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock rules-5132c293-b680-4491-ba2b-122515a71eaf taken with stack trace [, , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 677.083859] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-5132c293-b680-4491-ba2b-122515a71eaf" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 677.083895] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-5132c293-b680-4491-ba2b-122515a71eaf" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 677.084212] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-5132c293-b680-4491-ba2b-122515a71eaf" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 677.084335] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('5132c293-b680-4491-ba2b-122515a71eaf',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 677.085234] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock member-5132c293-b680-4491-ba2b-122515a71eaf taken with stack trace [, , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 677.085327] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5132c293-b680-4491-ba2b-122515a71eaf" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 677.085327] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5132c293-b680-4491-ba2b-122515a71eaf" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 677.085921] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5132c293-b680-4491-ba2b-122515a71eaf" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 677.085921] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 677.085921] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 677.085921] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 677.092016] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 677.092016] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 677.092016] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5132c293-b680-4491-ba2b-122515a71eaf',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 677.092016] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock port-cfc2bf8b-b1ac-4f6d-bb6f-abcee630e229 taken with stack trace [, , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 677.092016] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-cfc2bf8b-b1ac-4f6d-bb6f-abcee630e229" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 677.092016] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-cfc2bf8b-b1ac-4f6d-bb6f-abcee630e229" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 677.092016] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-cfc2bf8b-b1ac-4f6d-bb6f-abcee630e229" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 677.092016] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('cfc2bf8b-b1ac-4f6d-bb6f-abcee630e229',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 677.280658] env[65370]: INFO networking_nsxv3.common.synchronization [req-ec1baeac-6a04-406c-a198-b4e6363b4dcf req-f96ca8c2-5680-40e0-9bb1-3a7a4aaf2f5f tempest-SecurityGroupRulesNegativeTestJSON-410937182 tempest-SecurityGroupRulesNegativeTestJSON-410937182-project-member] Enqueued Resource ID: 52826a4a-c1e4-42a8-9a24-16cd234bb1de with Priority: HIGHEST for action security_group_rules [ 677.281783] env[65370]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 52826a4a-c1e4-42a8-9a24-16cd234bb1de with Priority: HIGHEST for action security_group_rules [ 677.281783] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock rules-52826a4a-c1e4-42a8-9a24-16cd234bb1de taken with stack trace [, , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 677.281783] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-52826a4a-c1e4-42a8-9a24-16cd234bb1de" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 677.281783] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-52826a4a-c1e4-42a8-9a24-16cd234bb1de" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 677.282251] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-52826a4a-c1e4-42a8-9a24-16cd234bb1de" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 677.282339] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('52826a4a-c1e4-42a8-9a24-16cd234bb1de',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 677.595920] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock member-5132c293-b680-4491-ba2b-122515a71eaf taken with stack trace [, , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 677.595920] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5132c293-b680-4491-ba2b-122515a71eaf" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 677.595920] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('5132c293-b680-4491-ba2b-122515a71eaf',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 677.596151] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port cfc2bf8b-b1ac-4f6d-bb6f-abcee630e229 with status ACTIVE [ 677.596234] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 677.596372] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 677.596436] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 677.596663] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 677.596798] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 677.597065] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 677.597216] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 677.598024] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 677.598024] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 677.598024] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 677.598024] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 677.598970] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 677.599125] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 677.599327] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 677.599458] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 677.599587] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: cfc2bf8b-b1ac-4f6d-bb6f-abcee630e229 is going to be updated. [ 677.622397] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 677.622565] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 677.622637] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 677.622883] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 677.626054] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 677.626054] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-cfc2bf8b-b1ac-4f6d-bb6f-abcee630e229" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 677.808737] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 677.809200] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 677.809200] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 677.809200] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 677.809345] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 677.809386] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 52826a4a-c1e4-42a8-9a24-16cd234bb1de already deleted. [ 677.809454] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-52826a4a-c1e4-42a8-9a24-16cd234bb1de" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 677.851872] env[65370]: INFO networking_nsxv3.common.synchronization [req-d8782107-4e48-434d-97b8-46579aab81bd req-1573a71e-f75a-4749-9053-c3d65e5ea3aa tempest-ServerAddressesNegativeTestJSON-1684933870 tempest-ServerAddressesNegativeTestJSON-1684933870-project-member] Enqueued Resource ID: aa33d5a3-f440-4aa7-9d41-10cb85d18100 with Priority: HIGHEST for action security_group_members [ 677.852451] env[65370]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: aa33d5a3-f440-4aa7-9d41-10cb85d18100 with Priority: HIGHEST for action security_group_members [ 677.852830] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock member-aa33d5a3-f440-4aa7-9d41-10cb85d18100 taken with stack trace [, , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 677.852984] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-aa33d5a3-f440-4aa7-9d41-10cb85d18100" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 677.853665] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-aa33d5a3-f440-4aa7-9d41-10cb85d18100" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 677.853893] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-aa33d5a3-f440-4aa7-9d41-10cb85d18100" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 677.854080] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 677.854195] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 677.854291] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 677.854412] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 677.854624] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 677.854720] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('aa33d5a3-f440-4aa7-9d41-10cb85d18100',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 677.969510] env[65370]: INFO networking_nsxv3.common.synchronization [req-c5db2290-481e-48af-8ae8-38b2c546c3f7 req-2f4289cc-01db-46a2-815c-25b6343f351f tempest-DeleteServersAdminTestJSON-1719358462 tempest-DeleteServersAdminTestJSON-1719358462-project-member] Enqueued Resource ID: d1777ef4-6140-42f0-bcd4-a267f85cb990 with Priority: HIGHEST for action security_group_members [ 677.971231] env[65370]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d1777ef4-6140-42f0-bcd4-a267f85cb990 with Priority: HIGHEST for action security_group_members [ 677.971231] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock member-d1777ef4-6140-42f0-bcd4-a267f85cb990 taken with stack trace [, , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 677.971231] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d1777ef4-6140-42f0-bcd4-a267f85cb990" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 677.971231] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d1777ef4-6140-42f0-bcd4-a267f85cb990" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 677.972481] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d1777ef4-6140-42f0-bcd4-a267f85cb990" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 677.972772] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 677.973000] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 677.974997] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 677.974997] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 677.974997] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 677.974997] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d1777ef4-6140-42f0-bcd4-a267f85cb990',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 678.072359] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: feaf18c3-295c-41df-89f1-309931cdeca1 in Status: SUCCESS [ 678.072501] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-feaf18c3-295c-41df-89f1-309931cdeca1" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 678.072693] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-feaf18c3-295c-41df-89f1-309931cdeca1" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 678.073147] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-feaf18c3-295c-41df-89f1-309931cdeca1" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 678.073233] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 678.073384] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 678.074149] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 678.074901] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 678.074901] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 678.074901] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-feaf18c3-295c-41df-89f1-309931cdeca1" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 678.075220] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('feaf18c3-295c-41df-89f1-309931cdeca1',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 678.102986] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('5132c293-b680-4491-ba2b-122515a71eaf',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 678.357933] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 678.358211] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 678.358211] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 678.358317] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 678.358778] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 678.358778] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 678.358778] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 678.358778] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 678.359040] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 678.359040] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 678.359197] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: aa33d5a3-f440-4aa7-9d41-10cb85d18100 is going to be updated. [ 678.393257] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 678.393398] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 678.393496] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 678.393669] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 678.393810] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 678.403951] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: aa33d5a3-f440-4aa7-9d41-10cb85d18100 in Status: IN_PROGRESS for 2s [ 678.477345] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 678.477578] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 678.477691] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 678.477849] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 678.477940] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 678.478163] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 678.478282] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 678.478344] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 678.478517] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 678.478611] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 678.478703] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d1777ef4-6140-42f0-bcd4-a267f85cb990 is going to be updated. [ 678.513695] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 678.513695] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 678.513695] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 678.514059] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 678.514059] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 678.523711] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d1777ef4-6140-42f0-bcd4-a267f85cb990 in Status: IN_PROGRESS for 2s [ 678.580125] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock member-feaf18c3-295c-41df-89f1-309931cdeca1 taken with stack trace [, , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 678.580125] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-feaf18c3-295c-41df-89f1-309931cdeca1" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 678.580125] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-feaf18c3-295c-41df-89f1-309931cdeca1" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 678.580125] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-feaf18c3-295c-41df-89f1-309931cdeca1" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 678.580125] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 678.580125] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 678.580125] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 678.580125] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 678.580125] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 678.580125] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-feaf18c3-295c-41df-89f1-309931cdeca1" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 678.580125] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock member-feaf18c3-295c-41df-89f1-309931cdeca1 taken with stack trace [, , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 678.580125] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-feaf18c3-295c-41df-89f1-309931cdeca1" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 678.580125] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-feaf18c3-295c-41df-89f1-309931cdeca1" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 678.580125] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-feaf18c3-295c-41df-89f1-309931cdeca1" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 678.581432] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 678.581432] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 678.581432] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 678.581432] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 678.581432] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 678.581432] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-feaf18c3-295c-41df-89f1-309931cdeca1" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 678.581432] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('feaf18c3-295c-41df-89f1-309931cdeca1',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 678.604962] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 678.605193] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 678.605267] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 678.605566] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 678.605679] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 678.605826] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5132c293-b680-4491-ba2b-122515a71eaf is going to be created. [ 678.634245] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 678.634392] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 678.634464] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 678.634712] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 678.634916] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 678.647692] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5132c293-b680-4491-ba2b-122515a71eaf in Status: UNINITIALIZED for 2s [ 679.083667] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for feaf18c3-295c-41df-89f1-309931cdeca1: rpc.has_security_group_logging(os_id): False [ 679.107096] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 679.107297] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 679.107769] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 679.108023] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 679.108124] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 679.108364] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 679.108455] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 679.108513] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 679.108667] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 679.108744] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 679.108925] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 679.109061] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 679.109128] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 679.109268] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 679.109342] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 679.109592] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 679.109669] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 679.109784] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 679.109903] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 679.109903] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 679.110126] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: feaf18c3-295c-41df-89f1-309931cdeca1 is going to be created. [ 679.195926] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 679.196194] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 679.196194] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 679.196482] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 679.196986] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 679.215029] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: feaf18c3-295c-41df-89f1-309931cdeca1 in Status: IN_PROGRESS for 2s [ 679.400195] env[65370]: INFO networking_nsxv3.common.synchronization [req-22d55ee0-56c4-4de5-bfad-0f71b05f422a req-cc4ff6cd-b9be-4e6b-8639-b0c3c8844208 tempest-ImagesTestJSON-246049254 tempest-ImagesTestJSON-246049254-project-member] Enqueued Resource ID: 67f4a0c1-3a3c-4ed8-9358-3a9645aba154 with Priority: HIGHEST for action security_group_members [ 679.400698] env[65370]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 67f4a0c1-3a3c-4ed8-9358-3a9645aba154 with Priority: HIGHEST for action security_group_members [ 679.401025] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock member-67f4a0c1-3a3c-4ed8-9358-3a9645aba154 taken with stack trace [, , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 679.401250] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-67f4a0c1-3a3c-4ed8-9358-3a9645aba154" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 679.401250] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-67f4a0c1-3a3c-4ed8-9358-3a9645aba154" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 679.401420] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-67f4a0c1-3a3c-4ed8-9358-3a9645aba154" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 679.401569] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 679.401660] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 679.401717] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 679.401863] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 679.401953] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 679.402448] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('67f4a0c1-3a3c-4ed8-9358-3a9645aba154',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 679.905484] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 679.905648] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 679.905710] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 679.905932] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 679.906039] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 679.906246] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 679.906345] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 679.906406] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 679.906559] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 679.906634] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 679.906721] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 67f4a0c1-3a3c-4ed8-9358-3a9645aba154 is going to be updated. [ 679.942716] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 679.942716] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 679.942716] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 679.943137] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 679.943137] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 679.953412] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 67f4a0c1-3a3c-4ed8-9358-3a9645aba154 in Status: IN_PROGRESS for 2s [ 680.072195] env[65370]: INFO networking_nsxv3.common.synchronization [req-b26217dc-3dc1-45e5-b77b-4312354a4113 req-b6e10eff-017b-4900-a95e-683a6d7d15ed tempest-DeleteServersTestJSON-1160924027 tempest-DeleteServersTestJSON-1160924027-project-member] Enqueued Resource ID: 1eaa763e-4469-4428-92d0-ba20a6c99edc with Priority: HIGHEST for action security_group_members [ 680.072195] env[65370]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1eaa763e-4469-4428-92d0-ba20a6c99edc with Priority: HIGHEST for action security_group_members [ 680.072195] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock member-1eaa763e-4469-4428-92d0-ba20a6c99edc taken with stack trace [, , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 680.072195] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1eaa763e-4469-4428-92d0-ba20a6c99edc" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 680.072195] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1eaa763e-4469-4428-92d0-ba20a6c99edc" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 680.072195] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1eaa763e-4469-4428-92d0-ba20a6c99edc" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 680.072624] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 680.072624] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 680.072624] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 680.072898] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 680.072934] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 680.073319] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1eaa763e-4469-4428-92d0-ba20a6c99edc',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 680.416978] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: aa33d5a3-f440-4aa7-9d41-10cb85d18100 in Status: SUCCESS [ 680.417356] env[65370]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: aa33d5a3-f440-4aa7-9d41-10cb85d18100 deletion is rescheduled due to dependency. [ 680.417356] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-aa33d5a3-f440-4aa7-9d41-10cb85d18100" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 680.534760] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d1777ef4-6140-42f0-bcd4-a267f85cb990 in Status: SUCCESS [ 680.535036] env[65370]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d1777ef4-6140-42f0-bcd4-a267f85cb990 deletion is rescheduled due to dependency. [ 680.535159] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d1777ef4-6140-42f0-bcd4-a267f85cb990" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 680.572959] env[65370]: DEBUG networking_nsxv3.common.locking [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Lock network-712 taken with stack trace [, , , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 680.573283] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquiring lock "network-712" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 680.573283] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquired lock "network-712" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 680.573580] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquired external semaphore "network-712" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 680.573832] env[65370]: DEBUG networking_nsxv3.common.locking [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 680.574121] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquiring lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 680.574195] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquired lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 680.574387] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquired external semaphore "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 680.574522] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Releasing lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 680.574713] env[65370]: DEBUG dogpile.cache.region [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] No value present for key: 'zone-id' {{(pid=65370) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 680.574815] env[65370]: DEBUG dogpile.lock [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] NeedRegenerationException {{(pid=65370) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 680.574976] env[65370]: DEBUG dogpile.lock [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] no value, waiting for create lock {{(pid=65370) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 680.575091] env[65370]: DEBUG dogpile.lock [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] value creation lock acquired {{(pid=65370) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 680.575196] env[65370]: DEBUG dogpile.cache.region [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] No value present for key: 'zone-id' {{(pid=65370) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 680.575290] env[65370]: DEBUG dogpile.lock [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Calling creation function for not-yet-present value {{(pid=65370) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 680.575412] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 680.576931] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 680.577060] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 680.577130] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 680.581574] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 680.581574] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 680.581574] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 680.581574] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 680.581574] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 680.581574] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 680.581574] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 680.581574] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1eaa763e-4469-4428-92d0-ba20a6c99edc already deleted. [ 680.581574] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1eaa763e-4469-4428-92d0-ba20a6c99edc" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 680.602249] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 680.602530] env[65370]: DEBUG dogpile.cache.region [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Cache value generated in 0.027 seconds for key(s): 'zone-id' {{(pid=65370) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 680.602610] env[65370]: DEBUG dogpile.lock [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Released creation lock {{(pid=65370) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 680.602806] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Releasing lock "network-712" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 680.603179] env[65370]: DEBUG networking_nsxv3.common.locking [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Lock port-4cc2c830-af3f-47d5-a632-9d0afb2ab5b6 taken with stack trace [, , , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 680.603396] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquiring lock "port-4cc2c830-af3f-47d5-a632-9d0afb2ab5b6" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 680.603469] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquired lock "port-4cc2c830-af3f-47d5-a632-9d0afb2ab5b6" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 680.603813] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquired external semaphore "port-4cc2c830-af3f-47d5-a632-9d0afb2ab5b6" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 680.603955] env[65370]: DEBUG networking_nsxv3.api.rpc [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4cc2c830-af3f-47d5-a632-9d0afb2ab5b6',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 680.652034] env[65370]: INFO networking_nsxv3.common.synchronization [req-b3f3083b-16e0-495f-a17d-9b1712f92338 req-6b7b5730-50b8-4fd4-ac6c-dc1e4b51ffcb tempest-ServerExternalEventsTest-616744642 tempest-ServerExternalEventsTest-616744642-project-member] Enqueued Resource ID: 20ca8821-63b1-4a18-a45d-43ad145b3707 with Priority: HIGHEST for action security_group_members [ 680.652314] env[65370]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 20ca8821-63b1-4a18-a45d-43ad145b3707 with Priority: HIGHEST for action security_group_members [ 680.653223] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock member-20ca8821-63b1-4a18-a45d-43ad145b3707 taken with stack trace [, , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 680.653363] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-20ca8821-63b1-4a18-a45d-43ad145b3707" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 680.653412] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-20ca8821-63b1-4a18-a45d-43ad145b3707" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 680.653630] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-20ca8821-63b1-4a18-a45d-43ad145b3707" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 680.653795] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 680.653894] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 680.653956] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 680.654128] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 680.654217] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 680.654317] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('20ca8821-63b1-4a18-a45d-43ad145b3707',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 680.661445] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5132c293-b680-4491-ba2b-122515a71eaf in Status: SUCCESS [ 680.661834] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5132c293-b680-4491-ba2b-122515a71eaf" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 680.662356] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5132c293-b680-4491-ba2b-122515a71eaf" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 680.662605] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5132c293-b680-4491-ba2b-122515a71eaf" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 680.662760] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 680.662923] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 680.662923] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 680.663088] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 680.663176] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 680.663264] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5132c293-b680-4491-ba2b-122515a71eaf" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 680.663351] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('5132c293-b680-4491-ba2b-122515a71eaf',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 681.108427] env[65370]: DEBUG networking_nsxv3.common.locking [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 681.108669] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquiring lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 681.108789] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquired lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 681.109101] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquired external semaphore "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 681.109245] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Releasing lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 681.109395] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Segment Port 4cc2c830-af3f-47d5-a632-9d0afb2ab5b6 not found, creating... [ 681.109657] env[65370]: DEBUG networking_nsxv3.common.locking [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 681.109807] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquiring lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 681.109914] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquired lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 681.110144] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquired external semaphore "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 681.110275] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Releasing lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 681.110543] env[65370]: DEBUG networking_nsxv3.common.locking [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 681.110692] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquiring lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 681.110795] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquired lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 681.110992] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquired external semaphore "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 681.111131] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Releasing lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 681.111260] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Resource: SegmentPort with ID: 4cc2c830-af3f-47d5-a632-9d0afb2ab5b6 is going to be created. [ 681.131224] env[65370]: DEBUG networking_nsxv3.common.locking [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 681.131448] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquiring lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 681.131565] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquired lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 681.131832] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquired external semaphore "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 681.132066] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Releasing lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 681.132284] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Releasing lock "port-4cc2c830-af3f-47d5-a632-9d0afb2ab5b6" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 681.159268] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 681.159446] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 681.159496] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 681.159697] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 681.159790] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 681.159985] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 681.160101] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 681.160162] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 681.160375] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 681.160524] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 681.160563] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 20ca8821-63b1-4a18-a45d-43ad145b3707 is going to be updated. [ 681.165286] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock member-5132c293-b680-4491-ba2b-122515a71eaf taken with stack trace [, , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 681.165459] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5132c293-b680-4491-ba2b-122515a71eaf" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 681.165496] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5132c293-b680-4491-ba2b-122515a71eaf" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 681.165671] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5132c293-b680-4491-ba2b-122515a71eaf" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 681.165913] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 681.166092] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 681.166145] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 681.166319] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 681.166382] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 681.166470] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5132c293-b680-4491-ba2b-122515a71eaf" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 681.166926] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock member-5132c293-b680-4491-ba2b-122515a71eaf taken with stack trace [, , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 681.166926] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5132c293-b680-4491-ba2b-122515a71eaf" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 681.166926] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5132c293-b680-4491-ba2b-122515a71eaf" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 681.166926] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5132c293-b680-4491-ba2b-122515a71eaf" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 681.167373] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 681.167373] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 681.167373] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 681.167373] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 681.167522] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 681.167522] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5132c293-b680-4491-ba2b-122515a71eaf" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 681.167688] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('5132c293-b680-4491-ba2b-122515a71eaf',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 681.193823] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 681.193823] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 681.193823] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 681.193823] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 681.193823] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 681.204987] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 20ca8821-63b1-4a18-a45d-43ad145b3707 in Status: IN_PROGRESS for 2s [ 681.224619] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: feaf18c3-295c-41df-89f1-309931cdeca1 in Status: SUCCESS [ 681.224873] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-feaf18c3-295c-41df-89f1-309931cdeca1" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 681.670433] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 5132c293-b680-4491-ba2b-122515a71eaf: rpc.has_security_group_logging(os_id): False [ 681.694075] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 681.694263] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 681.694336] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 681.694548] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 681.694641] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 681.694918] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 681.695029] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 681.695073] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 681.695253] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 681.695338] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 681.695583] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 681.695704] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 681.695772] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 681.695969] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 681.696053] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 681.696579] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 681.696685] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 681.696787] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 681.697054] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 681.697188] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 681.697285] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 5132c293-b680-4491-ba2b-122515a71eaf is going to be created. [ 681.807248] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 681.809080] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 681.809080] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 681.809080] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 681.809080] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 681.821293] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 5132c293-b680-4491-ba2b-122515a71eaf in Status: IN_PROGRESS for 2s [ 681.935283] env[65370]: INFO networking_nsxv3.common.synchronization [req-b26217dc-3dc1-45e5-b77b-4312354a4113 req-ff890f3f-61fc-42a1-9645-88093fb2f753 service nova] Enqueued Resource ID: 1eaa763e-4469-4428-92d0-ba20a6c99edc with Priority: HIGHEST for action security_group_rules [ 681.935433] env[65370]: INFO networking_nsxv3.common.synchronization [req-b26217dc-3dc1-45e5-b77b-4312354a4113 req-ff890f3f-61fc-42a1-9645-88093fb2f753 service nova] Enqueued Resource ID: 1eaa763e-4469-4428-92d0-ba20a6c99edc with Priority: HIGHEST for action security_group_members [ 681.935566] env[65370]: INFO networking_nsxv3.common.synchronization [req-b26217dc-3dc1-45e5-b77b-4312354a4113 req-ff890f3f-61fc-42a1-9645-88093fb2f753 service nova] Enqueued Resource ID: 4cc2c830-af3f-47d5-a632-9d0afb2ab5b6 with Priority: HIGHEST for action port [ 681.937921] env[65370]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1eaa763e-4469-4428-92d0-ba20a6c99edc with Priority: HIGHEST for action security_group_rules [ 681.938167] env[65370]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1eaa763e-4469-4428-92d0-ba20a6c99edc with Priority: HIGHEST for action security_group_members [ 681.938312] env[65370]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4cc2c830-af3f-47d5-a632-9d0afb2ab5b6 with Priority: HIGHEST for action port [ 681.940157] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock rules-1eaa763e-4469-4428-92d0-ba20a6c99edc taken with stack trace [, , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 681.940250] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-1eaa763e-4469-4428-92d0-ba20a6c99edc" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 681.940313] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-1eaa763e-4469-4428-92d0-ba20a6c99edc" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 681.940605] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-1eaa763e-4469-4428-92d0-ba20a6c99edc" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 681.940693] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('1eaa763e-4469-4428-92d0-ba20a6c99edc',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 681.941950] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock member-1eaa763e-4469-4428-92d0-ba20a6c99edc taken with stack trace [, , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 681.942247] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1eaa763e-4469-4428-92d0-ba20a6c99edc" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 681.942325] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1eaa763e-4469-4428-92d0-ba20a6c99edc" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 681.942512] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1eaa763e-4469-4428-92d0-ba20a6c99edc" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 681.942669] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 681.942764] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 681.942825] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 681.943067] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 681.943175] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 681.943321] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1eaa763e-4469-4428-92d0-ba20a6c99edc',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 681.944091] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock port-4cc2c830-af3f-47d5-a632-9d0afb2ab5b6 taken with stack trace [, , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 681.944198] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-4cc2c830-af3f-47d5-a632-9d0afb2ab5b6" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 681.944262] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-4cc2c830-af3f-47d5-a632-9d0afb2ab5b6" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 681.944429] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-4cc2c830-af3f-47d5-a632-9d0afb2ab5b6" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 681.944652] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4cc2c830-af3f-47d5-a632-9d0afb2ab5b6',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 681.967608] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 67f4a0c1-3a3c-4ed8-9358-3a9645aba154 in Status: SUCCESS [ 681.967813] env[65370]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 67f4a0c1-3a3c-4ed8-9358-3a9645aba154 deletion is rescheduled due to dependency. [ 681.967924] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-67f4a0c1-3a3c-4ed8-9358-3a9645aba154" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 682.447670] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock member-1eaa763e-4469-4428-92d0-ba20a6c99edc taken with stack trace [, , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 682.448054] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1eaa763e-4469-4428-92d0-ba20a6c99edc" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 682.449055] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('1eaa763e-4469-4428-92d0-ba20a6c99edc',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 682.449451] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 4cc2c830-af3f-47d5-a632-9d0afb2ab5b6 with status ACTIVE [ 682.449862] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 682.450271] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 682.450399] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 682.450651] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 682.450775] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 682.450927] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 682.451720] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 682.451720] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 682.451912] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 682.452540] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 682.452540] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 682.452540] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 682.452540] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 682.452821] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 682.453214] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 682.453639] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 4cc2c830-af3f-47d5-a632-9d0afb2ab5b6 is going to be updated. [ 682.478521] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 682.478945] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 682.478945] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 682.478945] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 682.479121] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 682.479268] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-4cc2c830-af3f-47d5-a632-9d0afb2ab5b6" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 682.744140] env[65370]: INFO networking_nsxv3.common.synchronization [req-6c9a39d9-8c1e-4888-9d7a-d6ce5e7e17fe req-e50c5c6f-2b8c-4cb5-9521-5565c6842478 tempest-ImagesOneServerTestJSON-1198729989 tempest-ImagesOneServerTestJSON-1198729989-project-member] Enqueued Resource ID: b6c4259c-ea9b-4b2f-84b9-cbedce2ee198 with Priority: HIGHEST for action security_group_members [ 682.744140] env[65370]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b6c4259c-ea9b-4b2f-84b9-cbedce2ee198 with Priority: HIGHEST for action security_group_members [ 682.744140] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock member-b6c4259c-ea9b-4b2f-84b9-cbedce2ee198 taken with stack trace [, , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 682.744140] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b6c4259c-ea9b-4b2f-84b9-cbedce2ee198" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 682.744140] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b6c4259c-ea9b-4b2f-84b9-cbedce2ee198" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 682.744140] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b6c4259c-ea9b-4b2f-84b9-cbedce2ee198" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 682.744140] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 682.744140] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 682.744140] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 682.744140] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 682.744140] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 682.744140] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b6c4259c-ea9b-4b2f-84b9-cbedce2ee198',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 682.960086] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('1eaa763e-4469-4428-92d0-ba20a6c99edc',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 683.196887] env[65370]: DEBUG networking_nsxv3.common.locking [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Lock network-504 taken with stack trace [, , , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 683.198094] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquiring lock "network-504" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 683.198094] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquired lock "network-504" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 683.198094] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquired external semaphore "network-504" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 683.198094] env[65370]: DEBUG networking_nsxv3.common.locking [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 683.198094] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquiring lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 683.198094] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquired lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 683.198419] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquired external semaphore "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 683.198419] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Releasing lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 683.198574] env[65370]: DEBUG dogpile.cache.region [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] No value present for key: 'zone-id' {{(pid=65370) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 683.198674] env[65370]: DEBUG dogpile.lock [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] NeedRegenerationException {{(pid=65370) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 683.198754] env[65370]: DEBUG dogpile.lock [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] no value, waiting for create lock {{(pid=65370) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 683.198863] env[65370]: DEBUG dogpile.lock [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] value creation lock acquired {{(pid=65370) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 683.198965] env[65370]: DEBUG dogpile.cache.region [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] No value present for key: 'zone-id' {{(pid=65370) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 683.199070] env[65370]: DEBUG dogpile.lock [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Calling creation function for not-yet-present value {{(pid=65370) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 683.199197] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 683.214184] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 20ca8821-63b1-4a18-a45d-43ad145b3707 in Status: SUCCESS [ 683.214360] env[65370]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 20ca8821-63b1-4a18-a45d-43ad145b3707 deletion is rescheduled due to dependency. [ 683.214475] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-20ca8821-63b1-4a18-a45d-43ad145b3707" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 683.221014] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 683.221191] env[65370]: DEBUG dogpile.cache.region [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=65370) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 683.221320] env[65370]: DEBUG dogpile.lock [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Released creation lock {{(pid=65370) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 683.221490] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Releasing lock "network-504" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 683.221790] env[65370]: DEBUG networking_nsxv3.common.locking [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Lock port-da64e768-3e90-48b8-b9aa-72425045a593 taken with stack trace [, , , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 683.221984] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquiring lock "port-da64e768-3e90-48b8-b9aa-72425045a593" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 683.222113] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquired lock "port-da64e768-3e90-48b8-b9aa-72425045a593" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 683.222415] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquired external semaphore "port-da64e768-3e90-48b8-b9aa-72425045a593" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 683.222539] env[65370]: DEBUG networking_nsxv3.api.rpc [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('da64e768-3e90-48b8-b9aa-72425045a593',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 683.248577] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 683.248577] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 683.248577] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 683.248844] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 683.249048] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 683.249167] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 683.249884] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 683.250761] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 683.250761] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 683.250761] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 683.250761] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b6c4259c-ea9b-4b2f-84b9-cbedce2ee198 already deleted. [ 683.250761] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b6c4259c-ea9b-4b2f-84b9-cbedce2ee198" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 683.464020] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 683.464020] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 683.464020] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 683.464020] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 683.464020] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 683.464020] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1eaa763e-4469-4428-92d0-ba20a6c99edc is going to be created. [ 683.493276] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 683.493276] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 683.493276] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 683.493276] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 683.493584] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 683.503680] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1eaa763e-4469-4428-92d0-ba20a6c99edc in Status: UNINITIALIZED for 2s [ 683.725517] env[65370]: DEBUG networking_nsxv3.common.locking [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 683.725748] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquiring lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 683.726103] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquired lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 683.726256] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquired external semaphore "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 683.726309] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Releasing lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 683.726455] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Segment Port da64e768-3e90-48b8-b9aa-72425045a593 not found, creating... [ 683.726714] env[65370]: DEBUG networking_nsxv3.common.locking [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 683.726900] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquiring lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 683.726978] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquired lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 683.727320] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquired external semaphore "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 683.727467] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Releasing lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 683.727812] env[65370]: DEBUG networking_nsxv3.common.locking [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 683.727900] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquiring lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 683.728015] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquired lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 683.728278] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquired external semaphore "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 683.728408] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Releasing lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 683.728540] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Resource: SegmentPort with ID: da64e768-3e90-48b8-b9aa-72425045a593 is going to be created. [ 683.752979] env[65370]: DEBUG networking_nsxv3.common.locking [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 683.753455] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquiring lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 683.753455] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquired lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 683.753539] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquired external semaphore "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 683.753764] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Releasing lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 683.753985] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Releasing lock "port-da64e768-3e90-48b8-b9aa-72425045a593" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 683.843022] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 5132c293-b680-4491-ba2b-122515a71eaf in Status: SUCCESS [ 683.843022] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-5132c293-b680-4491-ba2b-122515a71eaf" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 684.454932] env[65370]: INFO networking_nsxv3.common.synchronization [req-6c9a39d9-8c1e-4888-9d7a-d6ce5e7e17fe req-95858d9f-66e1-4a6e-bc93-4ade0b9dadc5 service nova] Enqueued Resource ID: b6c4259c-ea9b-4b2f-84b9-cbedce2ee198 with Priority: HIGHEST for action security_group_rules [ 684.455142] env[65370]: INFO networking_nsxv3.common.synchronization [req-6c9a39d9-8c1e-4888-9d7a-d6ce5e7e17fe req-95858d9f-66e1-4a6e-bc93-4ade0b9dadc5 service nova] Enqueued Resource ID: b6c4259c-ea9b-4b2f-84b9-cbedce2ee198 with Priority: HIGHEST for action security_group_members [ 684.455273] env[65370]: INFO networking_nsxv3.common.synchronization [req-6c9a39d9-8c1e-4888-9d7a-d6ce5e7e17fe req-95858d9f-66e1-4a6e-bc93-4ade0b9dadc5 service nova] Enqueued Resource ID: da64e768-3e90-48b8-b9aa-72425045a593 with Priority: HIGHEST for action port [ 684.455924] env[65370]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b6c4259c-ea9b-4b2f-84b9-cbedce2ee198 with Priority: HIGHEST for action security_group_rules [ 684.456099] env[65370]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b6c4259c-ea9b-4b2f-84b9-cbedce2ee198 with Priority: HIGHEST for action security_group_members [ 684.456214] env[65370]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: da64e768-3e90-48b8-b9aa-72425045a593 with Priority: HIGHEST for action port [ 684.456571] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock rules-b6c4259c-ea9b-4b2f-84b9-cbedce2ee198 taken with stack trace [, , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 684.456695] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-b6c4259c-ea9b-4b2f-84b9-cbedce2ee198" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 684.456856] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-b6c4259c-ea9b-4b2f-84b9-cbedce2ee198" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 684.457129] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-b6c4259c-ea9b-4b2f-84b9-cbedce2ee198" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 684.457219] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('b6c4259c-ea9b-4b2f-84b9-cbedce2ee198',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 684.458224] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock member-b6c4259c-ea9b-4b2f-84b9-cbedce2ee198 taken with stack trace [, , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 684.458224] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b6c4259c-ea9b-4b2f-84b9-cbedce2ee198" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 684.458224] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b6c4259c-ea9b-4b2f-84b9-cbedce2ee198" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 684.458399] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b6c4259c-ea9b-4b2f-84b9-cbedce2ee198" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 684.458547] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 684.458642] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 684.458700] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 684.458845] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 684.458931] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 684.459033] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b6c4259c-ea9b-4b2f-84b9-cbedce2ee198',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 684.460048] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock port-da64e768-3e90-48b8-b9aa-72425045a593 taken with stack trace [, , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 684.460148] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-da64e768-3e90-48b8-b9aa-72425045a593" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 684.460217] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-da64e768-3e90-48b8-b9aa-72425045a593" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 684.460369] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-da64e768-3e90-48b8-b9aa-72425045a593" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 684.460442] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('da64e768-3e90-48b8-b9aa-72425045a593',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 684.962009] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('b6c4259c-ea9b-4b2f-84b9-cbedce2ee198',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 684.963422] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock member-b6c4259c-ea9b-4b2f-84b9-cbedce2ee198 taken with stack trace [, , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 684.963422] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b6c4259c-ea9b-4b2f-84b9-cbedce2ee198" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 684.963422] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port da64e768-3e90-48b8-b9aa-72425045a593 with status ACTIVE [ 684.963878] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 684.963878] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 684.963878] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 684.964337] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 684.964337] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 684.964337] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 684.964337] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 684.964337] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 684.964586] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 684.964586] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 684.965211] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 684.965211] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 684.965211] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 684.966126] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 684.966126] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 684.966126] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: da64e768-3e90-48b8-b9aa-72425045a593 is going to be updated. [ 684.990887] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 684.991099] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 684.991099] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 684.991257] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 684.991478] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 684.991642] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-da64e768-3e90-48b8-b9aa-72425045a593" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 685.468425] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('b6c4259c-ea9b-4b2f-84b9-cbedce2ee198',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 685.518873] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1eaa763e-4469-4428-92d0-ba20a6c99edc in Status: SUCCESS [ 685.518873] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1eaa763e-4469-4428-92d0-ba20a6c99edc" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 685.518873] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1eaa763e-4469-4428-92d0-ba20a6c99edc" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 685.518873] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1eaa763e-4469-4428-92d0-ba20a6c99edc" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 685.518873] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 685.518873] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 685.518873] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 685.518873] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 685.518873] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 685.518873] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1eaa763e-4469-4428-92d0-ba20a6c99edc" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 685.518873] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('1eaa763e-4469-4428-92d0-ba20a6c99edc',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 685.973499] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 685.973792] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 685.973792] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 685.973882] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 685.973969] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 685.974082] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b6c4259c-ea9b-4b2f-84b9-cbedce2ee198 is going to be created. [ 685.999896] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 686.000470] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 686.000470] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 686.000680] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 686.002051] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 686.012213] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b6c4259c-ea9b-4b2f-84b9-cbedce2ee198 in Status: UNINITIALIZED for 2s [ 686.020831] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock member-1eaa763e-4469-4428-92d0-ba20a6c99edc taken with stack trace [, , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 686.021025] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1eaa763e-4469-4428-92d0-ba20a6c99edc" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 686.021088] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1eaa763e-4469-4428-92d0-ba20a6c99edc" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 686.021302] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1eaa763e-4469-4428-92d0-ba20a6c99edc" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 686.021477] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 686.021592] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 686.021641] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 686.021779] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 686.021866] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 686.021952] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1eaa763e-4469-4428-92d0-ba20a6c99edc" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 686.022115] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock member-1eaa763e-4469-4428-92d0-ba20a6c99edc taken with stack trace [, , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 686.022206] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1eaa763e-4469-4428-92d0-ba20a6c99edc" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 686.022264] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1eaa763e-4469-4428-92d0-ba20a6c99edc" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 686.022404] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1eaa763e-4469-4428-92d0-ba20a6c99edc" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 686.022539] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 686.022631] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 686.022706] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 686.024755] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 686.024755] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 686.024755] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1eaa763e-4469-4428-92d0-ba20a6c99edc" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 686.024755] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('1eaa763e-4469-4428-92d0-ba20a6c99edc',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 686.190302] env[65370]: INFO networking_nsxv3.common.synchronization [None req-f28b40e0-6b86-4914-ba8d-1bec8f05d9dc None None] Enqueued Resource ID: ef2534fa-2889-4f15-a796-e18c85414f75 with Priority: HIGHEST for action port [ 686.190302] env[65370]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ef2534fa-2889-4f15-a796-e18c85414f75 with Priority: HIGHEST for action port [ 686.190302] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock port-ef2534fa-2889-4f15-a796-e18c85414f75 taken with stack trace [, , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 686.190302] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-ef2534fa-2889-4f15-a796-e18c85414f75" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 686.190875] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-ef2534fa-2889-4f15-a796-e18c85414f75" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 686.191391] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-ef2534fa-2889-4f15-a796-e18c85414f75" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 686.191690] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ef2534fa-2889-4f15-a796-e18c85414f75',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 686.324849] env[65370]: INFO networking_nsxv3.common.synchronization [req-8328e1c4-52fa-400b-a17e-d3c717be4388 req-166d5094-ae03-4169-acc4-e7e68b856891 tempest-ServersTestManualDisk-1265226149 tempest-ServersTestManualDisk-1265226149-project-member] Enqueued Resource ID: 23979820-ccb5-4fdf-8d1a-316ad4242d32 with Priority: HIGHEST for action security_group_members [ 686.325891] env[65370]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 23979820-ccb5-4fdf-8d1a-316ad4242d32 with Priority: HIGHEST for action security_group_members [ 686.325891] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock member-23979820-ccb5-4fdf-8d1a-316ad4242d32 taken with stack trace [, , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 686.327144] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-23979820-ccb5-4fdf-8d1a-316ad4242d32" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 686.327309] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-23979820-ccb5-4fdf-8d1a-316ad4242d32" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 686.330715] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-23979820-ccb5-4fdf-8d1a-316ad4242d32" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 686.330964] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 686.331078] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 686.331137] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 686.331309] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 686.331401] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 686.331661] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('23979820-ccb5-4fdf-8d1a-316ad4242d32',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 686.527306] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 1eaa763e-4469-4428-92d0-ba20a6c99edc: rpc.has_security_group_logging(os_id): False [ 686.547689] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 686.547840] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 686.547972] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 686.548425] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 686.548425] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 686.548425] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 686.548611] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 686.548611] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 686.548689] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 686.548754] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 686.548965] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 686.549685] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 686.549685] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 686.549685] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 686.549685] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 686.549685] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 686.549685] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 686.549964] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 686.549964] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 686.549964] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 686.549964] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 1eaa763e-4469-4428-92d0-ba20a6c99edc is going to be created. [ 686.606941] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 686.608025] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 686.608025] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 686.608025] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 686.608025] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 686.621900] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 1eaa763e-4469-4428-92d0-ba20a6c99edc in Status: IN_PROGRESS for 2s [ 686.695732] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port ef2534fa-2889-4f15-a796-e18c85414f75 [ 686.696320] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 686.696432] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 686.696499] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 686.696720] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 686.696903] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 686.697012] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:ef2534fa-2889-4f15-a796-e18c85414f75 already deleted. [ 686.697119] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-ef2534fa-2889-4f15-a796-e18c85414f75" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 686.834475] env[65370]: DEBUG networking_nsxv3.common.locking [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Lock network-127 taken with stack trace [, , , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 686.834699] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquiring lock "network-127" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 686.837082] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquired lock "network-127" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 686.837082] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquired external semaphore "network-127" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 686.837082] env[65370]: DEBUG networking_nsxv3.common.locking [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 686.837082] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquiring lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 686.837082] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquired lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 686.837082] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquired external semaphore "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 686.837082] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Releasing lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 686.837082] env[65370]: DEBUG dogpile.cache.region [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] No value present for key: 'zone-id' {{(pid=65370) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 686.837082] env[65370]: DEBUG dogpile.lock [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] NeedRegenerationException {{(pid=65370) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 686.837082] env[65370]: DEBUG dogpile.lock [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] no value, waiting for create lock {{(pid=65370) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 686.837082] env[65370]: DEBUG dogpile.lock [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] value creation lock acquired {{(pid=65370) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 686.837082] env[65370]: DEBUG dogpile.cache.region [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] No value present for key: 'zone-id' {{(pid=65370) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 686.837082] env[65370]: DEBUG dogpile.lock [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Calling creation function for not-yet-present value {{(pid=65370) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 686.837082] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 686.838227] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 686.838348] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 686.838410] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 686.838580] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 686.838667] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 686.838849] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 686.838945] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 686.839011] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 686.839156] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 686.839236] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 686.839320] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 23979820-ccb5-4fdf-8d1a-316ad4242d32 already deleted. [ 686.839399] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-23979820-ccb5-4fdf-8d1a-316ad4242d32" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 686.860215] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 686.860446] env[65370]: DEBUG dogpile.cache.region [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=65370) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 686.860530] env[65370]: DEBUG dogpile.lock [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Released creation lock {{(pid=65370) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 686.860678] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Releasing lock "network-127" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 686.860999] env[65370]: DEBUG networking_nsxv3.common.locking [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Lock port-871602c5-5e7c-4c10-acab-a967988c67e0 taken with stack trace [, , , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 686.861274] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquiring lock "port-871602c5-5e7c-4c10-acab-a967988c67e0" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 686.861399] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquired lock "port-871602c5-5e7c-4c10-acab-a967988c67e0" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 686.861773] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquired external semaphore "port-871602c5-5e7c-4c10-acab-a967988c67e0" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 686.861898] env[65370]: DEBUG networking_nsxv3.api.rpc [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('871602c5-5e7c-4c10-acab-a967988c67e0',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 687.364258] env[65370]: DEBUG networking_nsxv3.common.locking [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 687.364570] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquiring lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 687.364632] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquired lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 687.365030] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquired external semaphore "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 687.365282] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Releasing lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 687.365537] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Segment Port 871602c5-5e7c-4c10-acab-a967988c67e0 not found, creating... [ 687.366113] env[65370]: DEBUG networking_nsxv3.common.locking [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 687.366113] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquiring lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 687.366113] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquired lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 687.366473] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquired external semaphore "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 687.366559] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Releasing lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 687.367246] env[65370]: DEBUG networking_nsxv3.common.locking [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 687.367246] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquiring lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 687.367246] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquired lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 687.368067] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquired external semaphore "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 687.368067] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Releasing lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 687.368067] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Resource: SegmentPort with ID: 871602c5-5e7c-4c10-acab-a967988c67e0 is going to be created. [ 687.387187] env[65370]: DEBUG networking_nsxv3.common.locking [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 687.387428] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquiring lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 687.387504] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquired lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 687.387762] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquired external semaphore "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 687.387971] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Releasing lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 687.388200] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Releasing lock "port-871602c5-5e7c-4c10-acab-a967988c67e0" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 688.027233] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b6c4259c-ea9b-4b2f-84b9-cbedce2ee198 in Status: SUCCESS [ 688.027474] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b6c4259c-ea9b-4b2f-84b9-cbedce2ee198" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 688.027637] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b6c4259c-ea9b-4b2f-84b9-cbedce2ee198" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 688.027960] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b6c4259c-ea9b-4b2f-84b9-cbedce2ee198" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 688.028210] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 688.028368] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 688.028443] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 688.028663] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 688.028753] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 688.028862] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b6c4259c-ea9b-4b2f-84b9-cbedce2ee198" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 688.028997] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('b6c4259c-ea9b-4b2f-84b9-cbedce2ee198',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 688.137751] env[65370]: INFO networking_nsxv3.common.synchronization [req-8328e1c4-52fa-400b-a17e-d3c717be4388 req-f057baaf-dfc4-4e7c-b3d9-a8c6c77eb898 service nova] Enqueued Resource ID: 23979820-ccb5-4fdf-8d1a-316ad4242d32 with Priority: HIGHEST for action security_group_rules [ 688.137994] env[65370]: INFO networking_nsxv3.common.synchronization [req-8328e1c4-52fa-400b-a17e-d3c717be4388 req-f057baaf-dfc4-4e7c-b3d9-a8c6c77eb898 service nova] Enqueued Resource ID: 23979820-ccb5-4fdf-8d1a-316ad4242d32 with Priority: HIGHEST for action security_group_members [ 688.138076] env[65370]: INFO networking_nsxv3.common.synchronization [req-8328e1c4-52fa-400b-a17e-d3c717be4388 req-f057baaf-dfc4-4e7c-b3d9-a8c6c77eb898 service nova] Enqueued Resource ID: 871602c5-5e7c-4c10-acab-a967988c67e0 with Priority: HIGHEST for action port [ 688.138555] env[65370]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 23979820-ccb5-4fdf-8d1a-316ad4242d32 with Priority: HIGHEST for action security_group_rules [ 688.138685] env[65370]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 23979820-ccb5-4fdf-8d1a-316ad4242d32 with Priority: HIGHEST for action security_group_members [ 688.138781] env[65370]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 871602c5-5e7c-4c10-acab-a967988c67e0 with Priority: HIGHEST for action port [ 688.139575] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock rules-23979820-ccb5-4fdf-8d1a-316ad4242d32 taken with stack trace [, , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 688.139575] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-23979820-ccb5-4fdf-8d1a-316ad4242d32" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 688.139724] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-23979820-ccb5-4fdf-8d1a-316ad4242d32" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 688.139955] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-23979820-ccb5-4fdf-8d1a-316ad4242d32" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 688.140088] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('23979820-ccb5-4fdf-8d1a-316ad4242d32',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 688.140947] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock member-23979820-ccb5-4fdf-8d1a-316ad4242d32 taken with stack trace [, , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 688.141071] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-23979820-ccb5-4fdf-8d1a-316ad4242d32" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 688.141137] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-23979820-ccb5-4fdf-8d1a-316ad4242d32" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 688.141327] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-23979820-ccb5-4fdf-8d1a-316ad4242d32" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 688.141446] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 688.141538] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 688.141596] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 688.142420] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 688.142420] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 688.142420] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('23979820-ccb5-4fdf-8d1a-316ad4242d32',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 688.143327] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock port-871602c5-5e7c-4c10-acab-a967988c67e0 taken with stack trace [, , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 688.143327] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-871602c5-5e7c-4c10-acab-a967988c67e0" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 688.143327] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-871602c5-5e7c-4c10-acab-a967988c67e0" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 688.144169] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-871602c5-5e7c-4c10-acab-a967988c67e0" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 688.144314] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('871602c5-5e7c-4c10-acab-a967988c67e0',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 688.531607] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock member-b6c4259c-ea9b-4b2f-84b9-cbedce2ee198 taken with stack trace [, , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 688.531904] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b6c4259c-ea9b-4b2f-84b9-cbedce2ee198" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 688.531904] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b6c4259c-ea9b-4b2f-84b9-cbedce2ee198" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 688.532184] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b6c4259c-ea9b-4b2f-84b9-cbedce2ee198" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 688.532226] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 688.532350] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 688.532413] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 688.532507] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 688.532595] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 688.532683] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b6c4259c-ea9b-4b2f-84b9-cbedce2ee198" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 688.532829] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock member-b6c4259c-ea9b-4b2f-84b9-cbedce2ee198 taken with stack trace [, , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 688.532934] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b6c4259c-ea9b-4b2f-84b9-cbedce2ee198" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 688.532992] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b6c4259c-ea9b-4b2f-84b9-cbedce2ee198" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 688.533239] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b6c4259c-ea9b-4b2f-84b9-cbedce2ee198" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 688.533239] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 688.533568] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 688.533568] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 688.533568] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 688.533568] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 688.533836] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b6c4259c-ea9b-4b2f-84b9-cbedce2ee198" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 688.533836] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('b6c4259c-ea9b-4b2f-84b9-cbedce2ee198',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 688.635026] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 1eaa763e-4469-4428-92d0-ba20a6c99edc in Status: SUCCESS [ 688.635253] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-1eaa763e-4469-4428-92d0-ba20a6c99edc" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 688.645919] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock member-23979820-ccb5-4fdf-8d1a-316ad4242d32 taken with stack trace [, , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 688.646096] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-23979820-ccb5-4fdf-8d1a-316ad4242d32" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 688.646259] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('23979820-ccb5-4fdf-8d1a-316ad4242d32',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 688.649049] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 871602c5-5e7c-4c10-acab-a967988c67e0 with status ACTIVE [ 688.649314] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 688.649495] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 688.649592] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 688.649930] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 688.649999] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 688.650203] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 688.650308] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 688.650370] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 688.653806] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 688.653806] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 688.653806] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 688.653806] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 688.653806] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 688.653806] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 688.653806] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 688.653806] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 871602c5-5e7c-4c10-acab-a967988c67e0 is going to be updated. [ 688.674139] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 688.674329] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 688.674385] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 688.674550] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 688.674683] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 688.674892] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-871602c5-5e7c-4c10-acab-a967988c67e0" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 688.692675] env[65370]: INFO networking_nsxv3.common.synchronization [req-7665e115-f95f-4bba-b22d-2d76f0849692 req-21d0fd1e-cb17-467d-aade-d1d3a0a82d99 tempest-ServersAdminTestJSON-387254877 tempest-ServersAdminTestJSON-387254877-project-member] Enqueued Resource ID: feaf18c3-295c-41df-89f1-309931cdeca1 with Priority: HIGHEST for action security_group_members [ 688.693472] env[65370]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: feaf18c3-295c-41df-89f1-309931cdeca1 with Priority: HIGHEST for action security_group_members [ 688.693760] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock member-feaf18c3-295c-41df-89f1-309931cdeca1 taken with stack trace [, , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 688.693886] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-feaf18c3-295c-41df-89f1-309931cdeca1" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 688.693955] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-feaf18c3-295c-41df-89f1-309931cdeca1" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 688.694583] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-feaf18c3-295c-41df-89f1-309931cdeca1" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 688.694852] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 688.694974] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 688.695057] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 688.695533] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 688.695533] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 688.695533] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('feaf18c3-295c-41df-89f1-309931cdeca1',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 688.763597] env[65370]: INFO networking_nsxv3.common.synchronization [None req-8b991600-1a47-4fb1-ad0a-2634cdd86359 None None] Enqueued Resource ID: d653784b-6c30-45dd-9449-2d872283bf9b with Priority: HIGHEST for action port [ 688.763597] env[65370]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d653784b-6c30-45dd-9449-2d872283bf9b with Priority: HIGHEST for action port [ 688.763597] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock port-d653784b-6c30-45dd-9449-2d872283bf9b taken with stack trace [, , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 688.763597] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-d653784b-6c30-45dd-9449-2d872283bf9b" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 688.765009] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-d653784b-6c30-45dd-9449-2d872283bf9b" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 688.765009] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-d653784b-6c30-45dd-9449-2d872283bf9b" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 688.765009] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d653784b-6c30-45dd-9449-2d872283bf9b',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 689.036262] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for b6c4259c-ea9b-4b2f-84b9-cbedce2ee198: rpc.has_security_group_logging(os_id): False [ 689.055933] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 689.056118] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 689.056182] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 689.056395] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 689.056485] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 689.056701] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 689.056812] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 689.056874] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 689.057028] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 689.057107] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 689.057279] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 689.057370] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 689.057477] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 689.057559] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 689.057629] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 689.057799] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 689.057890] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 689.057949] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 689.058599] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 689.058705] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 689.058801] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: b6c4259c-ea9b-4b2f-84b9-cbedce2ee198 is going to be created. [ 689.116492] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 689.116715] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 689.116783] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 689.117024] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 689.117218] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 689.134418] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b6c4259c-ea9b-4b2f-84b9-cbedce2ee198 in Status: IN_PROGRESS for 2s [ 689.154873] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('23979820-ccb5-4fdf-8d1a-316ad4242d32',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 689.200125] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('feaf18c3-295c-41df-89f1-309931cdeca1',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 689.266145] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port d653784b-6c30-45dd-9449-2d872283bf9b [ 689.266253] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 689.266397] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 689.266465] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 689.266682] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 689.266772] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 689.266867] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:d653784b-6c30-45dd-9449-2d872283bf9b already deleted. [ 689.266949] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-d653784b-6c30-45dd-9449-2d872283bf9b" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 689.657801] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 689.658127] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 689.658127] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 689.658127] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 689.658247] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 689.660225] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 23979820-ccb5-4fdf-8d1a-316ad4242d32 is going to be created. [ 689.684612] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 689.684816] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 689.684816] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 689.685093] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 689.685265] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 689.697044] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 23979820-ccb5-4fdf-8d1a-316ad4242d32 in Status: UNINITIALIZED for 2s [ 689.704375] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('feaf18c3-295c-41df-89f1-309931cdeca1',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 689.911128] env[65370]: DEBUG networking_nsxv3.common.locking [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Lock network-571 taken with stack trace [, , , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 689.911384] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquiring lock "network-571" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 689.911505] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquired lock "network-571" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 689.912008] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquired external semaphore "network-571" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 689.912189] env[65370]: DEBUG networking_nsxv3.common.locking [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 689.912354] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquiring lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 689.912488] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquired lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 689.912685] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquired external semaphore "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 689.912852] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Releasing lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 689.913114] env[65370]: DEBUG dogpile.cache.region [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] No value present for key: 'zone-id' {{(pid=65370) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 689.913230] env[65370]: DEBUG dogpile.lock [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] NeedRegenerationException {{(pid=65370) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 689.913319] env[65370]: DEBUG dogpile.lock [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] no value, waiting for create lock {{(pid=65370) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 689.913418] env[65370]: DEBUG dogpile.lock [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] value creation lock acquired {{(pid=65370) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 689.913534] env[65370]: DEBUG dogpile.cache.region [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] No value present for key: 'zone-id' {{(pid=65370) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 689.913631] env[65370]: DEBUG dogpile.lock [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Calling creation function for not-yet-present value {{(pid=65370) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 689.913752] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 689.932233] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 689.932408] env[65370]: DEBUG dogpile.cache.region [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=65370) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 689.932650] env[65370]: DEBUG dogpile.lock [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Released creation lock {{(pid=65370) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 689.932763] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Releasing lock "network-571" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 689.933107] env[65370]: DEBUG networking_nsxv3.common.locking [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Lock port-576a2ed8-22a3-4a07-be9d-d22130a80258 taken with stack trace [, , , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 689.933352] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquiring lock "port-576a2ed8-22a3-4a07-be9d-d22130a80258" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 689.933513] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquired lock "port-576a2ed8-22a3-4a07-be9d-d22130a80258" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 689.934061] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquired external semaphore "port-576a2ed8-22a3-4a07-be9d-d22130a80258" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 689.934106] env[65370]: DEBUG networking_nsxv3.api.rpc [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('576a2ed8-22a3-4a07-be9d-d22130a80258',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 690.124493] env[65370]: INFO networking_nsxv3.common.synchronization [None req-6daf0f45-0e8e-420c-a956-d28231d55a27 None None] Enqueued Resource ID: 7b036406-e5a8-4b30-818a-97eaf3dec6fa with Priority: HIGHEST for action port [ 690.125223] env[65370]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7b036406-e5a8-4b30-818a-97eaf3dec6fa with Priority: HIGHEST for action port [ 690.125589] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock port-7b036406-e5a8-4b30-818a-97eaf3dec6fa taken with stack trace [, , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 690.125678] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-7b036406-e5a8-4b30-818a-97eaf3dec6fa" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 690.125733] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-7b036406-e5a8-4b30-818a-97eaf3dec6fa" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 690.126048] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-7b036406-e5a8-4b30-818a-97eaf3dec6fa" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 690.126116] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7b036406-e5a8-4b30-818a-97eaf3dec6fa',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 690.206660] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 690.206660] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 690.206660] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 690.206660] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 690.206660] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 690.206660] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: feaf18c3-295c-41df-89f1-309931cdeca1 is going to be updated. [ 690.241448] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 690.241448] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 690.241597] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 690.241701] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 690.241848] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 690.251924] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: feaf18c3-295c-41df-89f1-309931cdeca1 in Status: IN_PROGRESS for 2s [ 690.438345] env[65370]: DEBUG networking_nsxv3.common.locking [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 690.438620] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquiring lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 690.438689] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquired lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 690.439070] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquired external semaphore "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 690.439309] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Releasing lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 690.440046] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Segment Port 576a2ed8-22a3-4a07-be9d-d22130a80258 not found, creating... [ 690.440046] env[65370]: DEBUG networking_nsxv3.common.locking [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 690.440046] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquiring lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 690.440046] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquired lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 690.440307] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquired external semaphore "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 690.440455] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Releasing lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 690.440770] env[65370]: DEBUG networking_nsxv3.common.locking [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 690.440963] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquiring lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 690.441155] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquired lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 690.442055] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquired external semaphore "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 690.442055] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Releasing lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 690.442055] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Resource: SegmentPort with ID: 576a2ed8-22a3-4a07-be9d-d22130a80258 is going to be created. [ 690.472177] env[65370]: DEBUG networking_nsxv3.common.locking [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 690.473681] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquiring lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 690.473906] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquired lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 690.474266] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquired external semaphore "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 690.474490] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Releasing lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 690.474717] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Releasing lock "port-576a2ed8-22a3-4a07-be9d-d22130a80258" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 690.628805] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 7b036406-e5a8-4b30-818a-97eaf3dec6fa [ 690.629066] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 690.629213] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 690.629276] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 690.629505] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 690.629599] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 690.629699] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:7b036406-e5a8-4b30-818a-97eaf3dec6fa already deleted. [ 690.629802] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-7b036406-e5a8-4b30-818a-97eaf3dec6fa" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 691.149676] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b6c4259c-ea9b-4b2f-84b9-cbedce2ee198 in Status: SUCCESS [ 691.149676] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-b6c4259c-ea9b-4b2f-84b9-cbedce2ee198" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 691.243057] env[65370]: INFO networking_nsxv3.common.synchronization [None req-1b4f4dc6-9074-4068-a2d1-9514f3db2392 None None] Enqueued Resource ID: f242675b-064b-480e-b604-2f5e5bc13938 with Priority: HIGHEST for action port [ 691.243819] env[65370]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f242675b-064b-480e-b604-2f5e5bc13938 with Priority: HIGHEST for action port [ 691.248510] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock port-f242675b-064b-480e-b604-2f5e5bc13938 taken with stack trace [, , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 691.248510] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-f242675b-064b-480e-b604-2f5e5bc13938" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 691.248510] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-f242675b-064b-480e-b604-2f5e5bc13938" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 691.248510] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-f242675b-064b-480e-b604-2f5e5bc13938" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 691.248510] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f242675b-064b-480e-b604-2f5e5bc13938',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 691.708754] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 23979820-ccb5-4fdf-8d1a-316ad4242d32 in Status: SUCCESS [ 691.709189] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-23979820-ccb5-4fdf-8d1a-316ad4242d32" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 691.709325] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-23979820-ccb5-4fdf-8d1a-316ad4242d32" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 691.709626] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-23979820-ccb5-4fdf-8d1a-316ad4242d32" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 691.709883] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 691.710044] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 691.710096] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 691.710338] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 691.710399] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 691.710508] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-23979820-ccb5-4fdf-8d1a-316ad4242d32" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 691.710629] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('23979820-ccb5-4fdf-8d1a-316ad4242d32',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 691.750697] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port f242675b-064b-480e-b604-2f5e5bc13938 [ 691.751066] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 691.751223] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 691.751321] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 691.751516] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 691.751620] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 691.751692] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:f242675b-064b-480e-b604-2f5e5bc13938 already deleted. [ 691.751769] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-f242675b-064b-480e-b604-2f5e5bc13938" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 691.786880] env[65370]: INFO networking_nsxv3.common.synchronization [req-7665e115-f95f-4bba-b22d-2d76f0849692 req-ed164c1d-576f-4c88-b13f-914406b26438 service nova] Enqueued Resource ID: feaf18c3-295c-41df-89f1-309931cdeca1 with Priority: HIGHEST for action security_group_rules [ 691.786880] env[65370]: INFO networking_nsxv3.common.synchronization [req-7665e115-f95f-4bba-b22d-2d76f0849692 req-ed164c1d-576f-4c88-b13f-914406b26438 service nova] Enqueued Resource ID: feaf18c3-295c-41df-89f1-309931cdeca1 with Priority: HIGHEST for action security_group_members [ 691.786880] env[65370]: INFO networking_nsxv3.common.synchronization [req-7665e115-f95f-4bba-b22d-2d76f0849692 req-ed164c1d-576f-4c88-b13f-914406b26438 service nova] Enqueued Resource ID: 576a2ed8-22a3-4a07-be9d-d22130a80258 with Priority: HIGHEST for action port [ 691.786880] env[65370]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: feaf18c3-295c-41df-89f1-309931cdeca1 with Priority: HIGHEST for action security_group_rules [ 691.786880] env[65370]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: feaf18c3-295c-41df-89f1-309931cdeca1 with Priority: HIGHEST for action security_group_members [ 691.787510] env[65370]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 576a2ed8-22a3-4a07-be9d-d22130a80258 with Priority: HIGHEST for action port [ 691.792027] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock rules-feaf18c3-295c-41df-89f1-309931cdeca1 taken with stack trace [, , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 691.792201] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-feaf18c3-295c-41df-89f1-309931cdeca1" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 691.792247] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-feaf18c3-295c-41df-89f1-309931cdeca1" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 691.793216] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-feaf18c3-295c-41df-89f1-309931cdeca1" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 691.793216] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('feaf18c3-295c-41df-89f1-309931cdeca1',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 691.794258] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock member-feaf18c3-295c-41df-89f1-309931cdeca1 taken with stack trace [, , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 691.794591] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-feaf18c3-295c-41df-89f1-309931cdeca1" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 691.800729] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock port-576a2ed8-22a3-4a07-be9d-d22130a80258 taken with stack trace [, , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 691.801042] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-576a2ed8-22a3-4a07-be9d-d22130a80258" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 691.801042] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-576a2ed8-22a3-4a07-be9d-d22130a80258" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 691.801299] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-576a2ed8-22a3-4a07-be9d-d22130a80258" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 691.801371] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('576a2ed8-22a3-4a07-be9d-d22130a80258',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 692.214675] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('23979820-ccb5-4fdf-8d1a-316ad4242d32',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 692.266027] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: feaf18c3-295c-41df-89f1-309931cdeca1 in Status: SUCCESS [ 692.266027] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-feaf18c3-295c-41df-89f1-309931cdeca1" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 692.266027] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-feaf18c3-295c-41df-89f1-309931cdeca1" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 692.266027] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-feaf18c3-295c-41df-89f1-309931cdeca1" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 692.266027] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 692.266027] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 692.266027] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 692.266027] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 692.266027] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 692.266027] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('feaf18c3-295c-41df-89f1-309931cdeca1',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 692.308047] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 576a2ed8-22a3-4a07-be9d-d22130a80258 with status ACTIVE [ 692.308047] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 692.308047] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 692.308047] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 692.308047] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 692.308047] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 692.308047] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 692.308687] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 692.310149] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 692.310149] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 692.310149] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 692.310149] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 692.310366] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 692.310366] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 692.310608] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 692.310608] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 692.310681] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 576a2ed8-22a3-4a07-be9d-d22130a80258 is going to be updated. [ 692.311800] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock member-feaf18c3-295c-41df-89f1-309931cdeca1 taken with stack trace [, , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 692.311906] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-feaf18c3-295c-41df-89f1-309931cdeca1" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 692.334595] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 692.334769] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 692.334769] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 692.334996] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 692.335148] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 692.336792] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-576a2ed8-22a3-4a07-be9d-d22130a80258" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 692.719851] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 23979820-ccb5-4fdf-8d1a-316ad4242d32: rpc.has_security_group_logging(os_id): False [ 692.747023] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 692.747023] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 692.747023] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 692.747023] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 692.747023] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 692.747023] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 692.747023] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 692.747023] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 692.747023] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 692.747023] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 692.747023] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 23979820-ccb5-4fdf-8d1a-316ad4242d32 is going to be created. [ 692.769493] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('feaf18c3-295c-41df-89f1-309931cdeca1',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 692.825788] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 692.826018] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 692.826077] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 692.826282] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 692.826538] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 692.839855] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 23979820-ccb5-4fdf-8d1a-316ad4242d32 in Status: IN_PROGRESS for 2s [ 693.272544] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('feaf18c3-295c-41df-89f1-309931cdeca1',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 693.455339] env[65370]: INFO networking_nsxv3.common.synchronization [None req-aedff8bd-42da-4b75-aeb6-0b467b4383ef None None] Enqueued Resource ID: a54d9d71-d3c3-4c46-9c04-5a54f3c56f59 with Priority: HIGHEST for action port [ 693.455339] env[65370]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a54d9d71-d3c3-4c46-9c04-5a54f3c56f59 with Priority: HIGHEST for action port [ 693.455339] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock port-a54d9d71-d3c3-4c46-9c04-5a54f3c56f59 taken with stack trace [, , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 693.455339] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-a54d9d71-d3c3-4c46-9c04-5a54f3c56f59" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 693.455339] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-a54d9d71-d3c3-4c46-9c04-5a54f3c56f59" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 693.455339] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-a54d9d71-d3c3-4c46-9c04-5a54f3c56f59" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 693.455339] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a54d9d71-d3c3-4c46-9c04-5a54f3c56f59',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 693.776030] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 693.776624] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 693.778770] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 693.778770] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 693.778770] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 693.778770] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: feaf18c3-295c-41df-89f1-309931cdeca1 is going to be updated. [ 693.813265] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 693.813441] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 693.814595] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 693.814878] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 693.815105] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 693.828539] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: feaf18c3-295c-41df-89f1-309931cdeca1 in Status: IN_PROGRESS for 2s [ 693.957421] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port a54d9d71-d3c3-4c46-9c04-5a54f3c56f59 [ 693.957722] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 693.957899] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 693.958124] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 693.959206] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 693.959333] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 693.959461] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:a54d9d71-d3c3-4c46-9c04-5a54f3c56f59 already deleted. [ 693.959537] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-a54d9d71-d3c3-4c46-9c04-5a54f3c56f59" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 694.859303] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 23979820-ccb5-4fdf-8d1a-316ad4242d32 in Status: SUCCESS [ 694.859675] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-23979820-ccb5-4fdf-8d1a-316ad4242d32" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 695.847368] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: feaf18c3-295c-41df-89f1-309931cdeca1 in Status: SUCCESS [ 695.847368] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-feaf18c3-295c-41df-89f1-309931cdeca1" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 695.847368] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-feaf18c3-295c-41df-89f1-309931cdeca1" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 695.847368] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-feaf18c3-295c-41df-89f1-309931cdeca1" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 695.847368] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 695.847368] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 695.847368] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 695.847368] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 695.847368] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 695.847368] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-feaf18c3-295c-41df-89f1-309931cdeca1" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 695.847368] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('feaf18c3-295c-41df-89f1-309931cdeca1',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 695.874788] env[65370]: INFO networking_nsxv3.common.synchronization [None req-53a125da-b41f-480d-aa3c-e098207b2272 None None] Enqueued Resource ID: cf24845e-0f15-4244-853e-5fdb50fe3ea2 with Priority: HIGHEST for action port [ 695.874788] env[65370]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cf24845e-0f15-4244-853e-5fdb50fe3ea2 with Priority: HIGHEST for action port [ 695.887263] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock port-cf24845e-0f15-4244-853e-5fdb50fe3ea2 taken with stack trace [, , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 695.887263] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-cf24845e-0f15-4244-853e-5fdb50fe3ea2" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 695.887263] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-cf24845e-0f15-4244-853e-5fdb50fe3ea2" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 695.887263] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-cf24845e-0f15-4244-853e-5fdb50fe3ea2" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 695.887263] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('cf24845e-0f15-4244-853e-5fdb50fe3ea2',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 696.354451] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock member-feaf18c3-295c-41df-89f1-309931cdeca1 taken with stack trace [, , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 696.354451] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-feaf18c3-295c-41df-89f1-309931cdeca1" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 696.354451] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-feaf18c3-295c-41df-89f1-309931cdeca1" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 696.354451] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-feaf18c3-295c-41df-89f1-309931cdeca1" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 696.354451] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 696.354451] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 696.354451] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 696.354451] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 696.354451] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 696.354451] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-feaf18c3-295c-41df-89f1-309931cdeca1" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 696.354451] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock member-feaf18c3-295c-41df-89f1-309931cdeca1 taken with stack trace [, , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 696.354451] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-feaf18c3-295c-41df-89f1-309931cdeca1" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 696.354451] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-feaf18c3-295c-41df-89f1-309931cdeca1" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 696.355021] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-feaf18c3-295c-41df-89f1-309931cdeca1" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 696.355021] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 696.355021] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 696.355021] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 696.355139] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 696.355163] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 696.355301] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-feaf18c3-295c-41df-89f1-309931cdeca1" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 696.355754] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('feaf18c3-295c-41df-89f1-309931cdeca1',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 696.389748] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port cf24845e-0f15-4244-853e-5fdb50fe3ea2 [ 696.390008] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 696.390159] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 696.390225] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 696.390433] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 696.390521] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 696.390614] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:cf24845e-0f15-4244-853e-5fdb50fe3ea2 already deleted. [ 696.390692] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-cf24845e-0f15-4244-853e-5fdb50fe3ea2" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 696.859744] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for feaf18c3-295c-41df-89f1-309931cdeca1: rpc.has_security_group_logging(os_id): False [ 696.898055] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 696.898055] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 696.898055] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 696.898055] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 696.898055] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 696.898055] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 696.898055] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 696.898055] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 696.898055] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 696.898055] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 696.898055] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 696.898055] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 696.898055] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 696.898055] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 696.898902] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 696.898902] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 696.898902] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 696.898902] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 696.898902] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 696.899051] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 696.899077] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: feaf18c3-295c-41df-89f1-309931cdeca1 is going to be updated. [ 696.999323] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 696.999882] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 696.999882] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 697.000087] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 697.000417] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 697.019996] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: feaf18c3-295c-41df-89f1-309931cdeca1 in Status: IN_PROGRESS for 2s [ 697.097858] env[65370]: INFO networking_nsxv3.common.synchronization [None req-2524fdbe-c209-4785-96d1-c1f0fb9b135b None None] Enqueued Resource ID: 5a499b40-1506-40d0-a635-420524baa753 with Priority: HIGHEST for action port [ 697.101326] env[65370]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5a499b40-1506-40d0-a635-420524baa753 with Priority: HIGHEST for action port [ 697.101326] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock port-5a499b40-1506-40d0-a635-420524baa753 taken with stack trace [, , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 697.101326] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-5a499b40-1506-40d0-a635-420524baa753" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 697.101326] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-5a499b40-1506-40d0-a635-420524baa753" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 697.101326] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-5a499b40-1506-40d0-a635-420524baa753" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 697.101326] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5a499b40-1506-40d0-a635-420524baa753',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 697.604478] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 5a499b40-1506-40d0-a635-420524baa753 [ 697.604681] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 697.604827] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 697.605038] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 697.605328] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 697.605406] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 697.605458] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:5a499b40-1506-40d0-a635-420524baa753 already deleted. [ 697.605564] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-5a499b40-1506-40d0-a635-420524baa753" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 697.741062] env[65370]: INFO networking_nsxv3.common.synchronization [req-866f0f72-fa3e-40b7-9cc8-ec99b1b48ec4 req-4f944d6e-14c2-42db-b62f-9bda673f4935 tempest-SecurityGroupRulesTestJSON-1280346518 tempest-SecurityGroupRulesTestJSON-1280346518-project-member] Enqueued Resource ID: 9b0c72f1-7926-4938-a48e-a714b32f1ec0 with Priority: HIGHEST for action security_group_rules [ 697.741645] env[65370]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9b0c72f1-7926-4938-a48e-a714b32f1ec0 with Priority: HIGHEST for action security_group_rules [ 697.741990] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock rules-9b0c72f1-7926-4938-a48e-a714b32f1ec0 taken with stack trace [, , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 697.742134] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-9b0c72f1-7926-4938-a48e-a714b32f1ec0" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 697.742201] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-9b0c72f1-7926-4938-a48e-a714b32f1ec0" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 697.742557] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-9b0c72f1-7926-4938-a48e-a714b32f1ec0" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 697.742644] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('9b0c72f1-7926-4938-a48e-a714b32f1ec0',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 698.268142] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 698.271483] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 698.271483] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 698.272641] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 698.272872] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 698.273063] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 9b0c72f1-7926-4938-a48e-a714b32f1ec0 already deleted. [ 698.273200] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-9b0c72f1-7926-4938-a48e-a714b32f1ec0" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 699.040110] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: feaf18c3-295c-41df-89f1-309931cdeca1 in Status: SUCCESS [ 699.040461] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-feaf18c3-295c-41df-89f1-309931cdeca1" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 699.242550] env[65370]: INFO networking_nsxv3.common.synchronization [None req-1fb41e89-0e6b-47e7-b077-3231a61e5d65 tempest-MigrationsAdminTest-1653527346 tempest-MigrationsAdminTest-1653527346-project-member] Enqueued Resource ID: 6a1042e9-98d3-4998-87ad-75d71400b989 with Priority: HIGHEST for action security_group_rules [ 699.242550] env[65370]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6a1042e9-98d3-4998-87ad-75d71400b989 with Priority: HIGHEST for action security_group_rules [ 699.242550] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock rules-6a1042e9-98d3-4998-87ad-75d71400b989 taken with stack trace [, , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 699.242550] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-6a1042e9-98d3-4998-87ad-75d71400b989" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 699.242550] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-6a1042e9-98d3-4998-87ad-75d71400b989" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 699.243321] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-6a1042e9-98d3-4998-87ad-75d71400b989" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 699.243321] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('6a1042e9-98d3-4998-87ad-75d71400b989',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 699.294810] env[65370]: INFO networking_nsxv3.common.synchronization [None req-80acd476-36d0-4928-8e16-f1380d0892ac None None] Enqueued Resource ID: 6cac5f73-779b-4577-b614-343e30980985 with Priority: HIGHEST for action port [ 699.297466] env[65370]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6cac5f73-779b-4577-b614-343e30980985 with Priority: HIGHEST for action port [ 699.299407] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock port-6cac5f73-779b-4577-b614-343e30980985 taken with stack trace [, , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 699.299585] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-6cac5f73-779b-4577-b614-343e30980985" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 699.299657] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-6cac5f73-779b-4577-b614-343e30980985" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 699.300740] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-6cac5f73-779b-4577-b614-343e30980985" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 699.300740] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6cac5f73-779b-4577-b614-343e30980985',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 699.487893] env[65370]: INFO networking_nsxv3.common.synchronization [req-b058f004-cd66-4509-90af-5d18071c4feb req-4d3f7645-a748-4392-bd3b-8f8b45f65827 tempest-ImagesTestJSON-246049254 tempest-ImagesTestJSON-246049254-project-member] Enqueued Resource ID: 67f4a0c1-3a3c-4ed8-9358-3a9645aba154 with Priority: HIGHEST for action security_group_members [ 699.488503] env[65370]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 67f4a0c1-3a3c-4ed8-9358-3a9645aba154 with Priority: HIGHEST for action security_group_members [ 699.488808] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock member-67f4a0c1-3a3c-4ed8-9358-3a9645aba154 taken with stack trace [, , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 699.488929] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-67f4a0c1-3a3c-4ed8-9358-3a9645aba154" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 699.488996] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-67f4a0c1-3a3c-4ed8-9358-3a9645aba154" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 699.489439] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-67f4a0c1-3a3c-4ed8-9358-3a9645aba154" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 699.490266] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 699.490266] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 699.490266] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 699.490266] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 699.490266] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 699.490266] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('67f4a0c1-3a3c-4ed8-9358-3a9645aba154',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 699.527134] env[65370]: INFO networking_nsxv3.common.synchronization [None req-42f2315e-a84d-4967-ae22-dc4a9dc6fe5a None None] Enqueued Resource ID: 24300bf8-31cd-4f03-89b7-06cbd30d43e2 with Priority: HIGHEST for action port [ 699.527919] env[65370]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 24300bf8-31cd-4f03-89b7-06cbd30d43e2 with Priority: HIGHEST for action port [ 699.528200] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock port-24300bf8-31cd-4f03-89b7-06cbd30d43e2 taken with stack trace [, , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 699.528282] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-24300bf8-31cd-4f03-89b7-06cbd30d43e2" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 699.528321] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-24300bf8-31cd-4f03-89b7-06cbd30d43e2" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 699.528629] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-24300bf8-31cd-4f03-89b7-06cbd30d43e2" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 699.528629] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('24300bf8-31cd-4f03-89b7-06cbd30d43e2',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 699.555329] env[65370]: INFO networking_nsxv3.common.synchronization [req-b97280ac-4eea-43c1-a823-0cea173e092b req-c9749778-82c8-4781-9d31-719c9c8e9a64 tempest-DeleteServersTestJSON-1160924027 tempest-DeleteServersTestJSON-1160924027-project-member] Enqueued Resource ID: 1eaa763e-4469-4428-92d0-ba20a6c99edc with Priority: HIGHEST for action security_group_members [ 699.555820] env[65370]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1eaa763e-4469-4428-92d0-ba20a6c99edc with Priority: HIGHEST for action security_group_members [ 699.556950] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock member-1eaa763e-4469-4428-92d0-ba20a6c99edc taken with stack trace [, , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 699.556950] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1eaa763e-4469-4428-92d0-ba20a6c99edc" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 699.556950] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1eaa763e-4469-4428-92d0-ba20a6c99edc" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 699.556950] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1eaa763e-4469-4428-92d0-ba20a6c99edc" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 699.556950] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 699.556950] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 699.556950] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 699.556950] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 699.557748] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 699.558072] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1eaa763e-4469-4428-92d0-ba20a6c99edc',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 699.658275] env[65370]: INFO networking_nsxv3.common.synchronization [None req-a93a9010-93e7-4e54-93a9-3dab24dc8604 tempest-MigrationsAdminTest-1653527346 tempest-MigrationsAdminTest-1653527346-project-member] Enqueued Resource ID: 6a1042e9-98d3-4998-87ad-75d71400b989 with Priority: HIGHEST for action security_group_rules [ 699.659759] env[65370]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6a1042e9-98d3-4998-87ad-75d71400b989 with Priority: HIGHEST for action security_group_rules [ 699.660381] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock rules-6a1042e9-98d3-4998-87ad-75d71400b989 taken with stack trace [, , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 699.660732] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-6a1042e9-98d3-4998-87ad-75d71400b989" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 699.765599] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 699.765757] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 699.765819] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 699.766036] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 699.766401] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 699.766401] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 6a1042e9-98d3-4998-87ad-75d71400b989 already deleted. [ 699.766401] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-6a1042e9-98d3-4998-87ad-75d71400b989" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 699.766563] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-6a1042e9-98d3-4998-87ad-75d71400b989" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 699.766779] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-6a1042e9-98d3-4998-87ad-75d71400b989" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 699.766874] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('6a1042e9-98d3-4998-87ad-75d71400b989',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 699.802317] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 6cac5f73-779b-4577-b614-343e30980985 [ 699.802588] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 699.802730] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 699.802801] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 699.803099] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 699.803219] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 699.803329] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:6cac5f73-779b-4577-b614-343e30980985 already deleted. [ 699.803425] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-6cac5f73-779b-4577-b614-343e30980985" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 699.991844] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 699.992016] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 699.992085] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 699.992315] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 699.992571] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 699.992935] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 699.993165] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 699.993234] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 699.993405] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 699.993482] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 699.993572] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 67f4a0c1-3a3c-4ed8-9358-3a9645aba154 is going to be updated. [ 700.026051] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 700.026549] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 700.026549] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 700.026710] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 700.026829] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 700.030823] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 24300bf8-31cd-4f03-89b7-06cbd30d43e2 [ 700.031064] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 700.031229] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 700.031308] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 700.031505] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 700.031616] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 700.031744] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:24300bf8-31cd-4f03-89b7-06cbd30d43e2 already deleted. [ 700.031834] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-24300bf8-31cd-4f03-89b7-06cbd30d43e2" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 700.041737] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 67f4a0c1-3a3c-4ed8-9358-3a9645aba154 in Status: IN_PROGRESS for 2s [ 700.059585] env[65370]: DEBUG networking_nsxv3.common.locking [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Lock network-955 taken with stack trace [, , , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 700.059681] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquiring lock "network-955" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 700.059758] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquired lock "network-955" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 700.060089] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquired external semaphore "network-955" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 700.060311] env[65370]: DEBUG networking_nsxv3.common.locking [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 700.060461] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquiring lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 700.060744] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquired lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 700.060965] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquired external semaphore "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 700.061115] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Releasing lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 700.061342] env[65370]: DEBUG dogpile.cache.region [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] No value present for key: 'zone-id' {{(pid=65370) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 700.063047] env[65370]: DEBUG dogpile.lock [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] NeedRegenerationException {{(pid=65370) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 700.063047] env[65370]: DEBUG dogpile.lock [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] no value, waiting for create lock {{(pid=65370) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 700.063047] env[65370]: DEBUG dogpile.lock [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] value creation lock acquired {{(pid=65370) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 700.063047] env[65370]: DEBUG dogpile.cache.region [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] No value present for key: 'zone-id' {{(pid=65370) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 700.063047] env[65370]: DEBUG dogpile.lock [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Calling creation function for not-yet-present value {{(pid=65370) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 700.063047] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 700.063989] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 700.064440] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 700.064440] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 700.064608] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 700.064608] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 700.065066] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 700.065066] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 700.065066] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 700.065197] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 700.065267] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 700.065389] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1eaa763e-4469-4428-92d0-ba20a6c99edc is going to be updated. [ 700.086175] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 700.086353] env[65370]: DEBUG dogpile.cache.region [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Cache value generated in 0.024 seconds for key(s): 'zone-id' {{(pid=65370) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 700.086524] env[65370]: DEBUG dogpile.lock [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Released creation lock {{(pid=65370) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 700.086707] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Releasing lock "network-955" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 700.087038] env[65370]: DEBUG networking_nsxv3.common.locking [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Lock port-453f7f4b-4576-40bc-9025-9298774b69be taken with stack trace [, , , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 700.087351] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquiring lock "port-453f7f4b-4576-40bc-9025-9298774b69be" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 700.087351] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquired lock "port-453f7f4b-4576-40bc-9025-9298774b69be" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 700.088510] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquired external semaphore "port-453f7f4b-4576-40bc-9025-9298774b69be" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 700.088510] env[65370]: DEBUG networking_nsxv3.api.rpc [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('453f7f4b-4576-40bc-9025-9298774b69be',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 700.101717] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 700.101717] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 700.101717] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 700.101717] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 700.101717] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 700.109707] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1eaa763e-4469-4428-92d0-ba20a6c99edc in Status: IN_PROGRESS for 2s [ 700.147498] env[65370]: INFO networking_nsxv3.common.synchronization [req-3e69b055-b834-42a8-8cf0-b1df3aa0d475 req-b4acf7b4-0c1b-4520-9129-e67b8691d034 tempest-ServersWithSpecificFlavorTestJSON-1546929489 tempest-ServersWithSpecificFlavorTestJSON-1546929489-project-member] Enqueued Resource ID: b8e66f81-0f32-48b8-b81f-542b74cbecd4 with Priority: HIGHEST for action security_group_members [ 700.148812] env[65370]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b8e66f81-0f32-48b8-b81f-542b74cbecd4 with Priority: HIGHEST for action security_group_members [ 700.148812] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock member-b8e66f81-0f32-48b8-b81f-542b74cbecd4 taken with stack trace [, , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 700.148812] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b8e66f81-0f32-48b8-b81f-542b74cbecd4" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 700.148812] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b8e66f81-0f32-48b8-b81f-542b74cbecd4" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 700.148812] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b8e66f81-0f32-48b8-b81f-542b74cbecd4" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 700.148812] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 700.149218] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 700.149306] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 700.149484] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 700.149577] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 700.149674] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b8e66f81-0f32-48b8-b81f-542b74cbecd4',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 700.291686] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 700.291825] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 700.291897] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 700.292134] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 700.292221] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 700.292314] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 6a1042e9-98d3-4998-87ad-75d71400b989 already deleted. [ 700.292394] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-6a1042e9-98d3-4998-87ad-75d71400b989" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 700.590715] env[65370]: DEBUG networking_nsxv3.common.locking [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 700.591104] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquiring lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 700.591139] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquired lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 700.591452] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquired external semaphore "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 700.591634] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Releasing lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 700.591814] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Segment Port 453f7f4b-4576-40bc-9025-9298774b69be not found, creating... [ 700.594568] env[65370]: DEBUG networking_nsxv3.common.locking [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 700.594568] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquiring lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 700.594568] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquired lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 700.594568] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquired external semaphore "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 700.594568] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Releasing lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 700.594568] env[65370]: DEBUG networking_nsxv3.common.locking [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 700.594568] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquiring lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 700.594568] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquired lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 700.594568] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquired external semaphore "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 700.594568] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Releasing lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 700.595148] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Resource: SegmentPort with ID: 453f7f4b-4576-40bc-9025-9298774b69be is going to be created. [ 700.624889] env[65370]: DEBUG networking_nsxv3.common.locking [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 700.624889] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquiring lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 700.624889] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquired lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 700.625263] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquired external semaphore "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 700.625526] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Releasing lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 700.626304] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Releasing lock "port-453f7f4b-4576-40bc-9025-9298774b69be" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 700.652405] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 700.652512] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 700.652544] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 700.652749] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 700.652870] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 700.653278] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 700.653436] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 700.653542] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 700.653983] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 700.653983] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 700.653983] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b8e66f81-0f32-48b8-b81f-542b74cbecd4 is going to be updated. [ 700.705022] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 700.705022] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 700.705022] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 700.705287] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 700.705287] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 700.729447] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b8e66f81-0f32-48b8-b81f-542b74cbecd4 in Status: IN_PROGRESS for 2s [ 701.380739] env[65370]: INFO networking_nsxv3.common.synchronization [req-b058f004-cd66-4509-90af-5d18071c4feb req-c2d19cd5-498d-4062-b682-8d865b7e6829 service nova] Enqueued Resource ID: 67f4a0c1-3a3c-4ed8-9358-3a9645aba154 with Priority: HIGHEST for action security_group_rules [ 701.380853] env[65370]: INFO networking_nsxv3.common.synchronization [req-b058f004-cd66-4509-90af-5d18071c4feb req-c2d19cd5-498d-4062-b682-8d865b7e6829 service nova] Enqueued Resource ID: 67f4a0c1-3a3c-4ed8-9358-3a9645aba154 with Priority: HIGHEST for action security_group_members [ 701.380983] env[65370]: INFO networking_nsxv3.common.synchronization [req-b058f004-cd66-4509-90af-5d18071c4feb req-c2d19cd5-498d-4062-b682-8d865b7e6829 service nova] Enqueued Resource ID: 453f7f4b-4576-40bc-9025-9298774b69be with Priority: HIGHEST for action port [ 701.381540] env[65370]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 67f4a0c1-3a3c-4ed8-9358-3a9645aba154 with Priority: HIGHEST for action security_group_rules [ 701.381673] env[65370]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 67f4a0c1-3a3c-4ed8-9358-3a9645aba154 with Priority: HIGHEST for action security_group_members [ 701.381810] env[65370]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 453f7f4b-4576-40bc-9025-9298774b69be with Priority: HIGHEST for action port [ 701.384703] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock rules-67f4a0c1-3a3c-4ed8-9358-3a9645aba154 taken with stack trace [, , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 701.384919] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-67f4a0c1-3a3c-4ed8-9358-3a9645aba154" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 701.384999] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-67f4a0c1-3a3c-4ed8-9358-3a9645aba154" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 701.387637] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-67f4a0c1-3a3c-4ed8-9358-3a9645aba154" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 701.387637] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('67f4a0c1-3a3c-4ed8-9358-3a9645aba154',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 701.387637] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock member-67f4a0c1-3a3c-4ed8-9358-3a9645aba154 taken with stack trace [, , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 701.387637] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-67f4a0c1-3a3c-4ed8-9358-3a9645aba154" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 701.387637] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock port-453f7f4b-4576-40bc-9025-9298774b69be taken with stack trace [, , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 701.387637] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-453f7f4b-4576-40bc-9025-9298774b69be" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 701.387637] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-453f7f4b-4576-40bc-9025-9298774b69be" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 701.387637] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-453f7f4b-4576-40bc-9025-9298774b69be" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 701.387637] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('453f7f4b-4576-40bc-9025-9298774b69be',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 701.460778] env[65370]: INFO networking_nsxv3.common.synchronization [req-5f78ee29-da33-4177-a751-5614d5e30aaa req-c5fd3f37-33d7-4039-9c17-7625f6a3f304 tempest-InstanceActionsTestJSON-805513987 tempest-InstanceActionsTestJSON-805513987-project-member] Enqueued Resource ID: d65082c9-0b60-42be-a86a-b728b05e4ca4 with Priority: HIGHEST for action security_group_members [ 701.461308] env[65370]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d65082c9-0b60-42be-a86a-b728b05e4ca4 with Priority: HIGHEST for action security_group_members [ 701.462259] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock member-d65082c9-0b60-42be-a86a-b728b05e4ca4 taken with stack trace [, , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 701.462495] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d65082c9-0b60-42be-a86a-b728b05e4ca4" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 701.462565] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d65082c9-0b60-42be-a86a-b728b05e4ca4" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 701.462763] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d65082c9-0b60-42be-a86a-b728b05e4ca4" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 701.462927] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 701.463085] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 701.463163] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 701.463329] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 701.463420] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 701.463516] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d65082c9-0b60-42be-a86a-b728b05e4ca4',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 701.559458] env[65370]: INFO networking_nsxv3.common.synchronization [None req-a4de7103-ac38-4a16-801f-4a3c4d0ace36 None None] Enqueued Resource ID: 817616dd-3d77-4130-93d5-265aeff86035 with Priority: HIGHEST for action port [ 701.560237] env[65370]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 817616dd-3d77-4130-93d5-265aeff86035 with Priority: HIGHEST for action port [ 701.560414] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock port-817616dd-3d77-4130-93d5-265aeff86035 taken with stack trace [, , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 701.560614] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-817616dd-3d77-4130-93d5-265aeff86035" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 701.560614] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-817616dd-3d77-4130-93d5-265aeff86035" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 701.561169] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-817616dd-3d77-4130-93d5-265aeff86035" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 701.561169] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('817616dd-3d77-4130-93d5-265aeff86035',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 701.891598] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock member-67f4a0c1-3a3c-4ed8-9358-3a9645aba154 taken with stack trace [, , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 701.891931] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-67f4a0c1-3a3c-4ed8-9358-3a9645aba154" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 701.891931] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 453f7f4b-4576-40bc-9025-9298774b69be with status ACTIVE [ 701.892068] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 701.892137] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 701.892272] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 701.892405] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 701.892504] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 701.892698] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 701.892766] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 701.892827] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 701.892976] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 701.893084] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 701.893235] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 701.893325] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 701.893413] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 701.893522] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 701.893594] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 701.894117] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 453f7f4b-4576-40bc-9025-9298774b69be is going to be updated. [ 701.916100] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 701.916317] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 701.916368] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 701.916547] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 701.916683] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 701.916847] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-453f7f4b-4576-40bc-9025-9298774b69be" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 701.968506] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 701.968747] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 701.968747] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 701.969048] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 701.969200] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 701.969561] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 701.969679] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 701.969758] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 701.969921] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 701.969999] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 701.970103] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d65082c9-0b60-42be-a86a-b728b05e4ca4 is going to be updated. [ 702.009799] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 702.009944] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 702.010037] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 702.011905] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 702.011905] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 702.032046] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d65082c9-0b60-42be-a86a-b728b05e4ca4 in Status: IN_PROGRESS for 2s [ 702.053295] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 67f4a0c1-3a3c-4ed8-9358-3a9645aba154 in Status: SUCCESS [ 702.053417] env[65370]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 67f4a0c1-3a3c-4ed8-9358-3a9645aba154 deletion is rescheduled due to dependency. [ 702.053532] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-67f4a0c1-3a3c-4ed8-9358-3a9645aba154" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 702.053707] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-67f4a0c1-3a3c-4ed8-9358-3a9645aba154" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 702.053910] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-67f4a0c1-3a3c-4ed8-9358-3a9645aba154" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 702.054104] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 702.054224] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 702.054287] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 702.056941] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 702.056941] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 702.056941] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('67f4a0c1-3a3c-4ed8-9358-3a9645aba154',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 702.063225] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 817616dd-3d77-4130-93d5-265aeff86035 [ 702.063573] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 702.063573] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 702.063573] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 702.063811] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 702.064051] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 702.064051] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:817616dd-3d77-4130-93d5-265aeff86035 already deleted. [ 702.064353] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-817616dd-3d77-4130-93d5-265aeff86035" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 702.119899] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1eaa763e-4469-4428-92d0-ba20a6c99edc in Status: SUCCESS [ 702.120092] env[65370]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1eaa763e-4469-4428-92d0-ba20a6c99edc deletion is rescheduled due to dependency. [ 702.120208] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1eaa763e-4469-4428-92d0-ba20a6c99edc" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 702.558800] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('67f4a0c1-3a3c-4ed8-9358-3a9645aba154',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 702.745896] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b8e66f81-0f32-48b8-b81f-542b74cbecd4 in Status: SUCCESS [ 702.746137] env[65370]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b8e66f81-0f32-48b8-b81f-542b74cbecd4 deletion is rescheduled due to dependency. [ 702.746209] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b8e66f81-0f32-48b8-b81f-542b74cbecd4" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 703.062287] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('67f4a0c1-3a3c-4ed8-9358-3a9645aba154',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 703.565672] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 703.566242] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 703.566242] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 703.566398] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 703.566558] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 703.567117] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 67f4a0c1-3a3c-4ed8-9358-3a9645aba154 is going to be updated. [ 703.603385] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 703.603554] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 703.603660] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 703.603955] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 703.604184] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 703.618939] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 67f4a0c1-3a3c-4ed8-9358-3a9645aba154 in Status: IN_PROGRESS for 2s [ 703.755687] env[65370]: INFO networking_nsxv3.common.synchronization [None req-2383249b-445b-4d1e-b8d6-9aa20c475f12 None None] Enqueued Resource ID: 5c4abcb6-f692-460d-8096-dd1a66aa8d32 with Priority: HIGHEST for action port [ 703.759844] env[65370]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5c4abcb6-f692-460d-8096-dd1a66aa8d32 with Priority: HIGHEST for action port [ 703.760274] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock port-5c4abcb6-f692-460d-8096-dd1a66aa8d32 taken with stack trace [, , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 703.760434] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-5c4abcb6-f692-460d-8096-dd1a66aa8d32" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 703.760484] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-5c4abcb6-f692-460d-8096-dd1a66aa8d32" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 703.760746] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-5c4abcb6-f692-460d-8096-dd1a66aa8d32" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 703.761417] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5c4abcb6-f692-460d-8096-dd1a66aa8d32',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 703.943612] env[65370]: INFO networking_nsxv3.common.synchronization [req-326834c1-1cb1-4f40-86cb-c77d0739ba7e req-09f5020e-d344-427c-bded-3391e14fb5c8 tempest-ServerPasswordTestJSON-1990139002 tempest-ServerPasswordTestJSON-1990139002-project-member] Enqueued Resource ID: a316198c-c3c7-4c28-a092-301a77045bc5 with Priority: HIGHEST for action security_group_members [ 703.944201] env[65370]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a316198c-c3c7-4c28-a092-301a77045bc5 with Priority: HIGHEST for action security_group_members [ 703.944529] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock member-a316198c-c3c7-4c28-a092-301a77045bc5 taken with stack trace [, , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 703.945141] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a316198c-c3c7-4c28-a092-301a77045bc5" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 703.945256] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a316198c-c3c7-4c28-a092-301a77045bc5" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 703.945560] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a316198c-c3c7-4c28-a092-301a77045bc5" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 703.945750] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 703.945999] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 703.946114] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 703.946304] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 703.946535] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 703.946633] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a316198c-c3c7-4c28-a092-301a77045bc5',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 704.044937] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d65082c9-0b60-42be-a86a-b728b05e4ca4 in Status: SUCCESS [ 704.045198] env[65370]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d65082c9-0b60-42be-a86a-b728b05e4ca4 deletion is rescheduled due to dependency. [ 704.045380] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d65082c9-0b60-42be-a86a-b728b05e4ca4" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 704.268391] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 5c4abcb6-f692-460d-8096-dd1a66aa8d32 [ 704.268951] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 704.269109] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 704.269174] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 704.269407] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 704.269506] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 704.269643] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:5c4abcb6-f692-460d-8096-dd1a66aa8d32 already deleted. [ 704.269767] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-5c4abcb6-f692-460d-8096-dd1a66aa8d32" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 704.452122] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 704.452122] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 704.452122] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 704.452122] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 704.452122] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 704.452122] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 704.452122] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 704.452122] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 704.452122] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 704.452122] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 704.452122] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a316198c-c3c7-4c28-a092-301a77045bc5 already deleted. [ 704.452122] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a316198c-c3c7-4c28-a092-301a77045bc5" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 704.493748] env[65370]: DEBUG networking_nsxv3.common.locking [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Lock network-660 taken with stack trace [, , , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 704.493948] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquiring lock "network-660" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 704.494303] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquired lock "network-660" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 704.494669] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquired external semaphore "network-660" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 704.494830] env[65370]: DEBUG networking_nsxv3.common.locking [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 704.496110] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquiring lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 704.496314] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquired lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 704.496783] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquired external semaphore "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 704.496783] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Releasing lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 704.497704] env[65370]: DEBUG dogpile.cache.region [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] No value present for key: 'zone-id' {{(pid=65370) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 704.497741] env[65370]: DEBUG dogpile.lock [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] NeedRegenerationException {{(pid=65370) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 704.497886] env[65370]: DEBUG dogpile.lock [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] no value, waiting for create lock {{(pid=65370) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 704.498031] env[65370]: DEBUG dogpile.lock [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] value creation lock acquired {{(pid=65370) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 704.498178] env[65370]: DEBUG dogpile.cache.region [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] No value present for key: 'zone-id' {{(pid=65370) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 704.499164] env[65370]: DEBUG dogpile.lock [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Calling creation function for not-yet-present value {{(pid=65370) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 704.499164] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 704.505493] env[65370]: INFO networking_nsxv3.common.synchronization [None req-7328bdcf-a8c7-42e8-ac11-8548bb04e839 None None] Enqueued Resource ID: 39281919-b605-40e6-aa94-51921e1212c5 with Priority: HIGHEST for action port [ 704.506563] env[65370]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 39281919-b605-40e6-aa94-51921e1212c5 with Priority: HIGHEST for action port [ 704.506563] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock port-39281919-b605-40e6-aa94-51921e1212c5 taken with stack trace [, , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 704.506563] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-39281919-b605-40e6-aa94-51921e1212c5" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 704.506563] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-39281919-b605-40e6-aa94-51921e1212c5" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 704.506773] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-39281919-b605-40e6-aa94-51921e1212c5" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 704.506773] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('39281919-b605-40e6-aa94-51921e1212c5',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 704.521089] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 704.521089] env[65370]: DEBUG dogpile.cache.region [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=65370) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 704.521089] env[65370]: DEBUG dogpile.lock [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Released creation lock {{(pid=65370) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 704.521089] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Releasing lock "network-660" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 704.521373] env[65370]: DEBUG networking_nsxv3.common.locking [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Lock port-e0c80400-f1db-49f7-a83c-a76588a37a55 taken with stack trace [, , , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 704.521496] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquiring lock "port-e0c80400-f1db-49f7-a83c-a76588a37a55" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 704.521651] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquired lock "port-e0c80400-f1db-49f7-a83c-a76588a37a55" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 704.522013] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquired external semaphore "port-e0c80400-f1db-49f7-a83c-a76588a37a55" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 704.522437] env[65370]: DEBUG networking_nsxv3.api.rpc [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e0c80400-f1db-49f7-a83c-a76588a37a55',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 705.010358] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 39281919-b605-40e6-aa94-51921e1212c5 [ 705.010358] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 705.010547] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 705.010547] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 705.010730] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 705.010821] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 705.010926] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:39281919-b605-40e6-aa94-51921e1212c5 already deleted. [ 705.011025] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-39281919-b605-40e6-aa94-51921e1212c5" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 705.024890] env[65370]: DEBUG networking_nsxv3.common.locking [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 705.025224] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquiring lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 705.025382] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquired lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 705.025888] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquired external semaphore "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 705.026028] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Releasing lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 705.026309] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Segment Port e0c80400-f1db-49f7-a83c-a76588a37a55 not found, creating... [ 705.026674] env[65370]: DEBUG networking_nsxv3.common.locking [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 705.026893] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquiring lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 705.027157] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquired lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 705.027489] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquired external semaphore "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 705.027816] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Releasing lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 705.027946] env[65370]: DEBUG networking_nsxv3.common.locking [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 705.028165] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquiring lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 705.028296] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquired lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 705.028576] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquired external semaphore "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 705.028769] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Releasing lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 705.028982] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Resource: SegmentPort with ID: e0c80400-f1db-49f7-a83c-a76588a37a55 is going to be created. [ 705.055580] env[65370]: DEBUG networking_nsxv3.common.locking [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 705.056277] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquiring lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 705.056455] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquired lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 705.057036] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquired external semaphore "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 705.057036] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Releasing lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 705.057436] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Releasing lock "port-e0c80400-f1db-49f7-a83c-a76588a37a55" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 705.629522] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 67f4a0c1-3a3c-4ed8-9358-3a9645aba154 in Status: SUCCESS [ 705.629937] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-67f4a0c1-3a3c-4ed8-9358-3a9645aba154" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 705.630030] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-67f4a0c1-3a3c-4ed8-9358-3a9645aba154" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 705.630231] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-67f4a0c1-3a3c-4ed8-9358-3a9645aba154" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 705.630607] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 705.630735] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 705.630789] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 705.630956] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 705.631068] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 705.631168] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-67f4a0c1-3a3c-4ed8-9358-3a9645aba154" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 705.631275] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('67f4a0c1-3a3c-4ed8-9358-3a9645aba154',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 705.785210] env[65370]: INFO networking_nsxv3.common.synchronization [req-326834c1-1cb1-4f40-86cb-c77d0739ba7e req-cb6ea804-210b-4a16-89e3-f64e66720c89 service nova] Enqueued Resource ID: a316198c-c3c7-4c28-a092-301a77045bc5 with Priority: HIGHEST for action security_group_rules [ 705.786230] env[65370]: INFO networking_nsxv3.common.synchronization [req-326834c1-1cb1-4f40-86cb-c77d0739ba7e req-cb6ea804-210b-4a16-89e3-f64e66720c89 service nova] Enqueued Resource ID: a316198c-c3c7-4c28-a092-301a77045bc5 with Priority: HIGHEST for action security_group_members [ 705.786230] env[65370]: INFO networking_nsxv3.common.synchronization [req-326834c1-1cb1-4f40-86cb-c77d0739ba7e req-cb6ea804-210b-4a16-89e3-f64e66720c89 service nova] Enqueued Resource ID: e0c80400-f1db-49f7-a83c-a76588a37a55 with Priority: HIGHEST for action port [ 705.788384] env[65370]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a316198c-c3c7-4c28-a092-301a77045bc5 with Priority: HIGHEST for action security_group_rules [ 705.788384] env[65370]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a316198c-c3c7-4c28-a092-301a77045bc5 with Priority: HIGHEST for action security_group_members [ 705.788384] env[65370]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e0c80400-f1db-49f7-a83c-a76588a37a55 with Priority: HIGHEST for action port [ 705.788586] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a316198c-c3c7-4c28-a092-301a77045bc5 taken with stack trace [, , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 705.790071] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a316198c-c3c7-4c28-a092-301a77045bc5" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 705.790071] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a316198c-c3c7-4c28-a092-301a77045bc5" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 705.790253] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a316198c-c3c7-4c28-a092-301a77045bc5" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 705.790383] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a316198c-c3c7-4c28-a092-301a77045bc5',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 705.791705] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock member-a316198c-c3c7-4c28-a092-301a77045bc5 taken with stack trace [, , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 705.791884] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a316198c-c3c7-4c28-a092-301a77045bc5" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 705.792126] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a316198c-c3c7-4c28-a092-301a77045bc5" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 705.792306] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a316198c-c3c7-4c28-a092-301a77045bc5" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 705.792828] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 705.792828] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 705.792828] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 705.794334] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 705.794334] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 705.794334] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a316198c-c3c7-4c28-a092-301a77045bc5',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 705.797680] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock port-e0c80400-f1db-49f7-a83c-a76588a37a55 taken with stack trace [, , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 705.797680] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-e0c80400-f1db-49f7-a83c-a76588a37a55" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 705.797680] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-e0c80400-f1db-49f7-a83c-a76588a37a55" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 705.797680] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-e0c80400-f1db-49f7-a83c-a76588a37a55" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 705.797680] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e0c80400-f1db-49f7-a83c-a76588a37a55',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 706.119791] env[65370]: INFO networking_nsxv3.common.synchronization [req-8ce0af5d-1f81-42ac-8334-21558fa739da req-413a8c0a-d6b5-4568-b478-480638dd529d tempest-SecurityGroupRulesTestJSON-1280346518 tempest-SecurityGroupRulesTestJSON-1280346518-project-member] Enqueued Resource ID: 992cb680-83e6-482d-b534-55ed5ddaaf1a with Priority: HIGHEST for action security_group_rules [ 706.120652] env[65370]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 992cb680-83e6-482d-b534-55ed5ddaaf1a with Priority: HIGHEST for action security_group_rules [ 706.121351] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock rules-992cb680-83e6-482d-b534-55ed5ddaaf1a taken with stack trace [, , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 706.121351] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-992cb680-83e6-482d-b534-55ed5ddaaf1a" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 706.121351] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-992cb680-83e6-482d-b534-55ed5ddaaf1a" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 706.127817] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-992cb680-83e6-482d-b534-55ed5ddaaf1a" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 706.127908] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('992cb680-83e6-482d-b534-55ed5ddaaf1a',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 706.135236] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock member-67f4a0c1-3a3c-4ed8-9358-3a9645aba154 taken with stack trace [, , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 706.135236] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-67f4a0c1-3a3c-4ed8-9358-3a9645aba154" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 706.135236] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-67f4a0c1-3a3c-4ed8-9358-3a9645aba154" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 706.135236] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-67f4a0c1-3a3c-4ed8-9358-3a9645aba154" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 706.135570] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 706.135570] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 706.135570] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 706.135680] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 706.135776] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 706.135864] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-67f4a0c1-3a3c-4ed8-9358-3a9645aba154" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 706.136100] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock member-67f4a0c1-3a3c-4ed8-9358-3a9645aba154 taken with stack trace [, , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 706.136244] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-67f4a0c1-3a3c-4ed8-9358-3a9645aba154" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 706.136289] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-67f4a0c1-3a3c-4ed8-9358-3a9645aba154" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 706.136466] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-67f4a0c1-3a3c-4ed8-9358-3a9645aba154" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 706.136618] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 706.136714] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 706.136775] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 706.136953] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 706.137059] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 706.137107] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-67f4a0c1-3a3c-4ed8-9358-3a9645aba154" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 706.138413] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('67f4a0c1-3a3c-4ed8-9358-3a9645aba154',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 706.299753] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock member-a316198c-c3c7-4c28-a092-301a77045bc5 taken with stack trace [, , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 706.300309] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a316198c-c3c7-4c28-a092-301a77045bc5" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 706.300309] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('a316198c-c3c7-4c28-a092-301a77045bc5',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 706.307893] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port e0c80400-f1db-49f7-a83c-a76588a37a55 with status ACTIVE [ 706.308145] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 706.308145] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 706.308295] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 706.308372] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 706.309454] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 706.309454] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 706.309454] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 706.309454] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 706.309454] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 706.309454] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 706.309454] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 706.309454] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 706.309454] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 706.309913] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 706.309913] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 706.309913] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: e0c80400-f1db-49f7-a83c-a76588a37a55 is going to be updated. [ 706.353318] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 706.353318] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 706.353318] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 706.353318] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 706.353318] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 706.353557] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-e0c80400-f1db-49f7-a83c-a76588a37a55" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 706.641757] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 67f4a0c1-3a3c-4ed8-9358-3a9645aba154: rpc.has_security_group_logging(os_id): False [ 706.650457] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 706.650617] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 706.650655] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 706.650884] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 706.651071] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 706.651071] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 992cb680-83e6-482d-b534-55ed5ddaaf1a already deleted. [ 706.651219] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-992cb680-83e6-482d-b534-55ed5ddaaf1a" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 706.659699] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 706.659844] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 706.659921] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 706.660142] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 706.660229] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 706.660449] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 706.660551] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 706.660609] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 706.660759] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 706.660836] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 706.661016] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 706.661115] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 706.661176] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 706.661314] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 706.661388] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 706.661569] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 706.661680] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 706.661722] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 706.661846] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 706.661918] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 706.662008] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 67f4a0c1-3a3c-4ed8-9358-3a9645aba154 is going to be updated. [ 706.730712] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 706.730947] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 706.730947] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 706.731216] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 706.731298] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 706.758284] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 67f4a0c1-3a3c-4ed8-9358-3a9645aba154 in Status: IN_PROGRESS for 2s [ 706.808931] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('a316198c-c3c7-4c28-a092-301a77045bc5',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 707.313399] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 707.313399] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 707.313399] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 707.313399] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 707.313399] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 707.313399] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a316198c-c3c7-4c28-a092-301a77045bc5 is going to be created. [ 707.365216] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 707.365459] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 707.365635] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 707.365860] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 707.365966] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 707.384611] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a316198c-c3c7-4c28-a092-301a77045bc5 in Status: UNINITIALIZED for 2s [ 708.773766] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 67f4a0c1-3a3c-4ed8-9358-3a9645aba154 in Status: SUCCESS [ 708.774033] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-67f4a0c1-3a3c-4ed8-9358-3a9645aba154" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 709.198842] env[65370]: INFO networking_nsxv3.common.synchronization [None req-1630b5e7-072a-493f-bf0e-78c248cd552b None None] Enqueued Resource ID: 7c791d0d-f07f-4fe8-9f8a-12ef753cda95 with Priority: HIGHEST for action port [ 709.199103] env[65370]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7c791d0d-f07f-4fe8-9f8a-12ef753cda95 with Priority: HIGHEST for action port [ 709.200129] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock port-7c791d0d-f07f-4fe8-9f8a-12ef753cda95 taken with stack trace [, , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 709.200129] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-7c791d0d-f07f-4fe8-9f8a-12ef753cda95" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 709.200129] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-7c791d0d-f07f-4fe8-9f8a-12ef753cda95" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 709.200580] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-7c791d0d-f07f-4fe8-9f8a-12ef753cda95" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 709.201828] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7c791d0d-f07f-4fe8-9f8a-12ef753cda95',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 709.407284] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a316198c-c3c7-4c28-a092-301a77045bc5 in Status: SUCCESS [ 709.407511] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a316198c-c3c7-4c28-a092-301a77045bc5" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 709.407616] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a316198c-c3c7-4c28-a092-301a77045bc5" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 709.407908] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a316198c-c3c7-4c28-a092-301a77045bc5" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 709.408142] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 709.408408] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 709.408892] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 709.408892] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 709.408892] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 709.408892] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a316198c-c3c7-4c28-a092-301a77045bc5" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 709.409266] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('a316198c-c3c7-4c28-a092-301a77045bc5',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 709.704331] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 7c791d0d-f07f-4fe8-9f8a-12ef753cda95 [ 709.705489] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 709.705823] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 709.705952] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 709.706501] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 709.706661] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 709.706826] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:7c791d0d-f07f-4fe8-9f8a-12ef753cda95 already deleted. [ 709.706984] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-7c791d0d-f07f-4fe8-9f8a-12ef753cda95" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 709.912211] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock member-a316198c-c3c7-4c28-a092-301a77045bc5 taken with stack trace [, , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 709.913809] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a316198c-c3c7-4c28-a092-301a77045bc5" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 709.913809] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a316198c-c3c7-4c28-a092-301a77045bc5" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 709.913809] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a316198c-c3c7-4c28-a092-301a77045bc5" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 709.914140] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 709.914140] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 709.914140] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 709.914870] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 709.914870] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 709.914870] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a316198c-c3c7-4c28-a092-301a77045bc5" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 709.915051] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock member-a316198c-c3c7-4c28-a092-301a77045bc5 taken with stack trace [, , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 709.915167] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a316198c-c3c7-4c28-a092-301a77045bc5" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 709.915286] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a316198c-c3c7-4c28-a092-301a77045bc5" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 709.915478] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a316198c-c3c7-4c28-a092-301a77045bc5" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 709.916325] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 709.917866] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 709.917866] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 709.917866] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 709.917866] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 709.917866] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a316198c-c3c7-4c28-a092-301a77045bc5" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 709.917866] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('a316198c-c3c7-4c28-a092-301a77045bc5',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 710.419210] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for a316198c-c3c7-4c28-a092-301a77045bc5: rpc.has_security_group_logging(os_id): False [ 710.443899] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 710.443899] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 710.443899] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 710.445850] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 710.445850] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 710.445850] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 710.445850] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 710.445850] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 710.445850] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 710.445850] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 710.445850] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 710.445850] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 710.445850] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 710.445850] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 710.445850] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 710.445850] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 710.445850] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 710.452065] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 710.452065] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 710.452065] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 710.452065] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a316198c-c3c7-4c28-a092-301a77045bc5 is going to be created. [ 710.514226] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 710.514397] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 710.514507] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 710.515391] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 710.515391] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 710.527415] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a316198c-c3c7-4c28-a092-301a77045bc5 in Status: IN_PROGRESS for 2s [ 710.580605] env[65370]: INFO networking_nsxv3.common.synchronization [req-e98b4578-8884-4a9f-b507-edbfb61d6cba req-94f2170e-2756-42d4-8ba3-8763f36c96e3 tempest-FloatingIPsAssociationNegativeTestJSON-1863561544 tempest-FloatingIPsAssociationNegativeTestJSON-1863561544-project-member] Enqueued Resource ID: ce41a48f-c3f8-4fae-9206-7c7028887496 with Priority: HIGHEST for action security_group_members [ 710.581560] env[65370]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ce41a48f-c3f8-4fae-9206-7c7028887496 with Priority: HIGHEST for action security_group_members [ 710.582533] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock member-ce41a48f-c3f8-4fae-9206-7c7028887496 taken with stack trace [, , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 710.585098] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ce41a48f-c3f8-4fae-9206-7c7028887496" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 710.585893] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ce41a48f-c3f8-4fae-9206-7c7028887496" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 710.585893] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ce41a48f-c3f8-4fae-9206-7c7028887496" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 710.585893] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 710.585893] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 710.585893] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 710.586152] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 710.586152] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 710.586233] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ce41a48f-c3f8-4fae-9206-7c7028887496',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 711.089300] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 711.089300] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 711.089300] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 711.089300] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 711.089845] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 711.089845] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 711.089845] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 711.089845] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 711.090091] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 711.090173] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 711.090292] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ce41a48f-c3f8-4fae-9206-7c7028887496 is going to be updated. [ 711.123837] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 711.123996] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 711.124107] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 711.124341] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 711.124509] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 711.140950] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ce41a48f-c3f8-4fae-9206-7c7028887496 in Status: IN_PROGRESS for 2s [ 712.221229] env[65370]: INFO networking_nsxv3.common.synchronization [None req-ffe3de62-3f31-4c47-a650-11d2e6233882 None None] Enqueued Resource ID: 0faff62f-bde6-4708-990b-2f690be6e5fa with Priority: HIGHEST for action port [ 712.221502] env[65370]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0faff62f-bde6-4708-990b-2f690be6e5fa with Priority: HIGHEST for action port [ 712.222214] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock port-0faff62f-bde6-4708-990b-2f690be6e5fa taken with stack trace [, , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 712.222340] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-0faff62f-bde6-4708-990b-2f690be6e5fa" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 712.222417] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-0faff62f-bde6-4708-990b-2f690be6e5fa" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 712.222654] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-0faff62f-bde6-4708-990b-2f690be6e5fa" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 712.222740] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0faff62f-bde6-4708-990b-2f690be6e5fa',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 712.542135] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a316198c-c3c7-4c28-a092-301a77045bc5 in Status: SUCCESS [ 712.542405] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a316198c-c3c7-4c28-a092-301a77045bc5" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 712.725693] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 0faff62f-bde6-4708-990b-2f690be6e5fa [ 712.726059] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 712.726272] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 712.726361] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 712.726622] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 712.726719] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 712.726843] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:0faff62f-bde6-4708-990b-2f690be6e5fa already deleted. [ 712.726933] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-0faff62f-bde6-4708-990b-2f690be6e5fa" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 712.771368] env[65370]: INFO networking_nsxv3.common.synchronization [req-47fb8ad1-0dbb-4eb6-ab6c-d3e854b2c3b9 req-78da28e9-c6e8-4524-86c0-0d901548dcfa tempest-VolumesAssistedSnapshotsTest-1217946812 tempest-VolumesAssistedSnapshotsTest-1217946812-project-member] Enqueued Resource ID: ade9055b-2ef9-426f-9386-65654700ee06 with Priority: HIGHEST for action security_group_members [ 712.772820] env[65370]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ade9055b-2ef9-426f-9386-65654700ee06 with Priority: HIGHEST for action security_group_members [ 712.773340] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock member-ade9055b-2ef9-426f-9386-65654700ee06 taken with stack trace [, , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 712.773738] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ade9055b-2ef9-426f-9386-65654700ee06" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 712.773876] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ade9055b-2ef9-426f-9386-65654700ee06" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 712.774249] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ade9055b-2ef9-426f-9386-65654700ee06" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 712.774658] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 712.774934] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 712.775118] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 712.775371] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 712.775583] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 712.776292] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ade9055b-2ef9-426f-9386-65654700ee06',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 713.153376] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ce41a48f-c3f8-4fae-9206-7c7028887496 in Status: SUCCESS [ 713.153376] env[65370]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ce41a48f-c3f8-4fae-9206-7c7028887496 deletion is rescheduled due to dependency. [ 713.153376] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ce41a48f-c3f8-4fae-9206-7c7028887496" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 713.245761] env[65370]: INFO networking_nsxv3.common.synchronization [None req-7989c684-f355-45d1-9d73-431c6efc8a50 None None] Enqueued Resource ID: 56f0ef63-265b-455b-94fc-b28a526f9494 with Priority: HIGHEST for action port [ 713.245761] env[65370]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 56f0ef63-265b-455b-94fc-b28a526f9494 with Priority: HIGHEST for action port [ 713.245761] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock port-56f0ef63-265b-455b-94fc-b28a526f9494 taken with stack trace [, , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 713.245761] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-56f0ef63-265b-455b-94fc-b28a526f9494" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 713.248415] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-56f0ef63-265b-455b-94fc-b28a526f9494" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 713.248415] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-56f0ef63-265b-455b-94fc-b28a526f9494" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 713.248415] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('56f0ef63-265b-455b-94fc-b28a526f9494',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 713.280815] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 713.280815] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 713.281191] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 713.281191] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 713.281308] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 713.281483] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 713.282481] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 713.282481] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 713.282481] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 713.282481] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 713.282481] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ade9055b-2ef9-426f-9386-65654700ee06 is going to be updated. [ 713.320918] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 713.321145] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 713.321234] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 713.321437] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 713.321586] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 713.335250] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ade9055b-2ef9-426f-9386-65654700ee06 in Status: IN_PROGRESS for 2s [ 713.499263] env[65370]: INFO networking_nsxv3.common.synchronization [req-aba4afd1-c233-4c90-973f-17bda6c170df req-3e31a860-1649-478c-98c5-ceb4afbbbe5d tempest-ServersWithSpecificFlavorTestJSON-1546929489 tempest-ServersWithSpecificFlavorTestJSON-1546929489-project-member] Enqueued Resource ID: b8e66f81-0f32-48b8-b81f-542b74cbecd4 with Priority: HIGHEST for action security_group_members [ 713.499819] env[65370]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b8e66f81-0f32-48b8-b81f-542b74cbecd4 with Priority: HIGHEST for action security_group_members [ 713.500217] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock member-b8e66f81-0f32-48b8-b81f-542b74cbecd4 taken with stack trace [, , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 713.500347] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b8e66f81-0f32-48b8-b81f-542b74cbecd4" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 713.500409] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b8e66f81-0f32-48b8-b81f-542b74cbecd4" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 713.500612] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b8e66f81-0f32-48b8-b81f-542b74cbecd4" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 713.500766] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 713.500863] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 713.500922] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 713.501087] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 713.501173] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 713.501300] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b8e66f81-0f32-48b8-b81f-542b74cbecd4',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 713.751465] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 56f0ef63-265b-455b-94fc-b28a526f9494 [ 713.751465] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 713.751465] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 713.751465] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 713.751465] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 713.751465] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 713.751465] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:56f0ef63-265b-455b-94fc-b28a526f9494 already deleted. [ 713.751465] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-56f0ef63-265b-455b-94fc-b28a526f9494" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 714.004435] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 714.004666] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 714.004764] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 714.006137] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 714.006137] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 714.006574] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 714.006574] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 714.006721] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 714.007769] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 714.007769] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 714.007769] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b8e66f81-0f32-48b8-b81f-542b74cbecd4 is going to be updated. [ 714.039270] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 714.039270] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 714.039270] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 714.039417] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 714.039535] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 714.050668] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b8e66f81-0f32-48b8-b81f-542b74cbecd4 in Status: IN_PROGRESS for 2s [ 714.226050] env[65370]: DEBUG networking_nsxv3.common.locking [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Lock network-573 taken with stack trace [, , , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 714.226050] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquiring lock "network-573" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 714.226050] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquired lock "network-573" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 714.226050] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquired external semaphore "network-573" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 714.226241] env[65370]: DEBUG networking_nsxv3.common.locking [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 714.226320] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquiring lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 714.226423] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquired lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 714.226668] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquired external semaphore "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 714.226780] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Releasing lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 714.228331] env[65370]: DEBUG dogpile.cache.region [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] No value present for key: 'zone-id' {{(pid=65370) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 714.228476] env[65370]: DEBUG dogpile.lock [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] NeedRegenerationException {{(pid=65370) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 714.228580] env[65370]: DEBUG dogpile.lock [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] no value, waiting for create lock {{(pid=65370) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 714.228678] env[65370]: DEBUG dogpile.lock [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] value creation lock acquired {{(pid=65370) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 714.228785] env[65370]: DEBUG dogpile.cache.region [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] No value present for key: 'zone-id' {{(pid=65370) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 714.228882] env[65370]: DEBUG dogpile.lock [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Calling creation function for not-yet-present value {{(pid=65370) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 714.229407] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 714.250635] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 714.250994] env[65370]: DEBUG dogpile.cache.region [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=65370) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 714.250994] env[65370]: DEBUG dogpile.lock [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Released creation lock {{(pid=65370) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 714.251076] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Releasing lock "network-573" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 714.251584] env[65370]: DEBUG networking_nsxv3.common.locking [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Lock port-f39c400b-d78f-4562-bb99-7b793f1be1a6 taken with stack trace [, , , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 714.251584] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquiring lock "port-f39c400b-d78f-4562-bb99-7b793f1be1a6" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 714.251722] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquired lock "port-f39c400b-d78f-4562-bb99-7b793f1be1a6" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 714.252041] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquired external semaphore "port-f39c400b-d78f-4562-bb99-7b793f1be1a6" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 714.252158] env[65370]: DEBUG networking_nsxv3.api.rpc [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f39c400b-d78f-4562-bb99-7b793f1be1a6',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 714.756347] env[65370]: DEBUG networking_nsxv3.common.locking [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 714.756653] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquiring lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 714.756653] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquired lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 714.756921] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquired external semaphore "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 714.757078] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Releasing lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 714.757228] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Segment Port f39c400b-d78f-4562-bb99-7b793f1be1a6 not found, creating... [ 714.757474] env[65370]: DEBUG networking_nsxv3.common.locking [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 714.757629] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquiring lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 714.757782] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquired lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 714.757938] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquired external semaphore "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 714.758082] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Releasing lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 714.758352] env[65370]: DEBUG networking_nsxv3.common.locking [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 714.758490] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquiring lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 714.758597] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquired lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 714.758788] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquired external semaphore "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 714.758911] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Releasing lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 714.759053] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Resource: SegmentPort with ID: f39c400b-d78f-4562-bb99-7b793f1be1a6 is going to be created. [ 714.782650] env[65370]: DEBUG networking_nsxv3.common.locking [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 714.782877] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquiring lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 714.782983] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquired lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 714.783375] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquired external semaphore "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 714.783614] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Releasing lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 714.783836] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Releasing lock "port-f39c400b-d78f-4562-bb99-7b793f1be1a6" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 714.885709] env[65370]: INFO networking_nsxv3.common.synchronization [req-1ca30ccc-b5ff-456b-9ad3-7efa3f52becf req-557951de-b158-41f9-b773-0745fc5ce18d tempest-ServerRescueTestJSONUnderV235-1438794252 tempest-ServerRescueTestJSONUnderV235-1438794252-project-member] Enqueued Resource ID: 5132c293-b680-4491-ba2b-122515a71eaf with Priority: HIGHEST for action security_group_members [ 714.885858] env[65370]: INFO networking_nsxv3.common.synchronization [req-1ca30ccc-b5ff-456b-9ad3-7efa3f52becf req-557951de-b158-41f9-b773-0745fc5ce18d tempest-ServerRescueTestJSONUnderV235-1438794252 tempest-ServerRescueTestJSONUnderV235-1438794252-project-member] Enqueued Resource ID: ab6d2881-75e8-4c26-9e66-c80d829d27df with Priority: HIGHEST for action security_group_members [ 714.886566] env[65370]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5132c293-b680-4491-ba2b-122515a71eaf with Priority: HIGHEST for action security_group_members [ 714.886704] env[65370]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ab6d2881-75e8-4c26-9e66-c80d829d27df with Priority: HIGHEST for action security_group_members [ 714.886988] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock member-5132c293-b680-4491-ba2b-122515a71eaf taken with stack trace [, , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 714.887124] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5132c293-b680-4491-ba2b-122515a71eaf" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 714.887191] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5132c293-b680-4491-ba2b-122515a71eaf" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 714.887404] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5132c293-b680-4491-ba2b-122515a71eaf" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 714.887900] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 714.887900] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 714.887900] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 714.887900] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 714.888098] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 714.888098] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5132c293-b680-4491-ba2b-122515a71eaf',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 714.889053] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock member-ab6d2881-75e8-4c26-9e66-c80d829d27df taken with stack trace [, , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 714.889366] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ab6d2881-75e8-4c26-9e66-c80d829d27df" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 714.889366] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ab6d2881-75e8-4c26-9e66-c80d829d27df" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 714.889588] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ab6d2881-75e8-4c26-9e66-c80d829d27df" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 714.889735] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 714.889894] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 714.889995] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 714.890266] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 714.890308] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 714.890392] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ab6d2881-75e8-4c26-9e66-c80d829d27df',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 714.936999] env[65370]: INFO networking_nsxv3.common.synchronization [req-1ca30ccc-b5ff-456b-9ad3-7efa3f52becf req-557951de-b158-41f9-b773-0745fc5ce18d tempest-ServerRescueTestJSONUnderV235-1438794252 tempest-ServerRescueTestJSONUnderV235-1438794252-project-member] Enqueued Resource ID: 5132c293-b680-4491-ba2b-122515a71eaf with Priority: HIGHEST for action security_group_rules [ 714.937119] env[65370]: INFO networking_nsxv3.common.synchronization [req-1ca30ccc-b5ff-456b-9ad3-7efa3f52becf req-557951de-b158-41f9-b773-0745fc5ce18d tempest-ServerRescueTestJSONUnderV235-1438794252 tempest-ServerRescueTestJSONUnderV235-1438794252-project-member] Enqueued Resource ID: 5132c293-b680-4491-ba2b-122515a71eaf with Priority: HIGHEST for action security_group_members [ 714.937204] env[65370]: INFO networking_nsxv3.common.synchronization [req-1ca30ccc-b5ff-456b-9ad3-7efa3f52becf req-557951de-b158-41f9-b773-0745fc5ce18d tempest-ServerRescueTestJSONUnderV235-1438794252 tempest-ServerRescueTestJSONUnderV235-1438794252-project-member] Enqueued Resource ID: ab6d2881-75e8-4c26-9e66-c80d829d27df with Priority: HIGHEST for action security_group_rules [ 714.937460] env[65370]: INFO networking_nsxv3.common.synchronization [req-1ca30ccc-b5ff-456b-9ad3-7efa3f52becf req-557951de-b158-41f9-b773-0745fc5ce18d tempest-ServerRescueTestJSONUnderV235-1438794252 tempest-ServerRescueTestJSONUnderV235-1438794252-project-member] Enqueued Resource ID: ab6d2881-75e8-4c26-9e66-c80d829d27df with Priority: HIGHEST for action security_group_members [ 714.937460] env[65370]: INFO networking_nsxv3.common.synchronization [req-1ca30ccc-b5ff-456b-9ad3-7efa3f52becf req-557951de-b158-41f9-b773-0745fc5ce18d tempest-ServerRescueTestJSONUnderV235-1438794252 tempest-ServerRescueTestJSONUnderV235-1438794252-project-member] Enqueued Resource ID: cfc2bf8b-b1ac-4f6d-bb6f-abcee630e229 with Priority: HIGHEST for action port [ 714.938242] env[65370]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5132c293-b680-4491-ba2b-122515a71eaf with Priority: HIGHEST for action security_group_rules [ 714.938608] env[65370]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ab6d2881-75e8-4c26-9e66-c80d829d27df with Priority: HIGHEST for action security_group_rules [ 714.938608] env[65370]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cfc2bf8b-b1ac-4f6d-bb6f-abcee630e229 with Priority: HIGHEST for action port [ 714.938608] env[65370]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5132c293-b680-4491-ba2b-122515a71eaf with Priority: HIGHEST for action security_group_members [ 714.940323] env[65370]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ab6d2881-75e8-4c26-9e66-c80d829d27df with Priority: HIGHEST for action security_group_members [ 714.940659] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock rules-5132c293-b680-4491-ba2b-122515a71eaf taken with stack trace [, , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 714.940786] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-5132c293-b680-4491-ba2b-122515a71eaf" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 714.940846] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-5132c293-b680-4491-ba2b-122515a71eaf" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 714.941095] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-5132c293-b680-4491-ba2b-122515a71eaf" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 714.941244] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('5132c293-b680-4491-ba2b-122515a71eaf',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 714.944991] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock rules-ab6d2881-75e8-4c26-9e66-c80d829d27df taken with stack trace [, , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 714.944991] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-ab6d2881-75e8-4c26-9e66-c80d829d27df" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 714.944991] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-ab6d2881-75e8-4c26-9e66-c80d829d27df" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 714.944991] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-ab6d2881-75e8-4c26-9e66-c80d829d27df" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 714.944991] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('ab6d2881-75e8-4c26-9e66-c80d829d27df',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 714.944991] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock port-cfc2bf8b-b1ac-4f6d-bb6f-abcee630e229 taken with stack trace [, , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 714.944991] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-cfc2bf8b-b1ac-4f6d-bb6f-abcee630e229" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 714.944991] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-cfc2bf8b-b1ac-4f6d-bb6f-abcee630e229" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 714.945757] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-cfc2bf8b-b1ac-4f6d-bb6f-abcee630e229" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 714.945757] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('cfc2bf8b-b1ac-4f6d-bb6f-abcee630e229',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 714.947140] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock member-5132c293-b680-4491-ba2b-122515a71eaf taken with stack trace [, , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 714.947444] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5132c293-b680-4491-ba2b-122515a71eaf" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 714.948065] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock member-ab6d2881-75e8-4c26-9e66-c80d829d27df taken with stack trace [, , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 714.948156] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ab6d2881-75e8-4c26-9e66-c80d829d27df" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 715.352102] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ade9055b-2ef9-426f-9386-65654700ee06 in Status: SUCCESS [ 715.352102] env[65370]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ade9055b-2ef9-426f-9386-65654700ee06 deletion is rescheduled due to dependency. [ 715.352378] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ade9055b-2ef9-426f-9386-65654700ee06" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 715.393252] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('5132c293-b680-4491-ba2b-122515a71eaf',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 715.394528] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('ab6d2881-75e8-4c26-9e66-c80d829d27df',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 715.444359] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock member-5132c293-b680-4491-ba2b-122515a71eaf taken with stack trace [, , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 715.444359] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5132c293-b680-4491-ba2b-122515a71eaf" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 715.447567] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port cfc2bf8b-b1ac-4f6d-bb6f-abcee630e229 with status ACTIVE [ 715.447984] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 715.448245] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 715.448346] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 715.448607] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 715.448733] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 715.448944] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 715.449064] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 715.449191] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 715.449344] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 715.449388] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 715.449551] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 715.449642] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 715.449728] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 715.450031] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 715.450031] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 715.450031] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: cfc2bf8b-b1ac-4f6d-bb6f-abcee630e229 is going to be updated. [ 715.452729] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock member-ab6d2881-75e8-4c26-9e66-c80d829d27df taken with stack trace [, , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 715.452729] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ab6d2881-75e8-4c26-9e66-c80d829d27df" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 715.475312] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 715.475486] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 715.475585] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 715.475793] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 715.475940] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 715.476166] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-cfc2bf8b-b1ac-4f6d-bb6f-abcee630e229" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 715.543379] env[65370]: INFO networking_nsxv3.common.synchronization [req-aba4afd1-c233-4c90-973f-17bda6c170df req-45b9ed32-d03b-43bd-8301-aad8c615b2ab service nova] Enqueued Resource ID: b8e66f81-0f32-48b8-b81f-542b74cbecd4 with Priority: HIGHEST for action security_group_rules [ 715.543379] env[65370]: INFO networking_nsxv3.common.synchronization [req-aba4afd1-c233-4c90-973f-17bda6c170df req-45b9ed32-d03b-43bd-8301-aad8c615b2ab service nova] Enqueued Resource ID: b8e66f81-0f32-48b8-b81f-542b74cbecd4 with Priority: HIGHEST for action security_group_members [ 715.543379] env[65370]: INFO networking_nsxv3.common.synchronization [req-aba4afd1-c233-4c90-973f-17bda6c170df req-45b9ed32-d03b-43bd-8301-aad8c615b2ab service nova] Enqueued Resource ID: f39c400b-d78f-4562-bb99-7b793f1be1a6 with Priority: HIGHEST for action port [ 715.543379] env[65370]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b8e66f81-0f32-48b8-b81f-542b74cbecd4 with Priority: HIGHEST for action security_group_rules [ 715.543379] env[65370]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b8e66f81-0f32-48b8-b81f-542b74cbecd4 with Priority: HIGHEST for action security_group_members [ 715.543379] env[65370]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f39c400b-d78f-4562-bb99-7b793f1be1a6 with Priority: HIGHEST for action port [ 715.543379] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock rules-b8e66f81-0f32-48b8-b81f-542b74cbecd4 taken with stack trace [, , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 715.543379] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-b8e66f81-0f32-48b8-b81f-542b74cbecd4" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 715.543379] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-b8e66f81-0f32-48b8-b81f-542b74cbecd4" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 715.543379] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-b8e66f81-0f32-48b8-b81f-542b74cbecd4" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 715.543379] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('b8e66f81-0f32-48b8-b81f-542b74cbecd4',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 715.544460] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock member-b8e66f81-0f32-48b8-b81f-542b74cbecd4 taken with stack trace [, , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 715.544558] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b8e66f81-0f32-48b8-b81f-542b74cbecd4" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 715.544931] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock port-f39c400b-d78f-4562-bb99-7b793f1be1a6 taken with stack trace [, , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 715.544931] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-f39c400b-d78f-4562-bb99-7b793f1be1a6" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 715.544931] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-f39c400b-d78f-4562-bb99-7b793f1be1a6" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 715.545191] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-f39c400b-d78f-4562-bb99-7b793f1be1a6" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 715.545251] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f39c400b-d78f-4562-bb99-7b793f1be1a6',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 715.838804] env[65370]: INFO networking_nsxv3.common.synchronization [req-8ba9669a-f495-4fc4-abd4-109e9b64c529 req-33839336-aa41-4965-bca7-ae95bbd743f9 tempest-VolumesAdminNegativeTest-1748062384 tempest-VolumesAdminNegativeTest-1748062384-project-member] Enqueued Resource ID: 14c6c739-bd84-4bc8-9d1c-9bc29741c32d with Priority: HIGHEST for action security_group_members [ 715.839463] env[65370]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 14c6c739-bd84-4bc8-9d1c-9bc29741c32d with Priority: HIGHEST for action security_group_members [ 715.839774] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock member-14c6c739-bd84-4bc8-9d1c-9bc29741c32d taken with stack trace [, , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 715.839887] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-14c6c739-bd84-4bc8-9d1c-9bc29741c32d" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 715.839954] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-14c6c739-bd84-4bc8-9d1c-9bc29741c32d" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 715.840243] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-14c6c739-bd84-4bc8-9d1c-9bc29741c32d" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 715.840399] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 715.840565] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 715.840565] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 715.840708] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 715.840791] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 715.840972] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('14c6c739-bd84-4bc8-9d1c-9bc29741c32d',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 715.898420] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('5132c293-b680-4491-ba2b-122515a71eaf',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 715.899426] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('ab6d2881-75e8-4c26-9e66-c80d829d27df',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 715.952135] env[65370]: INFO networking_nsxv3.common.synchronization [None req-3868fa41-0dcf-49e2-b4d0-ccf0db22cd87 None None] Enqueued Resource ID: 740b8829-dfd4-49c6-ac05-e9432cfc103b with Priority: HIGHEST for action port [ 715.953074] env[65370]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 740b8829-dfd4-49c6-ac05-e9432cfc103b with Priority: HIGHEST for action port [ 715.953074] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock port-740b8829-dfd4-49c6-ac05-e9432cfc103b taken with stack trace [, , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 715.953216] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-740b8829-dfd4-49c6-ac05-e9432cfc103b" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 715.953216] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-740b8829-dfd4-49c6-ac05-e9432cfc103b" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 715.953599] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-740b8829-dfd4-49c6-ac05-e9432cfc103b" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 715.953599] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('740b8829-dfd4-49c6-ac05-e9432cfc103b',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 716.047194] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock member-b8e66f81-0f32-48b8-b81f-542b74cbecd4 taken with stack trace [, , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 716.047349] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b8e66f81-0f32-48b8-b81f-542b74cbecd4" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 716.047567] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port f39c400b-d78f-4562-bb99-7b793f1be1a6 with status ACTIVE [ 716.047758] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 716.047881] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 716.047952] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 716.048191] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 716.048284] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 716.048465] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 716.048575] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 716.048638] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 716.048807] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 716.048871] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 716.049092] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 716.049218] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 716.049283] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 716.049421] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 716.049514] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 716.049655] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: f39c400b-d78f-4562-bb99-7b793f1be1a6 is going to be updated. [ 716.067107] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b8e66f81-0f32-48b8-b81f-542b74cbecd4 in Status: SUCCESS [ 716.067740] env[65370]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b8e66f81-0f32-48b8-b81f-542b74cbecd4 deletion is rescheduled due to dependency. [ 716.067914] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b8e66f81-0f32-48b8-b81f-542b74cbecd4" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 716.068534] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b8e66f81-0f32-48b8-b81f-542b74cbecd4" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 716.068785] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b8e66f81-0f32-48b8-b81f-542b74cbecd4" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 716.068995] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 716.069161] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 716.069256] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 716.071082] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 716.073140] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 716.073288] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b8e66f81-0f32-48b8-b81f-542b74cbecd4',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 716.079630] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 716.079792] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 716.079869] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 716.080088] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 716.080236] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 716.080530] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-f39c400b-d78f-4562-bb99-7b793f1be1a6" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 716.346665] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 716.346665] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 716.346856] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 716.346960] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 716.347063] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 716.347260] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 716.347361] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 716.347415] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 716.347557] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 716.347631] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 716.347713] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 14c6c739-bd84-4bc8-9d1c-9bc29741c32d already deleted. [ 716.347792] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-14c6c739-bd84-4bc8-9d1c-9bc29741c32d" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 716.389114] env[65370]: DEBUG networking_nsxv3.common.locking [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Lock network-714 taken with stack trace [, , , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 716.389114] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquiring lock "network-714" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 716.389114] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquired lock "network-714" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 716.389114] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquired external semaphore "network-714" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 716.389634] env[65370]: DEBUG networking_nsxv3.common.locking [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 716.389634] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquiring lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 716.389634] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquired lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 716.389837] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquired external semaphore "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 716.389905] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Releasing lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 716.390587] env[65370]: DEBUG dogpile.cache.region [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] No value present for key: 'zone-id' {{(pid=65370) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 716.390701] env[65370]: DEBUG dogpile.lock [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] NeedRegenerationException {{(pid=65370) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 716.390807] env[65370]: DEBUG dogpile.lock [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] no value, waiting for create lock {{(pid=65370) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 716.391162] env[65370]: DEBUG dogpile.lock [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] value creation lock acquired {{(pid=65370) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 716.391425] env[65370]: DEBUG dogpile.cache.region [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] No value present for key: 'zone-id' {{(pid=65370) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 716.391557] env[65370]: DEBUG dogpile.lock [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Calling creation function for not-yet-present value {{(pid=65370) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 716.391702] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 716.401702] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 716.401919] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 716.401919] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 716.402143] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 716.402243] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 716.402351] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ab6d2881-75e8-4c26-9e66-c80d829d27df is going to be created. [ 716.404481] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 716.404481] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 716.404481] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 716.404481] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 716.404481] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 716.404481] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5132c293-b680-4491-ba2b-122515a71eaf is going to be updated. [ 716.411587] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 716.411781] env[65370]: DEBUG dogpile.cache.region [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=65370) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 716.411884] env[65370]: DEBUG dogpile.lock [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Released creation lock {{(pid=65370) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 716.412076] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Releasing lock "network-714" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 716.412388] env[65370]: DEBUG networking_nsxv3.common.locking [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Lock port-19bc268b-f0c9-422e-8cf3-28e34f6fac61 taken with stack trace [, , , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 716.412549] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquiring lock "port-19bc268b-f0c9-422e-8cf3-28e34f6fac61" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 716.413119] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquired lock "port-19bc268b-f0c9-422e-8cf3-28e34f6fac61" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 716.413119] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquired external semaphore "port-19bc268b-f0c9-422e-8cf3-28e34f6fac61" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 716.413119] env[65370]: DEBUG networking_nsxv3.api.rpc [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('19bc268b-f0c9-422e-8cf3-28e34f6fac61',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 716.437175] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 716.437462] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 716.437462] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 716.437887] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 716.437887] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 716.441019] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 716.441019] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 716.441183] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 716.441714] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 716.441714] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 716.450178] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5132c293-b680-4491-ba2b-122515a71eaf in Status: IN_PROGRESS for 2s [ 716.450844] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ab6d2881-75e8-4c26-9e66-c80d829d27df in Status: UNINITIALIZED for 2s [ 716.455301] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 740b8829-dfd4-49c6-ac05-e9432cfc103b [ 716.458959] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 716.458959] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 716.458959] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 716.458959] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 716.458959] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 716.458959] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:740b8829-dfd4-49c6-ac05-e9432cfc103b already deleted. [ 716.458959] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-740b8829-dfd4-49c6-ac05-e9432cfc103b" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 716.578336] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('b8e66f81-0f32-48b8-b81f-542b74cbecd4',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 716.626604] env[65370]: INFO networking_nsxv3.common.synchronization [None req-2be89f50-5c6f-4896-b395-3e6dfcdb3b5e None None] Enqueued Resource ID: bc84b563-2a4b-4437-bac9-3107e989454f with Priority: HIGHEST for action port [ 716.627583] env[65370]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bc84b563-2a4b-4437-bac9-3107e989454f with Priority: HIGHEST for action port [ 716.627889] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock port-bc84b563-2a4b-4437-bac9-3107e989454f taken with stack trace [, , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 716.628017] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-bc84b563-2a4b-4437-bac9-3107e989454f" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 716.628780] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-bc84b563-2a4b-4437-bac9-3107e989454f" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 716.628886] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-bc84b563-2a4b-4437-bac9-3107e989454f" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 716.628978] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('bc84b563-2a4b-4437-bac9-3107e989454f',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 716.919114] env[65370]: DEBUG networking_nsxv3.common.locking [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 716.919386] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquiring lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 716.919454] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquired lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 716.919730] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquired external semaphore "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 716.919878] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Releasing lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 716.920043] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Segment Port 19bc268b-f0c9-422e-8cf3-28e34f6fac61 not found, creating... [ 716.920367] env[65370]: DEBUG networking_nsxv3.common.locking [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 716.920544] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquiring lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 716.921236] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquired lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 716.921236] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquired external semaphore "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 716.921236] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Releasing lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 716.921376] env[65370]: DEBUG networking_nsxv3.common.locking [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 716.921433] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquiring lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 716.921573] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquired lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 716.921755] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquired external semaphore "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 716.921879] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Releasing lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 716.922151] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Resource: SegmentPort with ID: 19bc268b-f0c9-422e-8cf3-28e34f6fac61 is going to be created. [ 716.943448] env[65370]: DEBUG networking_nsxv3.common.locking [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 716.943668] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquiring lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 716.943760] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquired lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 716.944019] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquired external semaphore "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 716.944250] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Releasing lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 716.944459] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Releasing lock "port-19bc268b-f0c9-422e-8cf3-28e34f6fac61" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 717.081091] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('b8e66f81-0f32-48b8-b81f-542b74cbecd4',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 717.133348] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port bc84b563-2a4b-4437-bac9-3107e989454f [ 717.133348] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 717.133348] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 717.133348] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 717.133849] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 717.133849] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 717.133849] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:bc84b563-2a4b-4437-bac9-3107e989454f already deleted. [ 717.133849] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-bc84b563-2a4b-4437-bac9-3107e989454f" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 717.587251] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 717.588184] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 717.588184] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 717.588373] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 717.588373] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 717.588471] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b8e66f81-0f32-48b8-b81f-542b74cbecd4 is going to be updated. [ 717.627257] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 717.627544] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 717.627648] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 717.627918] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 717.628163] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 717.639778] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b8e66f81-0f32-48b8-b81f-542b74cbecd4 in Status: IN_PROGRESS for 2s [ 717.661276] env[65370]: INFO networking_nsxv3.common.synchronization [req-2f311063-e1d7-4559-8540-093b8bcb3e4c req-de906b7a-f757-4ac4-822b-566b76c306d0 tempest-SecurityGroupRulesTestJSON-1280346518 tempest-SecurityGroupRulesTestJSON-1280346518-project-member] Enqueued Resource ID: 500971fe-f06b-4c78-af44-f61b389519f8 with Priority: HIGHEST for action security_group_rules [ 717.662211] env[65370]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 500971fe-f06b-4c78-af44-f61b389519f8 with Priority: HIGHEST for action security_group_rules [ 717.662399] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock rules-500971fe-f06b-4c78-af44-f61b389519f8 taken with stack trace [, , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 717.662524] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-500971fe-f06b-4c78-af44-f61b389519f8" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 717.662617] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-500971fe-f06b-4c78-af44-f61b389519f8" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 717.663077] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-500971fe-f06b-4c78-af44-f61b389519f8" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 717.663077] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('500971fe-f06b-4c78-af44-f61b389519f8',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 717.680655] env[65370]: INFO networking_nsxv3.common.synchronization [req-8ba9669a-f495-4fc4-abd4-109e9b64c529 req-04fc17ec-3b5d-4a12-b8d4-856932fa3843 service nova] Enqueued Resource ID: 14c6c739-bd84-4bc8-9d1c-9bc29741c32d with Priority: HIGHEST for action security_group_rules [ 717.680655] env[65370]: INFO networking_nsxv3.common.synchronization [req-8ba9669a-f495-4fc4-abd4-109e9b64c529 req-04fc17ec-3b5d-4a12-b8d4-856932fa3843 service nova] Enqueued Resource ID: 14c6c739-bd84-4bc8-9d1c-9bc29741c32d with Priority: HIGHEST for action security_group_members [ 717.680655] env[65370]: INFO networking_nsxv3.common.synchronization [req-8ba9669a-f495-4fc4-abd4-109e9b64c529 req-04fc17ec-3b5d-4a12-b8d4-856932fa3843 service nova] Enqueued Resource ID: 19bc268b-f0c9-422e-8cf3-28e34f6fac61 with Priority: HIGHEST for action port [ 717.680655] env[65370]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 14c6c739-bd84-4bc8-9d1c-9bc29741c32d with Priority: HIGHEST for action security_group_rules [ 717.680844] env[65370]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 14c6c739-bd84-4bc8-9d1c-9bc29741c32d with Priority: HIGHEST for action security_group_members [ 717.680901] env[65370]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 19bc268b-f0c9-422e-8cf3-28e34f6fac61 with Priority: HIGHEST for action port [ 717.682172] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock rules-14c6c739-bd84-4bc8-9d1c-9bc29741c32d taken with stack trace [, , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 717.682172] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-14c6c739-bd84-4bc8-9d1c-9bc29741c32d" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 717.682172] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-14c6c739-bd84-4bc8-9d1c-9bc29741c32d" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 717.682172] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-14c6c739-bd84-4bc8-9d1c-9bc29741c32d" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 717.682172] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('14c6c739-bd84-4bc8-9d1c-9bc29741c32d',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 717.683038] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock member-14c6c739-bd84-4bc8-9d1c-9bc29741c32d taken with stack trace [, , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 717.683291] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-14c6c739-bd84-4bc8-9d1c-9bc29741c32d" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 717.683291] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-14c6c739-bd84-4bc8-9d1c-9bc29741c32d" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 717.683410] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-14c6c739-bd84-4bc8-9d1c-9bc29741c32d" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 717.683575] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 717.683749] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 717.683845] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 717.684673] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 717.684673] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 717.684673] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('14c6c739-bd84-4bc8-9d1c-9bc29741c32d',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 717.685734] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock port-19bc268b-f0c9-422e-8cf3-28e34f6fac61 taken with stack trace [, , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 717.685734] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-19bc268b-f0c9-422e-8cf3-28e34f6fac61" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 717.685734] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-19bc268b-f0c9-422e-8cf3-28e34f6fac61" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 717.685888] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-19bc268b-f0c9-422e-8cf3-28e34f6fac61" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 717.685888] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('19bc268b-f0c9-422e-8cf3-28e34f6fac61',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 718.088128] env[65370]: INFO networking_nsxv3.common.synchronization [req-8fd966f2-9acf-456f-8bac-367759ddceab req-f19a3d4b-5794-4741-87af-f7b486d449d8 tempest-ServerRescueNegativeTestJSON-807527939 tempest-ServerRescueNegativeTestJSON-807527939-project-member] Enqueued Resource ID: 237e1a89-daff-4fd5-b02a-97e1d536d9bd with Priority: HIGHEST for action security_group_members [ 718.088128] env[65370]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 237e1a89-daff-4fd5-b02a-97e1d536d9bd with Priority: HIGHEST for action security_group_members [ 718.088128] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock member-237e1a89-daff-4fd5-b02a-97e1d536d9bd taken with stack trace [, , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 718.088128] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-237e1a89-daff-4fd5-b02a-97e1d536d9bd" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 718.088128] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-237e1a89-daff-4fd5-b02a-97e1d536d9bd" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 718.089274] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-237e1a89-daff-4fd5-b02a-97e1d536d9bd" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 718.089442] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 718.089555] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 718.089618] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 718.089799] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 718.089889] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 718.089988] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('237e1a89-daff-4fd5-b02a-97e1d536d9bd',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 718.188279] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock member-14c6c739-bd84-4bc8-9d1c-9bc29741c32d taken with stack trace [, , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 718.189068] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-14c6c739-bd84-4bc8-9d1c-9bc29741c32d" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 718.189068] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('14c6c739-bd84-4bc8-9d1c-9bc29741c32d',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 718.192516] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 718.192619] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 718.192619] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 718.192835] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 718.193274] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 718.193465] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 500971fe-f06b-4c78-af44-f61b389519f8 already deleted. [ 718.193465] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-500971fe-f06b-4c78-af44-f61b389519f8" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 718.193580] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 19bc268b-f0c9-422e-8cf3-28e34f6fac61 with status ACTIVE [ 718.193752] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 718.193859] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 718.193920] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 718.194910] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 718.194910] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 718.194910] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 718.194910] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 718.194910] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 718.194910] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 718.194910] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 718.194910] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 718.195380] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 718.195380] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 718.195380] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 718.195380] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 718.195380] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 19bc268b-f0c9-422e-8cf3-28e34f6fac61 is going to be updated. [ 718.223377] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 718.223624] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 718.223685] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 718.223882] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 718.224039] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 718.224204] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-19bc268b-f0c9-422e-8cf3-28e34f6fac61" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 718.456052] env[65370]: DEBUG networking_nsxv3.common.locking [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Lock network-467 taken with stack trace [, , , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 718.456052] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquiring lock "network-467" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 718.456394] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquired lock "network-467" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 718.456464] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquired external semaphore "network-467" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 718.456731] env[65370]: DEBUG networking_nsxv3.common.locking [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 718.456978] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquiring lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 718.457090] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquired lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 718.457407] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquired external semaphore "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 718.457456] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Releasing lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 718.457623] env[65370]: DEBUG dogpile.cache.region [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] No value present for key: 'zone-id' {{(pid=65370) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 718.457729] env[65370]: DEBUG dogpile.lock [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] NeedRegenerationException {{(pid=65370) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 718.458181] env[65370]: DEBUG dogpile.lock [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] no value, waiting for create lock {{(pid=65370) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 718.458181] env[65370]: DEBUG dogpile.lock [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] value creation lock acquired {{(pid=65370) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 718.458181] env[65370]: DEBUG dogpile.cache.region [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] No value present for key: 'zone-id' {{(pid=65370) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 718.458181] env[65370]: DEBUG dogpile.lock [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Calling creation function for not-yet-present value {{(pid=65370) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 718.458376] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 718.462079] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5132c293-b680-4491-ba2b-122515a71eaf in Status: SUCCESS [ 718.462079] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5132c293-b680-4491-ba2b-122515a71eaf" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 718.464367] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5132c293-b680-4491-ba2b-122515a71eaf" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 718.464367] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5132c293-b680-4491-ba2b-122515a71eaf" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 718.464367] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 718.464367] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 718.464367] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 718.464367] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 718.464367] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 718.464367] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5132c293-b680-4491-ba2b-122515a71eaf',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 718.464995] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ab6d2881-75e8-4c26-9e66-c80d829d27df in Status: SUCCESS [ 718.466846] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ab6d2881-75e8-4c26-9e66-c80d829d27df" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 718.466846] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ab6d2881-75e8-4c26-9e66-c80d829d27df" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 718.466846] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ab6d2881-75e8-4c26-9e66-c80d829d27df" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 718.466846] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 718.466846] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 718.466846] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 718.466846] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 718.466846] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 718.466846] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ab6d2881-75e8-4c26-9e66-c80d829d27df',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 718.490078] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 718.490267] env[65370]: DEBUG dogpile.cache.region [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Cache value generated in 0.032 seconds for key(s): 'zone-id' {{(pid=65370) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 718.490394] env[65370]: DEBUG dogpile.lock [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Released creation lock {{(pid=65370) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 718.490551] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Releasing lock "network-467" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 718.490847] env[65370]: DEBUG networking_nsxv3.common.locking [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Lock port-6b4aa8ff-ca4a-42e9-b7d7-295d46059af3 taken with stack trace [, , , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 718.491014] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquiring lock "port-6b4aa8ff-ca4a-42e9-b7d7-295d46059af3" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 718.491131] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquired lock "port-6b4aa8ff-ca4a-42e9-b7d7-295d46059af3" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 718.491449] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquired external semaphore "port-6b4aa8ff-ca4a-42e9-b7d7-295d46059af3" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 718.491584] env[65370]: DEBUG networking_nsxv3.api.rpc [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6b4aa8ff-ca4a-42e9-b7d7-295d46059af3',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 718.592722] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 718.593088] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 718.593088] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 718.593181] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 718.593424] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 718.593506] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 718.593567] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 718.593608] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 718.593741] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 718.593814] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 718.593893] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 237e1a89-daff-4fd5-b02a-97e1d536d9bd already deleted. [ 718.593972] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-237e1a89-daff-4fd5-b02a-97e1d536d9bd" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 718.701384] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('14c6c739-bd84-4bc8-9d1c-9bc29741c32d',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 718.968113] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('5132c293-b680-4491-ba2b-122515a71eaf',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 718.969090] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('ab6d2881-75e8-4c26-9e66-c80d829d27df',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 718.994767] env[65370]: DEBUG networking_nsxv3.common.locking [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 718.994944] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquiring lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 718.995069] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquired lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 718.995443] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquired external semaphore "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 718.995613] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Releasing lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 718.995759] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Segment Port 6b4aa8ff-ca4a-42e9-b7d7-295d46059af3 not found, creating... [ 718.996070] env[65370]: DEBUG networking_nsxv3.common.locking [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 718.996205] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquiring lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 718.996321] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquired lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 718.996536] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquired external semaphore "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 718.996684] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Releasing lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 718.996964] env[65370]: DEBUG networking_nsxv3.common.locking [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 718.997124] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquiring lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 718.997233] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquired lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 718.997467] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquired external semaphore "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 718.997596] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Releasing lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 718.997726] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Resource: SegmentPort with ID: 6b4aa8ff-ca4a-42e9-b7d7-295d46059af3 is going to be created. [ 719.020375] env[65370]: DEBUG networking_nsxv3.common.locking [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 719.020589] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquiring lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 719.020686] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquired lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 719.020956] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquired external semaphore "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 719.021198] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Releasing lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 719.021479] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Releasing lock "port-6b4aa8ff-ca4a-42e9-b7d7-295d46059af3" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 719.204175] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 719.204385] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 719.204426] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 719.205028] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 719.205028] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 719.205028] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 14c6c739-bd84-4bc8-9d1c-9bc29741c32d is going to be created. [ 719.234855] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 719.235146] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 719.235146] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 719.235465] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 719.235753] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 719.248476] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 14c6c739-bd84-4bc8-9d1c-9bc29741c32d in Status: UNINITIALIZED for 2s [ 719.471727] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('5132c293-b680-4491-ba2b-122515a71eaf',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 719.472846] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('ab6d2881-75e8-4c26-9e66-c80d829d27df',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 719.620965] env[65370]: INFO networking_nsxv3.common.synchronization [None req-327b588a-b6ed-4692-b4a8-93c8af7be575 tempest-ServersTestFqdnHostnames-1392648948 tempest-ServersTestFqdnHostnames-1392648948-project-member] Enqueued Resource ID: 6f93689f-ae79-496c-bd6b-5fcec0a3824f with Priority: HIGHEST for action security_group_rules [ 719.620965] env[65370]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6f93689f-ae79-496c-bd6b-5fcec0a3824f with Priority: HIGHEST for action security_group_rules [ 719.621302] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock rules-6f93689f-ae79-496c-bd6b-5fcec0a3824f taken with stack trace [, , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 719.621302] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-6f93689f-ae79-496c-bd6b-5fcec0a3824f" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 719.621302] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-6f93689f-ae79-496c-bd6b-5fcec0a3824f" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 719.621491] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-6f93689f-ae79-496c-bd6b-5fcec0a3824f" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 719.621573] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('6f93689f-ae79-496c-bd6b-5fcec0a3824f',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 719.650979] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b8e66f81-0f32-48b8-b81f-542b74cbecd4 in Status: IN_PROGRESS for 4s [ 719.738302] env[65370]: INFO networking_nsxv3.common.synchronization [req-8fd966f2-9acf-456f-8bac-367759ddceab req-71f21371-f1a7-4bed-8204-c020aa669dba service nova] Enqueued Resource ID: 237e1a89-daff-4fd5-b02a-97e1d536d9bd with Priority: HIGHEST for action security_group_rules [ 719.738488] env[65370]: INFO networking_nsxv3.common.synchronization [req-8fd966f2-9acf-456f-8bac-367759ddceab req-71f21371-f1a7-4bed-8204-c020aa669dba service nova] Enqueued Resource ID: 237e1a89-daff-4fd5-b02a-97e1d536d9bd with Priority: HIGHEST for action security_group_members [ 719.738631] env[65370]: INFO networking_nsxv3.common.synchronization [req-8fd966f2-9acf-456f-8bac-367759ddceab req-71f21371-f1a7-4bed-8204-c020aa669dba service nova] Enqueued Resource ID: 6b4aa8ff-ca4a-42e9-b7d7-295d46059af3 with Priority: HIGHEST for action port [ 719.739223] env[65370]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 237e1a89-daff-4fd5-b02a-97e1d536d9bd with Priority: HIGHEST for action security_group_rules [ 719.739364] env[65370]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 237e1a89-daff-4fd5-b02a-97e1d536d9bd with Priority: HIGHEST for action security_group_members [ 719.740199] env[65370]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6b4aa8ff-ca4a-42e9-b7d7-295d46059af3 with Priority: HIGHEST for action port [ 719.741593] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock rules-237e1a89-daff-4fd5-b02a-97e1d536d9bd taken with stack trace [, , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 719.741593] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-237e1a89-daff-4fd5-b02a-97e1d536d9bd" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 719.741593] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-237e1a89-daff-4fd5-b02a-97e1d536d9bd" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 719.741593] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-237e1a89-daff-4fd5-b02a-97e1d536d9bd" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 719.742151] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('237e1a89-daff-4fd5-b02a-97e1d536d9bd',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 719.742658] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock member-237e1a89-daff-4fd5-b02a-97e1d536d9bd taken with stack trace [, , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 719.742796] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-237e1a89-daff-4fd5-b02a-97e1d536d9bd" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 719.742879] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-237e1a89-daff-4fd5-b02a-97e1d536d9bd" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 719.744093] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-237e1a89-daff-4fd5-b02a-97e1d536d9bd" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 719.744287] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 719.744514] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 719.744514] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 719.744634] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 719.744940] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 719.744940] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('237e1a89-daff-4fd5-b02a-97e1d536d9bd',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 719.745773] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock port-6b4aa8ff-ca4a-42e9-b7d7-295d46059af3 taken with stack trace [, , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 719.746049] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-6b4aa8ff-ca4a-42e9-b7d7-295d46059af3" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 719.746049] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-6b4aa8ff-ca4a-42e9-b7d7-295d46059af3" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 719.746304] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-6b4aa8ff-ca4a-42e9-b7d7-295d46059af3" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 719.746416] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6b4aa8ff-ca4a-42e9-b7d7-295d46059af3',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 719.800293] env[65370]: INFO networking_nsxv3.common.synchronization [None req-a234f744-74bd-49a6-b828-8f5b5c0691a7 tempest-ServersTestFqdnHostnames-1392648948 tempest-ServersTestFqdnHostnames-1392648948-project-member] Enqueued Resource ID: 6f93689f-ae79-496c-bd6b-5fcec0a3824f with Priority: HIGHEST for action security_group_rules [ 719.800293] env[65370]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6f93689f-ae79-496c-bd6b-5fcec0a3824f with Priority: HIGHEST for action security_group_rules [ 719.800293] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock rules-6f93689f-ae79-496c-bd6b-5fcec0a3824f taken with stack trace [, , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 719.800293] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-6f93689f-ae79-496c-bd6b-5fcec0a3824f" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 719.975522] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 719.975522] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 719.975522] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 719.975522] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 719.975522] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 719.975522] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5132c293-b680-4491-ba2b-122515a71eaf is going to be updated. [ 719.977147] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 719.977455] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 719.977455] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 719.977620] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 719.977698] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 719.977864] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ab6d2881-75e8-4c26-9e66-c80d829d27df is going to be updated. [ 719.992950] env[65370]: INFO networking_nsxv3.common.synchronization [None req-294dbb28-84e9-4daa-bf84-7e5c7f1cd24e None None] Enqueued Resource ID: fc31b456-9aba-42d2-afe5-a620a094837d with Priority: HIGHEST for action port [ 719.993528] env[65370]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fc31b456-9aba-42d2-afe5-a620a094837d with Priority: HIGHEST for action port [ 719.993895] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock port-fc31b456-9aba-42d2-afe5-a620a094837d taken with stack trace [, , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 719.994367] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-fc31b456-9aba-42d2-afe5-a620a094837d" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 719.994367] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-fc31b456-9aba-42d2-afe5-a620a094837d" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 719.996053] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-fc31b456-9aba-42d2-afe5-a620a094837d" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 719.996053] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('fc31b456-9aba-42d2-afe5-a620a094837d',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 720.009555] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 720.009705] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 720.010027] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 720.010027] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 720.010126] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 720.012158] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 720.012274] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 720.012342] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 720.012514] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 720.012643] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 720.023534] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5132c293-b680-4491-ba2b-122515a71eaf in Status: IN_PROGRESS for 2s [ 720.024148] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ab6d2881-75e8-4c26-9e66-c80d829d27df in Status: IN_PROGRESS for 2s [ 720.036087] env[65370]: INFO networking_nsxv3.common.synchronization [req-5ab12cd9-0347-49f4-8fb8-74a3e32e0050 req-efb9ea85-fe67-4760-89ed-47d32fc75357 tempest-ServerRescueTestJSONUnderV235-1438794252 tempest-ServerRescueTestJSONUnderV235-1438794252-project-member] Enqueued Resource ID: 5132c293-b680-4491-ba2b-122515a71eaf with Priority: HIGHEST for action security_group_members [ 720.036281] env[65370]: INFO networking_nsxv3.common.synchronization [req-5ab12cd9-0347-49f4-8fb8-74a3e32e0050 req-efb9ea85-fe67-4760-89ed-47d32fc75357 tempest-ServerRescueTestJSONUnderV235-1438794252 tempest-ServerRescueTestJSONUnderV235-1438794252-project-member] Enqueued Resource ID: ab6d2881-75e8-4c26-9e66-c80d829d27df with Priority: HIGHEST for action security_group_members [ 720.038661] env[65370]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5132c293-b680-4491-ba2b-122515a71eaf with Priority: HIGHEST for action security_group_members [ 720.038747] env[65370]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ab6d2881-75e8-4c26-9e66-c80d829d27df with Priority: HIGHEST for action security_group_members [ 720.039172] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock member-5132c293-b680-4491-ba2b-122515a71eaf taken with stack trace [, , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 720.039305] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5132c293-b680-4491-ba2b-122515a71eaf" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 720.039684] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock member-ab6d2881-75e8-4c26-9e66-c80d829d27df taken with stack trace [, , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 720.039773] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ab6d2881-75e8-4c26-9e66-c80d829d27df" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 720.091350] env[65370]: INFO networking_nsxv3.common.synchronization [req-5ab12cd9-0347-49f4-8fb8-74a3e32e0050 req-efb9ea85-fe67-4760-89ed-47d32fc75357 tempest-ServerRescueTestJSONUnderV235-1438794252 tempest-ServerRescueTestJSONUnderV235-1438794252-project-member] Enqueued Resource ID: 5132c293-b680-4491-ba2b-122515a71eaf with Priority: HIGHEST for action security_group_rules [ 720.091924] env[65370]: INFO networking_nsxv3.common.synchronization [req-5ab12cd9-0347-49f4-8fb8-74a3e32e0050 req-efb9ea85-fe67-4760-89ed-47d32fc75357 tempest-ServerRescueTestJSONUnderV235-1438794252 tempest-ServerRescueTestJSONUnderV235-1438794252-project-member] Enqueued Resource ID: 5132c293-b680-4491-ba2b-122515a71eaf with Priority: HIGHEST for action security_group_members [ 720.092171] env[65370]: INFO networking_nsxv3.common.synchronization [req-5ab12cd9-0347-49f4-8fb8-74a3e32e0050 req-efb9ea85-fe67-4760-89ed-47d32fc75357 tempest-ServerRescueTestJSONUnderV235-1438794252 tempest-ServerRescueTestJSONUnderV235-1438794252-project-member] Enqueued Resource ID: cfc2bf8b-b1ac-4f6d-bb6f-abcee630e229 with Priority: HIGHEST for action port [ 720.092834] env[65370]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5132c293-b680-4491-ba2b-122515a71eaf with Priority: HIGHEST for action security_group_rules [ 720.093085] env[65370]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5132c293-b680-4491-ba2b-122515a71eaf with Priority: HIGHEST for action security_group_members [ 720.093315] env[65370]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cfc2bf8b-b1ac-4f6d-bb6f-abcee630e229 with Priority: HIGHEST for action port [ 720.094017] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock rules-5132c293-b680-4491-ba2b-122515a71eaf taken with stack trace [, , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 720.094171] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-5132c293-b680-4491-ba2b-122515a71eaf" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 720.094409] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock member-5132c293-b680-4491-ba2b-122515a71eaf taken with stack trace [, , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 720.094522] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5132c293-b680-4491-ba2b-122515a71eaf" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 720.094735] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock port-cfc2bf8b-b1ac-4f6d-bb6f-abcee630e229 taken with stack trace [, , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 720.094932] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-cfc2bf8b-b1ac-4f6d-bb6f-abcee630e229" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 720.095025] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-cfc2bf8b-b1ac-4f6d-bb6f-abcee630e229" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 720.095297] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-cfc2bf8b-b1ac-4f6d-bb6f-abcee630e229" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 720.095565] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('cfc2bf8b-b1ac-4f6d-bb6f-abcee630e229',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 720.219829] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 720.219829] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 720.219829] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 720.219829] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 720.219829] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 720.219829] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 6f93689f-ae79-496c-bd6b-5fcec0a3824f already deleted. [ 720.219829] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-6f93689f-ae79-496c-bd6b-5fcec0a3824f" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 720.219829] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-6f93689f-ae79-496c-bd6b-5fcec0a3824f" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 720.219829] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-6f93689f-ae79-496c-bd6b-5fcec0a3824f" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 720.219829] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('6f93689f-ae79-496c-bd6b-5fcec0a3824f',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 720.248161] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('237e1a89-daff-4fd5-b02a-97e1d536d9bd',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 720.250165] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock member-237e1a89-daff-4fd5-b02a-97e1d536d9bd taken with stack trace [, , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 720.250165] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-237e1a89-daff-4fd5-b02a-97e1d536d9bd" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 720.250763] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 6b4aa8ff-ca4a-42e9-b7d7-295d46059af3 with status ACTIVE [ 720.250763] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 720.251072] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 720.251072] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 720.251272] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 720.251272] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 720.251480] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 720.251586] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 720.251645] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 720.251813] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 720.251895] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 720.252083] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 720.252177] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 720.252237] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 720.252376] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 720.252450] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 720.252533] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 6b4aa8ff-ca4a-42e9-b7d7-295d46059af3 is going to be updated. [ 720.277577] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 720.277781] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 720.277828] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 720.278041] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 720.278161] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 720.278321] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-6b4aa8ff-ca4a-42e9-b7d7-295d46059af3" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 720.497288] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port fc31b456-9aba-42d2-afe5-a620a094837d [ 720.498646] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 720.498646] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 720.498646] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 720.498646] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 720.498646] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 720.498646] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:fc31b456-9aba-42d2-afe5-a620a094837d already deleted. [ 720.498646] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-fc31b456-9aba-42d2-afe5-a620a094837d" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 720.598490] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port cfc2bf8b-b1ac-4f6d-bb6f-abcee630e229 with status ACTIVE [ 720.598643] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 720.598716] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 720.598716] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 720.599115] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 720.599115] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 720.599303] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 720.599303] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 720.599382] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 720.599668] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 720.599668] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 720.599760] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 720.601116] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 720.601116] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 720.601116] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 720.601116] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 720.601116] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: cfc2bf8b-b1ac-4f6d-bb6f-abcee630e229 is going to be updated. [ 720.626719] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 720.627130] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 720.627130] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 720.627201] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 720.627317] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 720.627542] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-cfc2bf8b-b1ac-4f6d-bb6f-abcee630e229" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 720.730096] env[65370]: INFO networking_nsxv3.common.synchronization [req-7d91b6c1-9c08-4e8d-a1ec-c10b1ec25daf req-1deaa397-7be1-45f7-b97c-a656cb665e62 tempest-ServerActionsTestOtherA-1239332614 tempest-ServerActionsTestOtherA-1239332614-project-member] Enqueued Resource ID: b7074d70-d8cb-411f-b8c4-a4007dfd74f8 with Priority: HIGHEST for action security_group_members [ 720.731813] env[65370]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b7074d70-d8cb-411f-b8c4-a4007dfd74f8 with Priority: HIGHEST for action security_group_members [ 720.731813] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock member-b7074d70-d8cb-411f-b8c4-a4007dfd74f8 taken with stack trace [, , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 720.731813] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b7074d70-d8cb-411f-b8c4-a4007dfd74f8" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 720.731813] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b7074d70-d8cb-411f-b8c4-a4007dfd74f8" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 720.731813] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b7074d70-d8cb-411f-b8c4-a4007dfd74f8" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 720.731813] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 720.732225] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 720.732225] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 720.732699] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 720.732699] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 720.732699] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b7074d70-d8cb-411f-b8c4-a4007dfd74f8',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 720.751531] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('237e1a89-daff-4fd5-b02a-97e1d536d9bd',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 720.755181] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 720.755181] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 720.755181] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 720.755181] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 720.755181] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 720.755181] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 6f93689f-ae79-496c-bd6b-5fcec0a3824f already deleted. [ 720.755181] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-6f93689f-ae79-496c-bd6b-5fcec0a3824f" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 721.235122] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 721.235309] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 721.235369] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 721.235633] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 721.235733] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 721.235934] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 721.236109] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 721.236109] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 721.236312] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 721.236397] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 721.236481] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b7074d70-d8cb-411f-b8c4-a4007dfd74f8 already deleted. [ 721.236563] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b7074d70-d8cb-411f-b8c4-a4007dfd74f8" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 721.256560] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 721.257445] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 721.257445] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 721.257445] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 721.257445] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 721.257632] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 237e1a89-daff-4fd5-b02a-97e1d536d9bd is going to be created. [ 721.265756] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 14c6c739-bd84-4bc8-9d1c-9bc29741c32d in Status: SUCCESS [ 721.265756] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-14c6c739-bd84-4bc8-9d1c-9bc29741c32d" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 721.265756] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-14c6c739-bd84-4bc8-9d1c-9bc29741c32d" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 721.265756] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-14c6c739-bd84-4bc8-9d1c-9bc29741c32d" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 721.265756] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 721.265756] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 721.265756] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 721.265756] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 721.265756] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 721.265756] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-14c6c739-bd84-4bc8-9d1c-9bc29741c32d" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 721.265756] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('14c6c739-bd84-4bc8-9d1c-9bc29741c32d',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 721.287279] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 721.287279] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 721.287279] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 721.287279] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 721.287279] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 721.299434] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 237e1a89-daff-4fd5-b02a-97e1d536d9bd in Status: UNINITIALIZED for 2s [ 721.425533] env[65370]: DEBUG networking_nsxv3.common.locking [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Lock network-865 taken with stack trace [, , , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 721.425731] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquiring lock "network-865" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 721.425883] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquired lock "network-865" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 721.426297] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquired external semaphore "network-865" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 721.426649] env[65370]: DEBUG networking_nsxv3.common.locking [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 721.426867] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquiring lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 721.427051] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquired lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 721.427306] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquired external semaphore "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 721.427505] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Releasing lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 721.427759] env[65370]: DEBUG dogpile.cache.region [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] No value present for key: 'zone-id' {{(pid=65370) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 721.427995] env[65370]: DEBUG dogpile.lock [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] NeedRegenerationException {{(pid=65370) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 721.428176] env[65370]: DEBUG dogpile.lock [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] no value, waiting for create lock {{(pid=65370) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 721.428338] env[65370]: DEBUG dogpile.lock [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] value creation lock acquired {{(pid=65370) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 721.428517] env[65370]: DEBUG dogpile.cache.region [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] No value present for key: 'zone-id' {{(pid=65370) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 721.428651] env[65370]: DEBUG dogpile.lock [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Calling creation function for not-yet-present value {{(pid=65370) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 721.428836] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 721.450385] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 721.450385] env[65370]: DEBUG dogpile.cache.region [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=65370) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 721.450385] env[65370]: DEBUG dogpile.lock [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Released creation lock {{(pid=65370) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 721.450385] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Releasing lock "network-865" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 721.450385] env[65370]: DEBUG networking_nsxv3.common.locking [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Lock port-d51f959a-25e2-4322-9a41-21fb251c1e74 taken with stack trace [, , , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 721.450611] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquiring lock "port-d51f959a-25e2-4322-9a41-21fb251c1e74" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 721.450674] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquired lock "port-d51f959a-25e2-4322-9a41-21fb251c1e74" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 721.451033] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquired external semaphore "port-d51f959a-25e2-4322-9a41-21fb251c1e74" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 721.451223] env[65370]: DEBUG networking_nsxv3.api.rpc [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d51f959a-25e2-4322-9a41-21fb251c1e74',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 721.663781] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b8e66f81-0f32-48b8-b81f-542b74cbecd4 in Status: SUCCESS [ 721.664119] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b8e66f81-0f32-48b8-b81f-542b74cbecd4" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 721.664299] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b8e66f81-0f32-48b8-b81f-542b74cbecd4" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 721.664587] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b8e66f81-0f32-48b8-b81f-542b74cbecd4" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 721.664812] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 721.664934] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 721.665102] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 721.665266] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 721.665362] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 721.665454] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b8e66f81-0f32-48b8-b81f-542b74cbecd4" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 721.665580] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('b8e66f81-0f32-48b8-b81f-542b74cbecd4',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 721.769180] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock member-14c6c739-bd84-4bc8-9d1c-9bc29741c32d taken with stack trace [, , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 721.769400] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-14c6c739-bd84-4bc8-9d1c-9bc29741c32d" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 721.769400] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-14c6c739-bd84-4bc8-9d1c-9bc29741c32d" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 721.769596] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-14c6c739-bd84-4bc8-9d1c-9bc29741c32d" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 721.769814] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 721.769946] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 721.770024] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 721.770434] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 721.770434] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 721.770434] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-14c6c739-bd84-4bc8-9d1c-9bc29741c32d" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 721.770576] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock member-14c6c739-bd84-4bc8-9d1c-9bc29741c32d taken with stack trace [, , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 721.770678] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-14c6c739-bd84-4bc8-9d1c-9bc29741c32d" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 721.770740] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-14c6c739-bd84-4bc8-9d1c-9bc29741c32d" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 721.770889] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-14c6c739-bd84-4bc8-9d1c-9bc29741c32d" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 721.771043] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 721.771157] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 721.771284] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 721.771476] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 721.771898] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 721.772069] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-14c6c739-bd84-4bc8-9d1c-9bc29741c32d" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 721.772235] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('14c6c739-bd84-4bc8-9d1c-9bc29741c32d',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 721.953948] env[65370]: DEBUG networking_nsxv3.common.locking [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 721.954174] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquiring lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 721.954400] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquired lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 721.954662] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquired external semaphore "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 721.954843] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Releasing lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 721.954968] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Segment Port d51f959a-25e2-4322-9a41-21fb251c1e74 not found, creating... [ 721.955268] env[65370]: DEBUG networking_nsxv3.common.locking [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 721.955436] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquiring lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 721.955547] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquired lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 721.955760] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquired external semaphore "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 721.955889] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Releasing lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 721.956507] env[65370]: DEBUG networking_nsxv3.common.locking [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 721.956692] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquiring lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 721.956806] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquired lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 721.957028] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquired external semaphore "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 721.957160] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Releasing lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 721.957293] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Resource: SegmentPort with ID: d51f959a-25e2-4322-9a41-21fb251c1e74 is going to be created. [ 721.979238] env[65370]: DEBUG networking_nsxv3.common.locking [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 721.979461] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquiring lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 721.979580] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquired lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 721.979850] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquired external semaphore "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 721.980130] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Releasing lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 721.980365] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Releasing lock "port-d51f959a-25e2-4322-9a41-21fb251c1e74" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 722.035841] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5132c293-b680-4491-ba2b-122515a71eaf in Status: SUCCESS [ 722.036151] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5132c293-b680-4491-ba2b-122515a71eaf" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 722.036342] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5132c293-b680-4491-ba2b-122515a71eaf" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 722.036633] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5132c293-b680-4491-ba2b-122515a71eaf" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 722.037360] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 722.037360] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 722.037360] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 722.037360] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 722.037577] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 722.037577] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5132c293-b680-4491-ba2b-122515a71eaf" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 722.037693] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('5132c293-b680-4491-ba2b-122515a71eaf',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 722.039252] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ab6d2881-75e8-4c26-9e66-c80d829d27df in Status: SUCCESS [ 722.039807] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ab6d2881-75e8-4c26-9e66-c80d829d27df" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 722.039807] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5132c293-b680-4491-ba2b-122515a71eaf" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 722.039936] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5132c293-b680-4491-ba2b-122515a71eaf" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 722.040218] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 722.040218] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 722.040322] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 722.040843] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 722.040843] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 722.040843] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5132c293-b680-4491-ba2b-122515a71eaf',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 722.041729] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ab6d2881-75e8-4c26-9e66-c80d829d27df" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 722.041729] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ab6d2881-75e8-4c26-9e66-c80d829d27df" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 722.041863] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 722.041955] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 722.042051] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 722.042245] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 722.042613] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 722.042613] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ab6d2881-75e8-4c26-9e66-c80d829d27df" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 722.042613] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('ab6d2881-75e8-4c26-9e66-c80d829d27df',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 722.043550] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ab6d2881-75e8-4c26-9e66-c80d829d27df" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 722.043742] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ab6d2881-75e8-4c26-9e66-c80d829d27df" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 722.043855] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 722.043956] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 722.044066] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 722.044170] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 722.044263] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 722.044379] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ab6d2881-75e8-4c26-9e66-c80d829d27df',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 722.170454] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('b8e66f81-0f32-48b8-b81f-542b74cbecd4',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 722.275780] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 14c6c739-bd84-4bc8-9d1c-9bc29741c32d: rpc.has_security_group_logging(os_id): False [ 722.297170] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 722.297392] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 722.297440] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 722.297653] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 722.297806] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 722.298039] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 722.298393] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 722.298393] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 722.298393] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 722.298541] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 722.298669] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 722.298777] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 722.298834] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 722.298983] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 722.299082] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 722.299276] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 722.299366] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 722.299425] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 722.299587] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 722.299675] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 722.299771] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 14c6c739-bd84-4bc8-9d1c-9bc29741c32d is going to be created. [ 722.360763] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 722.360932] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 722.361026] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 722.361578] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 722.361578] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 722.377089] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 14c6c739-bd84-4bc8-9d1c-9bc29741c32d in Status: IN_PROGRESS for 2s [ 722.544724] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock member-5132c293-b680-4491-ba2b-122515a71eaf taken with stack trace [, , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 722.544915] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5132c293-b680-4491-ba2b-122515a71eaf" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 722.545802] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('5132c293-b680-4491-ba2b-122515a71eaf',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 722.546196] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('ab6d2881-75e8-4c26-9e66-c80d829d27df',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 722.547109] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 722.547256] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 722.547339] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 722.547554] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 722.550220] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 722.550220] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 722.550220] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 722.550220] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 722.553115] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 722.553115] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 722.553115] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ab6d2881-75e8-4c26-9e66-c80d829d27df is going to be deleted. [ 722.633706] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 722.633900] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 722.633969] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 722.634150] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 722.634247] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 722.634438] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ab6d2881-75e8-4c26-9e66-c80d829d27df" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 722.675249] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for b8e66f81-0f32-48b8-b81f-542b74cbecd4: rpc.has_security_group_logging(os_id): False [ 722.699574] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 722.699574] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 722.702786] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 722.702786] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 722.702786] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 722.702786] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 722.702786] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 722.702786] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 722.703749] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 722.704644] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 722.704773] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: b8e66f81-0f32-48b8-b81f-542b74cbecd4 is going to be updated. [ 722.791739] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 722.791926] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 722.792043] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 722.792270] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 722.792704] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 722.807916] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b8e66f81-0f32-48b8-b81f-542b74cbecd4 in Status: IN_PROGRESS for 2s [ 722.916268] env[65370]: INFO networking_nsxv3.common.synchronization [req-7d91b6c1-9c08-4e8d-a1ec-c10b1ec25daf req-01865cbe-9582-4577-bb4d-b8ec6ca5e722 service nova] Enqueued Resource ID: b7074d70-d8cb-411f-b8c4-a4007dfd74f8 with Priority: HIGHEST for action security_group_rules [ 722.916750] env[65370]: INFO networking_nsxv3.common.synchronization [req-7d91b6c1-9c08-4e8d-a1ec-c10b1ec25daf req-01865cbe-9582-4577-bb4d-b8ec6ca5e722 service nova] Enqueued Resource ID: b7074d70-d8cb-411f-b8c4-a4007dfd74f8 with Priority: HIGHEST for action security_group_members [ 722.916750] env[65370]: INFO networking_nsxv3.common.synchronization [req-7d91b6c1-9c08-4e8d-a1ec-c10b1ec25daf req-01865cbe-9582-4577-bb4d-b8ec6ca5e722 service nova] Enqueued Resource ID: d51f959a-25e2-4322-9a41-21fb251c1e74 with Priority: HIGHEST for action port [ 722.918539] env[65370]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b7074d70-d8cb-411f-b8c4-a4007dfd74f8 with Priority: HIGHEST for action security_group_rules [ 722.918703] env[65370]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b7074d70-d8cb-411f-b8c4-a4007dfd74f8 with Priority: HIGHEST for action security_group_members [ 722.918803] env[65370]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d51f959a-25e2-4322-9a41-21fb251c1e74 with Priority: HIGHEST for action port [ 722.919209] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock rules-b7074d70-d8cb-411f-b8c4-a4007dfd74f8 taken with stack trace [, , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 722.919370] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-b7074d70-d8cb-411f-b8c4-a4007dfd74f8" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 722.919442] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-b7074d70-d8cb-411f-b8c4-a4007dfd74f8" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 722.919762] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-b7074d70-d8cb-411f-b8c4-a4007dfd74f8" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 722.919927] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('b7074d70-d8cb-411f-b8c4-a4007dfd74f8',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 722.920873] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock member-b7074d70-d8cb-411f-b8c4-a4007dfd74f8 taken with stack trace [, , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 722.921020] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b7074d70-d8cb-411f-b8c4-a4007dfd74f8" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 722.921080] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b7074d70-d8cb-411f-b8c4-a4007dfd74f8" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 722.921256] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b7074d70-d8cb-411f-b8c4-a4007dfd74f8" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 722.924695] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 722.924695] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 722.924695] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 722.924695] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 722.924695] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 722.924910] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b7074d70-d8cb-411f-b8c4-a4007dfd74f8',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 722.926474] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock port-d51f959a-25e2-4322-9a41-21fb251c1e74 taken with stack trace [, , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 722.926474] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-d51f959a-25e2-4322-9a41-21fb251c1e74" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 722.926644] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-d51f959a-25e2-4322-9a41-21fb251c1e74" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 722.926758] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-d51f959a-25e2-4322-9a41-21fb251c1e74" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 722.926821] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d51f959a-25e2-4322-9a41-21fb251c1e74',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 723.054747] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for ab6d2881-75e8-4c26-9e66-c80d829d27df: rpc.has_security_group_logging(os_id): False [ 723.056105] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('5132c293-b680-4491-ba2b-122515a71eaf',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 723.079498] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 723.079696] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 723.079696] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 723.079933] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 723.080044] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 723.080290] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 723.080533] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 723.080533] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 723.080651] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 723.080682] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 723.080763] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: ab6d2881-75e8-4c26-9e66-c80d829d27df is going to be created. [ 723.106449] env[65370]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [-] Warning Code=404 Message=b'{\n "httpStatus" : "NOT_FOUND",\n "error_code" : 500232,\n "module_name" : "Policy",\n "error_message" : "Following dependent objects, used in path=[/infra/domains/default/security-policies/ab6d2881-75e8-4c26-9e66-c80d829d27df], does not exist path=[/infra/domains/default/groups/ab6d2881-75e8-4c26-9e66-c80d829d27df]."\n}' [ 723.106623] env[65370]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: ab6d2881-75e8-4c26-9e66-c80d829d27df failed to be updated, retrying after metadata refresh: requests.exceptions.HTTPError: 404 Client Error: Not Found for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/policy/api/v1/infra/domains/default/security-policies/ab6d2881-75e8-4c26-9e66-c80d829d27df [ 723.106762] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules). [ 723.141802] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 723.141969] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 723.142029] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 723.142382] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 723.144337] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 723.144840] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 723.144840] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 723.144840] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 723.145131] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 723.145259] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 723.147078] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 723.147078] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 723.147078] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 723.147078] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 723.147078] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 723.147078] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: ab6d2881-75e8-4c26-9e66-c80d829d27df is going to be created. [ 723.173176] env[65370]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [-] Warning Code=404 Message=b'{\n "httpStatus" : "NOT_FOUND",\n "error_code" : 500232,\n "module_name" : "Policy",\n "error_message" : "Following dependent objects, used in path=[/infra/domains/default/security-policies/ab6d2881-75e8-4c26-9e66-c80d829d27df], does not exist path=[/infra/domains/default/groups/ab6d2881-75e8-4c26-9e66-c80d829d27df]."\n}': requests.exceptions.HTTPError: 404 Client Error: Not Found for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/policy/api/v1/infra/domains/default/security-policies/ab6d2881-75e8-4c26-9e66-c80d829d27df [ 723.174568] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-ab6d2881-75e8-4c26-9e66-c80d829d27df" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 723.174568] env[65370]: Traceback (most recent call last): [ 723.174568] env[65370]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py", line 36, in wrapper [ 723.174568] env[65370]: return func(*args, **kwargs) [ 723.174568] env[65370]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py", line 786, in _realize [ 723.174568] env[65370]: res.raise_for_status() [ 723.174568] env[65370]: File "/opt/stack/data/venv/lib/python3.10/site-packages/requests/models.py", line 1026, in raise_for_status [ 723.174568] env[65370]: raise HTTPError(http_error_msg, response=self) [ 723.174568] env[65370]: requests.exceptions.HTTPError: 404 Client Error: Not Found for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/policy/api/v1/infra/domains/default/security-policies/ab6d2881-75e8-4c26-9e66-c80d829d27df [ 723.174568] env[65370]: During handling of the above exception, another exception occurred: [ 723.174568] env[65370]: Traceback (most recent call last): [ 723.174568] env[65370]: File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/hubs/poll.py", line 111, in wait [ 723.174568] env[65370]: listener.cb(fileno) [ 723.174568] env[65370]: File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py", line 272, in main [ 723.174568] env[65370]: result = function(*args, **kwargs) [ 723.174568] env[65370]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py", line 210, in security_group_rules [ 723.174568] env[65370]: self.nsx_provider.sg_rules_realize(os_sg, logged=logged) [ 723.174568] env[65370]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py", line 1012, in sg_rules_realize [ 723.174568] env[65370]: return self._realize(Provider.SG_RULES, delete, self.payload.sg_rules_container, os_sg, provider_sg) [ 723.174568] env[65370]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py", line 45, in wrapper [ 723.174568] env[65370]: return func(self, resource_type, delete, self.payload.sg_rules_container, os_obj, provider_sg) [ 723.174568] env[65370]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py", line 786, in _realize [ 723.174568] env[65370]: res.raise_for_status() [ 723.174568] env[65370]: File "/opt/stack/data/venv/lib/python3.10/site-packages/requests/models.py", line 1026, in raise_for_status [ 723.174568] env[65370]: raise HTTPError(http_error_msg, response=self) [ 723.174568] env[65370]: requests.exceptions.HTTPError: 404 Client Error: Not Found for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/policy/api/v1/infra/domains/default/security-policies/ab6d2881-75e8-4c26-9e66-c80d829d27df [ 723.174568] env[65370]: Removing descriptor: 18 [ 723.312722] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 237e1a89-daff-4fd5-b02a-97e1d536d9bd in Status: SUCCESS [ 723.313327] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-237e1a89-daff-4fd5-b02a-97e1d536d9bd" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 723.313520] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-237e1a89-daff-4fd5-b02a-97e1d536d9bd" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 723.313754] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-237e1a89-daff-4fd5-b02a-97e1d536d9bd" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 723.313949] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 723.314126] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 723.314586] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 723.314586] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 723.314586] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 723.314763] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-237e1a89-daff-4fd5-b02a-97e1d536d9bd" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 723.314763] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('237e1a89-daff-4fd5-b02a-97e1d536d9bd',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 723.389249] env[65370]: INFO networking_nsxv3.common.synchronization [req-9e121e94-023f-4a3c-b5ee-106e519a8cbf req-a27afa95-f5f2-4176-8058-06cfef348668 tempest-ServerRescueNegativeTestJSON-807527939 tempest-ServerRescueNegativeTestJSON-807527939-project-member] Enqueued Resource ID: 237e1a89-daff-4fd5-b02a-97e1d536d9bd with Priority: HIGHEST for action security_group_members [ 723.389717] env[65370]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 237e1a89-daff-4fd5-b02a-97e1d536d9bd with Priority: HIGHEST for action security_group_members [ 723.389839] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock member-237e1a89-daff-4fd5-b02a-97e1d536d9bd taken with stack trace [, , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 723.389972] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-237e1a89-daff-4fd5-b02a-97e1d536d9bd" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 723.390248] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-237e1a89-daff-4fd5-b02a-97e1d536d9bd" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 723.390476] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-237e1a89-daff-4fd5-b02a-97e1d536d9bd" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 723.390700] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 723.390869] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 723.390869] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 723.390958] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 723.390986] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 723.391095] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('237e1a89-daff-4fd5-b02a-97e1d536d9bd',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 723.428813] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock member-b7074d70-d8cb-411f-b8c4-a4007dfd74f8 taken with stack trace [, , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 723.428956] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b7074d70-d8cb-411f-b8c4-a4007dfd74f8" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 723.429140] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('b7074d70-d8cb-411f-b8c4-a4007dfd74f8',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 723.430043] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port d51f959a-25e2-4322-9a41-21fb251c1e74 with status ACTIVE [ 723.430365] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 723.431190] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 723.431190] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 723.431190] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 723.431190] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 723.431190] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 723.431444] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 723.431444] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 723.431508] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 723.431667] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 723.431763] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 723.431857] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 723.431917] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 723.432092] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 723.432170] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 723.432254] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: d51f959a-25e2-4322-9a41-21fb251c1e74 is going to be updated. [ 723.469790] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 723.469926] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 723.469963] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 723.470203] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 723.470338] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 723.470497] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-d51f959a-25e2-4322-9a41-21fb251c1e74" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 723.563980] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 723.563980] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 723.564256] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 723.564627] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 723.564833] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 723.565149] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5132c293-b680-4491-ba2b-122515a71eaf is going to be updated. [ 723.629188] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 723.629188] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 723.629188] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 723.629188] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 723.629461] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 723.645508] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5132c293-b680-4491-ba2b-122515a71eaf in Status: IN_PROGRESS for 2s [ 723.794662] env[65370]: DEBUG networking_nsxv3.common.locking [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Lock network-467 taken with stack trace [, , , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 723.795028] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquiring lock "network-467" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 723.795107] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquired lock "network-467" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 723.796066] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquired external semaphore "network-467" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 723.796066] env[65370]: DEBUG networking_nsxv3.common.locking [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 723.796066] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquiring lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 723.796319] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquired lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 723.796612] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquired external semaphore "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 723.796807] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Releasing lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 723.797097] env[65370]: DEBUG dogpile.cache.region [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] No value present for key: 'zone-id' {{(pid=65370) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 723.797218] env[65370]: DEBUG dogpile.lock [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] NeedRegenerationException {{(pid=65370) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 723.797322] env[65370]: DEBUG dogpile.lock [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] no value, waiting for create lock {{(pid=65370) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 723.797421] env[65370]: DEBUG dogpile.lock [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] value creation lock acquired {{(pid=65370) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 723.797653] env[65370]: DEBUG dogpile.cache.region [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] No value present for key: 'zone-id' {{(pid=65370) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 723.797686] env[65370]: DEBUG dogpile.lock [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Calling creation function for not-yet-present value {{(pid=65370) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 723.797842] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 723.818413] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock member-237e1a89-daff-4fd5-b02a-97e1d536d9bd taken with stack trace [, , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 723.818541] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-237e1a89-daff-4fd5-b02a-97e1d536d9bd" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 723.822234] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 723.822398] env[65370]: DEBUG dogpile.cache.region [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Cache value generated in 0.025 seconds for key(s): 'zone-id' {{(pid=65370) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 723.822529] env[65370]: DEBUG dogpile.lock [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Released creation lock {{(pid=65370) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 723.822704] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Releasing lock "network-467" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 723.823045] env[65370]: DEBUG networking_nsxv3.common.locking [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Lock port-a2f67a76-1428-42cb-914c-333c3800e47e taken with stack trace [, , , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 723.823199] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquiring lock "port-a2f67a76-1428-42cb-914c-333c3800e47e" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 723.823314] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquired lock "port-a2f67a76-1428-42cb-914c-333c3800e47e" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 723.823666] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquired external semaphore "port-a2f67a76-1428-42cb-914c-333c3800e47e" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 723.823796] env[65370]: DEBUG networking_nsxv3.api.rpc [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a2f67a76-1428-42cb-914c-333c3800e47e',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 723.894966] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('237e1a89-daff-4fd5-b02a-97e1d536d9bd',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 723.934925] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('b7074d70-d8cb-411f-b8c4-a4007dfd74f8',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 724.044152] env[65370]: INFO networking_nsxv3.common.synchronization [req-94d33d92-6def-4375-b840-479cc2e5da40 req-bd076d48-e1b7-4552-86ea-81e30820bf63 tempest-ImagesOneServerNegativeTestJSON-1384686973 tempest-ImagesOneServerNegativeTestJSON-1384686973-project-member] Enqueued Resource ID: e2790d7c-6d0c-45bc-84d1-8cb00d26b9b0 with Priority: HIGHEST for action security_group_members [ 724.044644] env[65370]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e2790d7c-6d0c-45bc-84d1-8cb00d26b9b0 with Priority: HIGHEST for action security_group_members [ 724.045055] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock member-e2790d7c-6d0c-45bc-84d1-8cb00d26b9b0 taken with stack trace [, , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 724.045178] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e2790d7c-6d0c-45bc-84d1-8cb00d26b9b0" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 724.045227] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e2790d7c-6d0c-45bc-84d1-8cb00d26b9b0" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 724.045798] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e2790d7c-6d0c-45bc-84d1-8cb00d26b9b0" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 724.045798] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 724.045798] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 724.045798] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 724.045985] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 724.045985] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 724.046058] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e2790d7c-6d0c-45bc-84d1-8cb00d26b9b0',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 724.326547] env[65370]: DEBUG networking_nsxv3.common.locking [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 724.326765] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquiring lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 724.326872] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquired lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 724.327166] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquired external semaphore "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 724.327309] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Releasing lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 724.327466] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Segment Port a2f67a76-1428-42cb-914c-333c3800e47e not found, creating... [ 724.327703] env[65370]: DEBUG networking_nsxv3.common.locking [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 724.327852] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquiring lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 724.327964] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquired lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 724.328196] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquired external semaphore "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 724.328318] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Releasing lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 724.328900] env[65370]: DEBUG networking_nsxv3.common.locking [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 724.328900] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquiring lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 724.328900] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquired lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 724.329232] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquired external semaphore "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 724.329692] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Releasing lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 724.329692] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Resource: SegmentPort with ID: a2f67a76-1428-42cb-914c-333c3800e47e is going to be created. [ 724.361161] env[65370]: DEBUG networking_nsxv3.common.locking [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 724.361997] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquiring lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 724.361997] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquired lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 724.361997] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquired external semaphore "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 724.362148] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Releasing lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 724.362377] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Releasing lock "port-a2f67a76-1428-42cb-914c-333c3800e47e" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 724.392117] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 14c6c739-bd84-4bc8-9d1c-9bc29741c32d in Status: SUCCESS [ 724.392254] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-14c6c739-bd84-4bc8-9d1c-9bc29741c32d" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 724.395730] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('237e1a89-daff-4fd5-b02a-97e1d536d9bd',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 724.439883] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 724.440092] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 724.440133] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 724.441291] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 724.441642] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 724.441642] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b7074d70-d8cb-411f-b8c4-a4007dfd74f8 is going to be created. [ 724.470941] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 724.471105] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 724.471201] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 724.471528] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 724.471692] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 724.489588] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b7074d70-d8cb-411f-b8c4-a4007dfd74f8 in Status: UNINITIALIZED for 2s [ 724.547887] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 724.548087] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 724.548087] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 724.548701] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 724.569964] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 724.570361] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 724.570541] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 724.570614] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 724.570819] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 724.570902] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 724.570992] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e2790d7c-6d0c-45bc-84d1-8cb00d26b9b0 is going to be updated. [ 724.604162] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 724.604162] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 724.604162] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 724.604162] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 724.604162] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 724.614455] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e2790d7c-6d0c-45bc-84d1-8cb00d26b9b0 in Status: IN_PROGRESS for 2s [ 724.826182] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b8e66f81-0f32-48b8-b81f-542b74cbecd4 in Status: SUCCESS [ 724.826520] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-b8e66f81-0f32-48b8-b81f-542b74cbecd4" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 724.898866] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 724.899063] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 724.899151] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 724.899370] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 724.899506] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 724.899645] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 237e1a89-daff-4fd5-b02a-97e1d536d9bd is going to be updated. [ 724.933368] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 724.933589] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 724.933667] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 724.933833] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 724.933982] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 724.946538] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 237e1a89-daff-4fd5-b02a-97e1d536d9bd in Status: IN_PROGRESS for 2s [ 725.172038] env[65370]: INFO networking_nsxv3.common.synchronization [req-9e121e94-023f-4a3c-b5ee-106e519a8cbf req-e96f1200-ff54-4aad-adff-925de6990f13 service nova] Enqueued Resource ID: 237e1a89-daff-4fd5-b02a-97e1d536d9bd with Priority: HIGHEST for action security_group_rules [ 725.172235] env[65370]: INFO networking_nsxv3.common.synchronization [req-9e121e94-023f-4a3c-b5ee-106e519a8cbf req-e96f1200-ff54-4aad-adff-925de6990f13 service nova] Enqueued Resource ID: 237e1a89-daff-4fd5-b02a-97e1d536d9bd with Priority: HIGHEST for action security_group_members [ 725.172352] env[65370]: INFO networking_nsxv3.common.synchronization [req-9e121e94-023f-4a3c-b5ee-106e519a8cbf req-e96f1200-ff54-4aad-adff-925de6990f13 service nova] Enqueued Resource ID: a2f67a76-1428-42cb-914c-333c3800e47e with Priority: HIGHEST for action port [ 725.172858] env[65370]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 237e1a89-daff-4fd5-b02a-97e1d536d9bd with Priority: HIGHEST for action security_group_rules [ 725.172990] env[65370]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 237e1a89-daff-4fd5-b02a-97e1d536d9bd with Priority: HIGHEST for action security_group_members [ 725.173119] env[65370]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a2f67a76-1428-42cb-914c-333c3800e47e with Priority: HIGHEST for action port [ 725.173438] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock rules-237e1a89-daff-4fd5-b02a-97e1d536d9bd taken with stack trace [, , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 725.173498] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-237e1a89-daff-4fd5-b02a-97e1d536d9bd" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 725.173662] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock member-237e1a89-daff-4fd5-b02a-97e1d536d9bd taken with stack trace [, , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 725.173760] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-237e1a89-daff-4fd5-b02a-97e1d536d9bd" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 725.173882] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock port-a2f67a76-1428-42cb-914c-333c3800e47e taken with stack trace [, , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 725.173977] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-a2f67a76-1428-42cb-914c-333c3800e47e" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 725.175648] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-a2f67a76-1428-42cb-914c-333c3800e47e" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 725.175913] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-a2f67a76-1428-42cb-914c-333c3800e47e" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 725.175991] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a2f67a76-1428-42cb-914c-333c3800e47e',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 725.658475] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5132c293-b680-4491-ba2b-122515a71eaf in Status: IN_PROGRESS for 4s [ 725.682145] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port a2f67a76-1428-42cb-914c-333c3800e47e with status ACTIVE [ 725.682563] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 725.682563] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 725.682702] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 725.682805] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 725.682913] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 725.683260] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 725.683760] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 725.683760] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 725.683760] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 725.683760] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 725.683915] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 725.683963] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 725.683991] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 725.684133] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 725.684310] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 725.684310] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: a2f67a76-1428-42cb-914c-333c3800e47e is going to be updated. [ 725.742151] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 725.742239] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 725.742422] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 725.742825] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 725.746692] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 725.746692] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-a2f67a76-1428-42cb-914c-333c3800e47e" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 726.160561] env[65370]: INFO networking_nsxv3.common.synchronization [req-6a40ac6c-0653-4e9f-afef-592ec6e6ae53 req-d989f419-7c44-417a-80cc-68bc28c6cbf0 tempest-DeleteServersTestJSON-1160924027 tempest-DeleteServersTestJSON-1160924027-project-member] Enqueued Resource ID: 1eaa763e-4469-4428-92d0-ba20a6c99edc with Priority: HIGHEST for action security_group_members [ 726.161143] env[65370]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1eaa763e-4469-4428-92d0-ba20a6c99edc with Priority: HIGHEST for action security_group_members [ 726.161479] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock member-1eaa763e-4469-4428-92d0-ba20a6c99edc taken with stack trace [, , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 726.161596] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1eaa763e-4469-4428-92d0-ba20a6c99edc" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 726.161657] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1eaa763e-4469-4428-92d0-ba20a6c99edc" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 726.161846] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1eaa763e-4469-4428-92d0-ba20a6c99edc" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 726.161983] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 726.162791] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 726.163565] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 726.163565] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 726.163565] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 726.163565] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1eaa763e-4469-4428-92d0-ba20a6c99edc',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 726.501485] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b7074d70-d8cb-411f-b8c4-a4007dfd74f8 in Status: SUCCESS [ 726.501714] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b7074d70-d8cb-411f-b8c4-a4007dfd74f8" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 726.501884] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b7074d70-d8cb-411f-b8c4-a4007dfd74f8" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 726.502162] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b7074d70-d8cb-411f-b8c4-a4007dfd74f8" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 726.502364] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 726.502483] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 726.502566] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 726.502701] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 726.502784] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 726.502870] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b7074d70-d8cb-411f-b8c4-a4007dfd74f8" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 726.502962] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('b7074d70-d8cb-411f-b8c4-a4007dfd74f8',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 726.584682] env[65370]: DEBUG networking_nsxv3.common.locking [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Lock network-712 taken with stack trace [, , , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 726.584682] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquiring lock "network-712" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 726.584873] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquired lock "network-712" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 726.584956] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquired external semaphore "network-712" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 726.585249] env[65370]: DEBUG networking_nsxv3.common.locking [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 726.585401] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquiring lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 726.585510] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquired lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 726.585710] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquired external semaphore "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 726.585841] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Releasing lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 726.586241] env[65370]: DEBUG dogpile.cache.region [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] No value present for key: 'zone-id' {{(pid=65370) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 726.586363] env[65370]: DEBUG dogpile.lock [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] NeedRegenerationException {{(pid=65370) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 726.586439] env[65370]: DEBUG dogpile.lock [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] no value, waiting for create lock {{(pid=65370) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 726.586537] env[65370]: DEBUG dogpile.lock [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] value creation lock acquired {{(pid=65370) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 726.586982] env[65370]: DEBUG dogpile.cache.region [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] No value present for key: 'zone-id' {{(pid=65370) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 726.586982] env[65370]: DEBUG dogpile.lock [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Calling creation function for not-yet-present value {{(pid=65370) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 726.586982] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 726.610823] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 726.611058] env[65370]: DEBUG dogpile.cache.region [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Cache value generated in 0.024 seconds for key(s): 'zone-id' {{(pid=65370) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 726.611215] env[65370]: DEBUG dogpile.lock [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Released creation lock {{(pid=65370) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 726.611391] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Releasing lock "network-712" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 726.611716] env[65370]: DEBUG networking_nsxv3.common.locking [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Lock port-a97f39b9-7b92-4e47-b37a-a83e5fe2b876 taken with stack trace [, , , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 726.611948] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquiring lock "port-a97f39b9-7b92-4e47-b37a-a83e5fe2b876" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 726.612108] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquired lock "port-a97f39b9-7b92-4e47-b37a-a83e5fe2b876" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 726.612421] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquired external semaphore "port-a97f39b9-7b92-4e47-b37a-a83e5fe2b876" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 726.612551] env[65370]: DEBUG networking_nsxv3.api.rpc [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a97f39b9-7b92-4e47-b37a-a83e5fe2b876',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 726.623635] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e2790d7c-6d0c-45bc-84d1-8cb00d26b9b0 in Status: SUCCESS [ 726.623781] env[65370]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e2790d7c-6d0c-45bc-84d1-8cb00d26b9b0 deletion is rescheduled due to dependency. [ 726.623896] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e2790d7c-6d0c-45bc-84d1-8cb00d26b9b0" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 726.665084] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 726.665308] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 726.665378] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 726.665901] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 726.685631] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 726.685882] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 726.686043] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 726.686128] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 726.686393] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 726.686393] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 726.686494] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1eaa763e-4469-4428-92d0-ba20a6c99edc is going to be updated. [ 726.710097] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 726.714065] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 726.714065] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 726.714065] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 726.714065] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 726.720751] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1eaa763e-4469-4428-92d0-ba20a6c99edc in Status: IN_PROGRESS for 2s [ 726.960365] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 237e1a89-daff-4fd5-b02a-97e1d536d9bd in Status: SUCCESS [ 726.960365] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-237e1a89-daff-4fd5-b02a-97e1d536d9bd" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 726.960574] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-237e1a89-daff-4fd5-b02a-97e1d536d9bd" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 726.960865] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-237e1a89-daff-4fd5-b02a-97e1d536d9bd" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 726.960960] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 726.961105] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 726.961165] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 726.961334] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 726.961415] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 726.961496] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-237e1a89-daff-4fd5-b02a-97e1d536d9bd" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 726.961681] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock member-237e1a89-daff-4fd5-b02a-97e1d536d9bd taken with stack trace [, , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 726.961773] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-237e1a89-daff-4fd5-b02a-97e1d536d9bd" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 726.961826] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-237e1a89-daff-4fd5-b02a-97e1d536d9bd" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 726.961934] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-237e1a89-daff-4fd5-b02a-97e1d536d9bd" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 726.962401] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 726.962509] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 726.962570] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 726.962766] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 726.962846] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 726.962935] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-237e1a89-daff-4fd5-b02a-97e1d536d9bd" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 726.963051] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('237e1a89-daff-4fd5-b02a-97e1d536d9bd',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 726.963963] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-237e1a89-daff-4fd5-b02a-97e1d536d9bd" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 726.964140] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-237e1a89-daff-4fd5-b02a-97e1d536d9bd" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 726.964298] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 726.964493] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 726.964551] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 726.964701] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 726.964779] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 726.964872] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('237e1a89-daff-4fd5-b02a-97e1d536d9bd',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 727.004519] env[65370]: INFO networking_nsxv3.common.synchronization [req-ba6b1cf1-604f-4e30-a108-e5275d3220fd req-fa2ba058-60b4-47fc-b6b0-ec7c8f133339 tempest-SecurityGroupRulesTestJSON-1280346518 tempest-SecurityGroupRulesTestJSON-1280346518-project-member] Enqueued Resource ID: c3f17eb2-c785-4881-b154-9e3ebb4525e7 with Priority: HIGHEST for action security_group_rules [ 727.005707] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock member-b7074d70-d8cb-411f-b8c4-a4007dfd74f8 taken with stack trace [, , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 727.005707] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b7074d70-d8cb-411f-b8c4-a4007dfd74f8" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 727.005707] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b7074d70-d8cb-411f-b8c4-a4007dfd74f8" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 727.005707] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b7074d70-d8cb-411f-b8c4-a4007dfd74f8" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 727.005925] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 727.005925] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 727.005925] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 727.006805] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 727.007110] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 727.007110] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b7074d70-d8cb-411f-b8c4-a4007dfd74f8" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 727.007272] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock member-b7074d70-d8cb-411f-b8c4-a4007dfd74f8 taken with stack trace [, , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 727.007318] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b7074d70-d8cb-411f-b8c4-a4007dfd74f8" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 727.007350] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b7074d70-d8cb-411f-b8c4-a4007dfd74f8" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 727.007567] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b7074d70-d8cb-411f-b8c4-a4007dfd74f8" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 727.007627] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 727.007741] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 727.007773] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 727.007904] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 727.008215] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 727.008215] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b7074d70-d8cb-411f-b8c4-a4007dfd74f8" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 727.008215] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('b7074d70-d8cb-411f-b8c4-a4007dfd74f8',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 727.009310] env[65370]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c3f17eb2-c785-4881-b154-9e3ebb4525e7 with Priority: HIGHEST for action security_group_rules [ 727.010579] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock rules-c3f17eb2-c785-4881-b154-9e3ebb4525e7 taken with stack trace [, , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 727.011062] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-c3f17eb2-c785-4881-b154-9e3ebb4525e7" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 727.011062] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-c3f17eb2-c785-4881-b154-9e3ebb4525e7" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 727.011062] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-c3f17eb2-c785-4881-b154-9e3ebb4525e7" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 727.011062] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('c3f17eb2-c785-4881-b154-9e3ebb4525e7',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 727.115078] env[65370]: DEBUG networking_nsxv3.common.locking [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 727.115329] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquiring lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 727.115453] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquired lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 727.115720] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquired external semaphore "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 727.115858] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Releasing lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 727.116010] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Segment Port a97f39b9-7b92-4e47-b37a-a83e5fe2b876 not found, creating... [ 727.116491] env[65370]: DEBUG networking_nsxv3.common.locking [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 727.116491] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquiring lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 727.116612] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquired lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 727.116768] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquired external semaphore "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 727.116858] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Releasing lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 727.117176] env[65370]: DEBUG networking_nsxv3.common.locking [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 727.117290] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquiring lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 727.117379] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquired lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 727.117595] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquired external semaphore "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 727.117721] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Releasing lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 727.117851] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Resource: SegmentPort with ID: a97f39b9-7b92-4e47-b37a-a83e5fe2b876 is going to be created. [ 727.140627] env[65370]: DEBUG networking_nsxv3.common.locking [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 727.140627] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquiring lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 727.140627] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquired lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 727.140627] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquired external semaphore "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 727.140627] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Releasing lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 727.141024] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Releasing lock "port-a97f39b9-7b92-4e47-b37a-a83e5fe2b876" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 727.478437] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 237e1a89-daff-4fd5-b02a-97e1d536d9bd: rpc.has_security_group_logging(os_id): False [ 727.478437] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('237e1a89-daff-4fd5-b02a-97e1d536d9bd',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 727.492423] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 727.492423] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 727.492626] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 727.492825] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 727.492825] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 727.493131] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 727.493268] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 727.493268] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 727.493405] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 727.493490] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 727.493770] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 727.493829] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 727.494030] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 727.494030] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 727.494150] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 727.494304] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 727.496669] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 727.496669] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 727.496866] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 727.496952] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 727.497058] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 237e1a89-daff-4fd5-b02a-97e1d536d9bd is going to be created. [ 727.510743] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for b7074d70-d8cb-411f-b8c4-a4007dfd74f8: rpc.has_security_group_logging(os_id): False [ 727.529961] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 727.530279] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 727.530391] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 727.530708] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 727.530829] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 727.531118] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 727.531229] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 727.531301] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 727.531464] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 727.531868] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 727.531868] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 727.531868] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 727.532089] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 727.532116] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 727.532227] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 727.537545] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 727.537545] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 727.537545] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 727.537545] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 727.537545] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 727.537545] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: b7074d70-d8cb-411f-b8c4-a4007dfd74f8 is going to be created. [ 727.537545] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 727.537545] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 727.537545] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 727.537545] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 727.537545] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 727.537545] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: c3f17eb2-c785-4881-b154-9e3ebb4525e7 already deleted. [ 727.537545] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-c3f17eb2-c785-4881-b154-9e3ebb4525e7" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 727.560465] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 727.560465] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 727.560729] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 727.560729] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 727.561245] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 727.574966] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 237e1a89-daff-4fd5-b02a-97e1d536d9bd in Status: IN_PROGRESS for 2s [ 727.598472] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 727.598663] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 727.598760] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 727.599058] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 727.599308] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 727.632385] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b7074d70-d8cb-411f-b8c4-a4007dfd74f8 in Status: IN_PROGRESS for 2s [ 727.681771] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5132c293-b680-4491-ba2b-122515a71eaf in Status: SUCCESS [ 727.682038] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5132c293-b680-4491-ba2b-122515a71eaf" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 727.682309] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5132c293-b680-4491-ba2b-122515a71eaf" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 727.682583] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5132c293-b680-4491-ba2b-122515a71eaf" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 727.682842] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 727.683146] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 727.683146] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 727.683268] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 727.683430] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 727.683502] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5132c293-b680-4491-ba2b-122515a71eaf',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 727.971359] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('237e1a89-daff-4fd5-b02a-97e1d536d9bd',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 728.018140] env[65370]: INFO networking_nsxv3.common.synchronization [req-6a40ac6c-0653-4e9f-afef-592ec6e6ae53 req-b6ce0acb-91de-4c3a-84b1-585996df6f85 service nova] Enqueued Resource ID: 1eaa763e-4469-4428-92d0-ba20a6c99edc with Priority: HIGHEST for action security_group_rules [ 728.018140] env[65370]: INFO networking_nsxv3.common.synchronization [req-6a40ac6c-0653-4e9f-afef-592ec6e6ae53 req-b6ce0acb-91de-4c3a-84b1-585996df6f85 service nova] Enqueued Resource ID: 1eaa763e-4469-4428-92d0-ba20a6c99edc with Priority: HIGHEST for action security_group_members [ 728.018140] env[65370]: INFO networking_nsxv3.common.synchronization [req-6a40ac6c-0653-4e9f-afef-592ec6e6ae53 req-b6ce0acb-91de-4c3a-84b1-585996df6f85 service nova] Enqueued Resource ID: a97f39b9-7b92-4e47-b37a-a83e5fe2b876 with Priority: HIGHEST for action port [ 728.018140] env[65370]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1eaa763e-4469-4428-92d0-ba20a6c99edc with Priority: HIGHEST for action security_group_rules [ 728.018574] env[65370]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1eaa763e-4469-4428-92d0-ba20a6c99edc with Priority: HIGHEST for action security_group_members [ 728.018574] env[65370]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a97f39b9-7b92-4e47-b37a-a83e5fe2b876 with Priority: HIGHEST for action port [ 728.018692] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock rules-1eaa763e-4469-4428-92d0-ba20a6c99edc taken with stack trace [, , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 728.018780] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-1eaa763e-4469-4428-92d0-ba20a6c99edc" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 728.019405] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-1eaa763e-4469-4428-92d0-ba20a6c99edc" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 728.019405] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-1eaa763e-4469-4428-92d0-ba20a6c99edc" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 728.019405] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('1eaa763e-4469-4428-92d0-ba20a6c99edc',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 728.020436] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock member-1eaa763e-4469-4428-92d0-ba20a6c99edc taken with stack trace [, , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 728.020436] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1eaa763e-4469-4428-92d0-ba20a6c99edc" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 728.020436] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock port-a97f39b9-7b92-4e47-b37a-a83e5fe2b876 taken with stack trace [, , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 728.020641] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-a97f39b9-7b92-4e47-b37a-a83e5fe2b876" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 728.020641] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-a97f39b9-7b92-4e47-b37a-a83e5fe2b876" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 728.020802] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-a97f39b9-7b92-4e47-b37a-a83e5fe2b876" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 728.020925] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a97f39b9-7b92-4e47-b37a-a83e5fe2b876',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 728.189211] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('5132c293-b680-4491-ba2b-122515a71eaf',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 728.476175] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 728.476175] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 728.476175] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 728.476175] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 728.476175] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 728.476175] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 237e1a89-daff-4fd5-b02a-97e1d536d9bd is going to be updated. [ 728.510621] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 728.510621] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 728.510621] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 728.510621] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 728.510621] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 728.521012] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 237e1a89-daff-4fd5-b02a-97e1d536d9bd in Status: IN_PROGRESS for 2s [ 728.522673] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock member-1eaa763e-4469-4428-92d0-ba20a6c99edc taken with stack trace [, , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 728.522853] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1eaa763e-4469-4428-92d0-ba20a6c99edc" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 728.524321] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port a97f39b9-7b92-4e47-b37a-a83e5fe2b876 with status ACTIVE [ 728.524532] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 728.524946] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 728.524946] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 728.524946] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 728.525098] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 728.525217] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 728.525330] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 728.525398] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 728.525555] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 728.525637] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 728.525811] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 728.525939] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 728.526069] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 728.526103] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 728.526183] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 728.526267] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: a97f39b9-7b92-4e47-b37a-a83e5fe2b876 is going to be updated. [ 728.549076] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 728.549280] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 728.549280] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 728.549664] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 728.549664] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 728.549756] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-a97f39b9-7b92-4e47-b37a-a83e5fe2b876" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 728.691509] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('5132c293-b680-4491-ba2b-122515a71eaf',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 728.731929] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1eaa763e-4469-4428-92d0-ba20a6c99edc in Status: SUCCESS [ 728.732149] env[65370]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1eaa763e-4469-4428-92d0-ba20a6c99edc deletion is rescheduled due to dependency. [ 728.732290] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1eaa763e-4469-4428-92d0-ba20a6c99edc" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 728.732568] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1eaa763e-4469-4428-92d0-ba20a6c99edc" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 728.732809] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1eaa763e-4469-4428-92d0-ba20a6c99edc" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 728.733082] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 728.733200] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 728.733240] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 728.733398] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 728.733484] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 728.733582] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1eaa763e-4469-4428-92d0-ba20a6c99edc',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 729.194540] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 729.194705] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 729.194778] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 729.195008] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 729.195113] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 729.195307] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5132c293-b680-4491-ba2b-122515a71eaf is going to be updated. [ 729.225780] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 729.225917] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 729.225990] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 729.226263] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 729.226422] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 729.236284] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('1eaa763e-4469-4428-92d0-ba20a6c99edc',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 729.239381] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5132c293-b680-4491-ba2b-122515a71eaf in Status: IN_PROGRESS for 2s [ 729.591369] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 237e1a89-daff-4fd5-b02a-97e1d536d9bd in Status: SUCCESS [ 729.591739] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-237e1a89-daff-4fd5-b02a-97e1d536d9bd" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 729.591777] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-237e1a89-daff-4fd5-b02a-97e1d536d9bd" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 729.592314] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-237e1a89-daff-4fd5-b02a-97e1d536d9bd" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 729.592314] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('237e1a89-daff-4fd5-b02a-97e1d536d9bd',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 729.652562] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b7074d70-d8cb-411f-b8c4-a4007dfd74f8 in Status: SUCCESS [ 729.652562] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-b7074d70-d8cb-411f-b8c4-a4007dfd74f8" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 729.739618] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('1eaa763e-4469-4428-92d0-ba20a6c99edc',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 730.097279] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock member-237e1a89-daff-4fd5-b02a-97e1d536d9bd taken with stack trace [, , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 730.097455] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-237e1a89-daff-4fd5-b02a-97e1d536d9bd" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 730.244907] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 730.244907] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 730.244907] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 730.244907] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 730.244907] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 730.244907] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1eaa763e-4469-4428-92d0-ba20a6c99edc is going to be updated. [ 730.308627] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 730.308794] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 730.308874] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 730.309180] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 730.309317] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 730.319719] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1eaa763e-4469-4428-92d0-ba20a6c99edc in Status: IN_PROGRESS for 2s [ 730.349526] env[65370]: INFO networking_nsxv3.common.synchronization [req-4d1b1571-7e95-498f-9acd-1011e2f68118 req-56e2720a-c0e0-4a21-8893-962a2fd7a4fa tempest-ServerPasswordTestJSON-1990139002 tempest-ServerPasswordTestJSON-1990139002-project-member] Enqueued Resource ID: a316198c-c3c7-4c28-a092-301a77045bc5 with Priority: HIGHEST for action security_group_members [ 730.350344] env[65370]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a316198c-c3c7-4c28-a092-301a77045bc5 with Priority: HIGHEST for action security_group_members [ 730.351095] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock member-a316198c-c3c7-4c28-a092-301a77045bc5 taken with stack trace [, , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 730.351396] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a316198c-c3c7-4c28-a092-301a77045bc5" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 730.351558] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a316198c-c3c7-4c28-a092-301a77045bc5" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 730.351853] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a316198c-c3c7-4c28-a092-301a77045bc5" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 730.352181] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 730.352428] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 730.352567] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 730.352808] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 730.352993] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 730.353828] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a316198c-c3c7-4c28-a092-301a77045bc5',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 730.535991] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 237e1a89-daff-4fd5-b02a-97e1d536d9bd in Status: SUCCESS [ 730.535991] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-237e1a89-daff-4fd5-b02a-97e1d536d9bd" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 730.536865] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-237e1a89-daff-4fd5-b02a-97e1d536d9bd" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 730.536865] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-237e1a89-daff-4fd5-b02a-97e1d536d9bd" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 730.536865] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 730.537117] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 730.537117] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 730.537322] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 730.537574] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 730.538304] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-237e1a89-daff-4fd5-b02a-97e1d536d9bd" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 730.538304] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('237e1a89-daff-4fd5-b02a-97e1d536d9bd',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 730.860717] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 730.860717] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 730.860717] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 730.860717] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 730.883689] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 730.889304] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 730.889304] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 730.889304] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 730.889304] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 730.889304] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 730.889304] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a316198c-c3c7-4c28-a092-301a77045bc5 is going to be updated. [ 730.925337] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 730.925517] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 730.925517] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 730.926831] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 730.926831] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 730.940873] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a316198c-c3c7-4c28-a092-301a77045bc5 in Status: IN_PROGRESS for 2s [ 731.042081] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock member-237e1a89-daff-4fd5-b02a-97e1d536d9bd taken with stack trace [, , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 731.042213] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-237e1a89-daff-4fd5-b02a-97e1d536d9bd" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 731.042262] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-237e1a89-daff-4fd5-b02a-97e1d536d9bd" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 731.042607] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-237e1a89-daff-4fd5-b02a-97e1d536d9bd" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 731.042858] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 731.043323] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 731.043387] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 731.043590] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 731.043685] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 731.043859] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-237e1a89-daff-4fd5-b02a-97e1d536d9bd" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 731.043933] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock member-237e1a89-daff-4fd5-b02a-97e1d536d9bd taken with stack trace [, , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 731.044046] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-237e1a89-daff-4fd5-b02a-97e1d536d9bd" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 731.044115] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-237e1a89-daff-4fd5-b02a-97e1d536d9bd" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 731.044257] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-237e1a89-daff-4fd5-b02a-97e1d536d9bd" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 731.048013] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 731.048013] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 731.048013] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 731.048013] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 731.048013] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 731.048316] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-237e1a89-daff-4fd5-b02a-97e1d536d9bd" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 731.048426] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('237e1a89-daff-4fd5-b02a-97e1d536d9bd',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 731.254938] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5132c293-b680-4491-ba2b-122515a71eaf in Status: SUCCESS [ 731.254938] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5132c293-b680-4491-ba2b-122515a71eaf" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 731.254938] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5132c293-b680-4491-ba2b-122515a71eaf" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 731.255119] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5132c293-b680-4491-ba2b-122515a71eaf" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 731.255275] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 731.255408] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 731.255473] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 731.255692] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 731.255774] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 731.255872] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5132c293-b680-4491-ba2b-122515a71eaf" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 731.256039] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock member-5132c293-b680-4491-ba2b-122515a71eaf taken with stack trace [, , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 731.256140] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5132c293-b680-4491-ba2b-122515a71eaf" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 731.256200] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5132c293-b680-4491-ba2b-122515a71eaf" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 731.256387] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5132c293-b680-4491-ba2b-122515a71eaf" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 731.256527] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 731.256616] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 731.256687] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 731.256822] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 731.256894] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 731.256971] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5132c293-b680-4491-ba2b-122515a71eaf" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 731.261027] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('5132c293-b680-4491-ba2b-122515a71eaf',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 731.551407] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 237e1a89-daff-4fd5-b02a-97e1d536d9bd: rpc.has_security_group_logging(os_id): False [ 731.571039] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 731.571383] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 731.571383] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 731.571981] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 731.571981] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 731.572311] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 731.572484] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 731.572721] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 731.573108] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 731.573108] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 731.573386] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 731.573498] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 731.573768] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 731.576813] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 731.577106] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 731.577581] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 731.577756] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 731.577820] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 731.578081] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 731.578332] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 731.578332] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 237e1a89-daff-4fd5-b02a-97e1d536d9bd is going to be updated. [ 731.652371] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 731.652645] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 731.652796] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 731.653114] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 731.653315] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 731.668292] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 237e1a89-daff-4fd5-b02a-97e1d536d9bd in Status: IN_PROGRESS for 2s [ 731.764091] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 5132c293-b680-4491-ba2b-122515a71eaf: rpc.has_security_group_logging(os_id): False [ 731.792801] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 731.792801] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 731.792801] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 731.793363] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 731.840714] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 731.841026] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 731.841164] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 731.841257] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 731.841566] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 731.842800] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 731.843296] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 731.843468] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 731.843697] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 731.844367] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 731.844367] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 731.844367] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 731.844512] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 731.844512] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 731.844674] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 731.844803] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 731.844858] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 5132c293-b680-4491-ba2b-122515a71eaf is going to be updated. [ 731.936727] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 731.936727] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 731.936727] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 731.936727] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 731.937278] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 731.964782] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 5132c293-b680-4491-ba2b-122515a71eaf in Status: IN_PROGRESS for 2s [ 732.332380] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1eaa763e-4469-4428-92d0-ba20a6c99edc in Status: SUCCESS [ 732.332620] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1eaa763e-4469-4428-92d0-ba20a6c99edc" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 732.333706] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1eaa763e-4469-4428-92d0-ba20a6c99edc" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 732.334159] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1eaa763e-4469-4428-92d0-ba20a6c99edc" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 732.335214] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 732.335564] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 732.335844] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 732.336230] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 732.337064] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 732.337258] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1eaa763e-4469-4428-92d0-ba20a6c99edc" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 732.337467] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('1eaa763e-4469-4428-92d0-ba20a6c99edc',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 732.842059] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock member-1eaa763e-4469-4428-92d0-ba20a6c99edc taken with stack trace [, , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 732.842059] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1eaa763e-4469-4428-92d0-ba20a6c99edc" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 732.842059] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1eaa763e-4469-4428-92d0-ba20a6c99edc" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 732.842742] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1eaa763e-4469-4428-92d0-ba20a6c99edc" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 732.842742] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 732.842742] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 732.842742] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 732.842742] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 732.843520] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 732.843520] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1eaa763e-4469-4428-92d0-ba20a6c99edc" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 732.843520] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock member-1eaa763e-4469-4428-92d0-ba20a6c99edc taken with stack trace [, , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 732.843520] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1eaa763e-4469-4428-92d0-ba20a6c99edc" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 732.843520] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1eaa763e-4469-4428-92d0-ba20a6c99edc" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 732.844607] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1eaa763e-4469-4428-92d0-ba20a6c99edc" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 732.844607] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 732.844607] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 732.844607] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 732.844607] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 732.844607] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 732.844607] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1eaa763e-4469-4428-92d0-ba20a6c99edc" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 732.844607] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('1eaa763e-4469-4428-92d0-ba20a6c99edc',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 732.953734] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a316198c-c3c7-4c28-a092-301a77045bc5 in Status: SUCCESS [ 732.954241] env[65370]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a316198c-c3c7-4c28-a092-301a77045bc5 deletion is rescheduled due to dependency. [ 732.954241] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a316198c-c3c7-4c28-a092-301a77045bc5" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 733.348188] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 1eaa763e-4469-4428-92d0-ba20a6c99edc: rpc.has_security_group_logging(os_id): False [ 733.383021] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 733.387025] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 733.387025] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 733.387025] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 733.387025] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 733.387025] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 733.387025] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 733.387025] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 733.387025] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 733.387025] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 733.387025] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 733.387025] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 733.387025] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 733.387025] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 733.387025] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 733.388105] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 733.388503] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 733.388753] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 733.389125] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 733.389429] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 733.389691] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 1eaa763e-4469-4428-92d0-ba20a6c99edc is going to be updated. [ 733.478380] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 733.480016] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 733.480016] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 733.480016] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 733.480016] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 733.499781] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 1eaa763e-4469-4428-92d0-ba20a6c99edc in Status: IN_PROGRESS for 2s [ 733.684701] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 237e1a89-daff-4fd5-b02a-97e1d536d9bd in Status: SUCCESS [ 733.684701] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-237e1a89-daff-4fd5-b02a-97e1d536d9bd" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 733.762370] env[65370]: INFO networking_nsxv3.common.synchronization [req-fac9c348-1447-43b7-8805-e8c632872c1d req-e5b966e8-2477-4030-b4d4-de20166a2c94 tempest-ServersAdminTestJSON-387254877 tempest-ServersAdminTestJSON-387254877-project-member] Enqueued Resource ID: feaf18c3-295c-41df-89f1-309931cdeca1 with Priority: HIGHEST for action security_group_members [ 733.763165] env[65370]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: feaf18c3-295c-41df-89f1-309931cdeca1 with Priority: HIGHEST for action security_group_members [ 733.766194] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock member-feaf18c3-295c-41df-89f1-309931cdeca1 taken with stack trace [, , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 733.766194] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-feaf18c3-295c-41df-89f1-309931cdeca1" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 733.766194] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-feaf18c3-295c-41df-89f1-309931cdeca1" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 733.766194] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-feaf18c3-295c-41df-89f1-309931cdeca1" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 733.766194] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 733.766194] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 733.766194] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 733.766194] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 733.766194] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 733.766194] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('feaf18c3-295c-41df-89f1-309931cdeca1',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 733.984385] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 5132c293-b680-4491-ba2b-122515a71eaf in Status: SUCCESS [ 733.984385] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-5132c293-b680-4491-ba2b-122515a71eaf" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 733.984385] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-5132c293-b680-4491-ba2b-122515a71eaf" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 733.985368] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-5132c293-b680-4491-ba2b-122515a71eaf" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 733.985368] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('5132c293-b680-4491-ba2b-122515a71eaf',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 734.267818] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('feaf18c3-295c-41df-89f1-309931cdeca1',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 734.488189] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock member-5132c293-b680-4491-ba2b-122515a71eaf taken with stack trace [, , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 734.488654] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5132c293-b680-4491-ba2b-122515a71eaf" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 734.488654] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5132c293-b680-4491-ba2b-122515a71eaf" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 734.488654] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5132c293-b680-4491-ba2b-122515a71eaf" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 734.488863] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 734.488956] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 734.489017] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 734.489167] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 734.489257] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 734.489348] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5132c293-b680-4491-ba2b-122515a71eaf" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 734.489436] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('5132c293-b680-4491-ba2b-122515a71eaf',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 734.533385] env[65370]: DEBUG networking_nsxv3.common.locking [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Lock network-571 taken with stack trace [, , , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 734.533646] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquiring lock "network-571" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 734.533794] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquired lock "network-571" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 734.534084] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquired external semaphore "network-571" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 734.534341] env[65370]: DEBUG networking_nsxv3.common.locking [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 734.534519] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquiring lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 734.534630] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquired lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 734.534841] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquired external semaphore "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 734.534979] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Releasing lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 734.535250] env[65370]: DEBUG dogpile.cache.region [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] No value present for key: 'zone-id' {{(pid=65370) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 734.535369] env[65370]: DEBUG dogpile.lock [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] NeedRegenerationException {{(pid=65370) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 734.535469] env[65370]: DEBUG dogpile.lock [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] no value, waiting for create lock {{(pid=65370) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 734.535609] env[65370]: DEBUG dogpile.lock [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] value creation lock acquired {{(pid=65370) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 734.535726] env[65370]: DEBUG dogpile.cache.region [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] No value present for key: 'zone-id' {{(pid=65370) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 734.535863] env[65370]: DEBUG dogpile.lock [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Calling creation function for not-yet-present value {{(pid=65370) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 734.536035] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 734.556011] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 734.556447] env[65370]: DEBUG dogpile.cache.region [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=65370) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 734.556610] env[65370]: DEBUG dogpile.lock [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Released creation lock {{(pid=65370) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 734.556761] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Releasing lock "network-571" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 734.558143] env[65370]: DEBUG networking_nsxv3.common.locking [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Lock port-13cc4b42-31ba-4498-8dc9-20a42a02730b taken with stack trace [, , , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 734.558409] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquiring lock "port-13cc4b42-31ba-4498-8dc9-20a42a02730b" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 734.558562] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquired lock "port-13cc4b42-31ba-4498-8dc9-20a42a02730b" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 734.559050] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquired external semaphore "port-13cc4b42-31ba-4498-8dc9-20a42a02730b" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 734.559368] env[65370]: DEBUG networking_nsxv3.api.rpc [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('13cc4b42-31ba-4498-8dc9-20a42a02730b',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 734.770827] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('feaf18c3-295c-41df-89f1-309931cdeca1',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 734.994702] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock member-5132c293-b680-4491-ba2b-122515a71eaf taken with stack trace [, , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 734.995061] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5132c293-b680-4491-ba2b-122515a71eaf" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 734.995101] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5132c293-b680-4491-ba2b-122515a71eaf" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 734.995463] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5132c293-b680-4491-ba2b-122515a71eaf" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 734.995666] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 734.996321] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 734.996321] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 734.996321] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 734.996321] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 734.996321] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5132c293-b680-4491-ba2b-122515a71eaf" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 734.996543] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock member-5132c293-b680-4491-ba2b-122515a71eaf taken with stack trace [, , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 734.996543] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5132c293-b680-4491-ba2b-122515a71eaf" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 734.996543] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5132c293-b680-4491-ba2b-122515a71eaf" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 734.996668] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5132c293-b680-4491-ba2b-122515a71eaf" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 734.996805] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 734.996894] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 734.996953] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 734.997110] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 734.997215] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 734.997575] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5132c293-b680-4491-ba2b-122515a71eaf" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 734.997575] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('5132c293-b680-4491-ba2b-122515a71eaf',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 735.062264] env[65370]: DEBUG networking_nsxv3.common.locking [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 735.062494] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquiring lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 735.062622] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquired lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 735.066020] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquired external semaphore "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 735.066020] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Releasing lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 735.066020] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Segment Port 13cc4b42-31ba-4498-8dc9-20a42a02730b not found, creating... [ 735.066020] env[65370]: DEBUG networking_nsxv3.common.locking [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 735.066020] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquiring lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 735.066020] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquired lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 735.066020] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquired external semaphore "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 735.066020] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Releasing lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 735.066020] env[65370]: DEBUG networking_nsxv3.common.locking [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 735.066020] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquiring lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 735.066502] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquired lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 735.066502] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquired external semaphore "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 735.066502] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Releasing lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 735.066502] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Resource: SegmentPort with ID: 13cc4b42-31ba-4498-8dc9-20a42a02730b is going to be created. [ 735.086510] env[65370]: DEBUG networking_nsxv3.common.locking [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 735.086705] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquiring lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 735.086810] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquired lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 735.087099] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquired external semaphore "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 735.087325] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Releasing lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 735.087634] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Releasing lock "port-13cc4b42-31ba-4498-8dc9-20a42a02730b" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 735.273211] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 735.273425] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 735.273473] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 735.273798] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 735.273901] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 735.273983] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: feaf18c3-295c-41df-89f1-309931cdeca1 is going to be updated. [ 735.313247] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 735.313512] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 735.313597] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 735.313831] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 735.313982] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 735.324154] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: feaf18c3-295c-41df-89f1-309931cdeca1 in Status: IN_PROGRESS for 2s [ 735.397060] env[65370]: INFO networking_nsxv3.common.synchronization [req-cc6de2a1-995f-43ba-900e-b661bcd5acbc req-38623bf5-60b1-40bf-8a90-54b288f88d54 tempest-ServerTagsTestJSON-174359618 tempest-ServerTagsTestJSON-174359618-project-member] Enqueued Resource ID: e01148a4-883d-4ac9-887d-a7302ffdd9d7 with Priority: HIGHEST for action security_group_members [ 735.397977] env[65370]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e01148a4-883d-4ac9-887d-a7302ffdd9d7 with Priority: HIGHEST for action security_group_members [ 735.398616] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock member-e01148a4-883d-4ac9-887d-a7302ffdd9d7 taken with stack trace [, , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 735.398829] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e01148a4-883d-4ac9-887d-a7302ffdd9d7" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 735.398829] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e01148a4-883d-4ac9-887d-a7302ffdd9d7" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 735.399101] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e01148a4-883d-4ac9-887d-a7302ffdd9d7" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 735.399454] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 735.399454] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 735.399454] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 735.399713] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 735.399814] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 735.399952] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e01148a4-883d-4ac9-887d-a7302ffdd9d7',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 735.500149] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 5132c293-b680-4491-ba2b-122515a71eaf: rpc.has_security_group_logging(os_id): False [ 735.523509] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 1eaa763e-4469-4428-92d0-ba20a6c99edc in Status: SUCCESS [ 735.523918] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-1eaa763e-4469-4428-92d0-ba20a6c99edc" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 735.534162] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 735.534162] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 735.534162] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 735.534162] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 735.534162] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 735.534479] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 735.534479] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 735.534566] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 735.535280] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 735.535280] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 735.535280] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 735.535478] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 735.535478] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 735.535900] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 735.535900] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 735.535900] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 735.536067] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 735.536166] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 735.536414] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 735.536545] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 735.536704] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 5132c293-b680-4491-ba2b-122515a71eaf is going to be updated. [ 735.658964] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 735.659312] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 735.659412] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 735.659795] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 735.659795] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 735.692776] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 5132c293-b680-4491-ba2b-122515a71eaf in Status: IN_PROGRESS for 2s [ 735.904722] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 735.904914] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 735.905064] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 735.905390] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 735.915239] env[65370]: INFO networking_nsxv3.common.synchronization [req-fac9c348-1447-43b7-8805-e8c632872c1d req-07544f45-4c22-4fe4-a6bb-c9d47c5880d1 service nova] Enqueued Resource ID: feaf18c3-295c-41df-89f1-309931cdeca1 with Priority: HIGHEST for action security_group_rules [ 735.915649] env[65370]: INFO networking_nsxv3.common.synchronization [req-fac9c348-1447-43b7-8805-e8c632872c1d req-07544f45-4c22-4fe4-a6bb-c9d47c5880d1 service nova] Enqueued Resource ID: feaf18c3-295c-41df-89f1-309931cdeca1 with Priority: HIGHEST for action security_group_members [ 735.915896] env[65370]: INFO networking_nsxv3.common.synchronization [req-fac9c348-1447-43b7-8805-e8c632872c1d req-07544f45-4c22-4fe4-a6bb-c9d47c5880d1 service nova] Enqueued Resource ID: 13cc4b42-31ba-4498-8dc9-20a42a02730b with Priority: HIGHEST for action port [ 735.916700] env[65370]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: feaf18c3-295c-41df-89f1-309931cdeca1 with Priority: HIGHEST for action security_group_rules [ 735.917053] env[65370]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: feaf18c3-295c-41df-89f1-309931cdeca1 with Priority: HIGHEST for action security_group_members [ 735.917053] env[65370]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 13cc4b42-31ba-4498-8dc9-20a42a02730b with Priority: HIGHEST for action port [ 735.917268] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock rules-feaf18c3-295c-41df-89f1-309931cdeca1 taken with stack trace [, , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 735.917428] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-feaf18c3-295c-41df-89f1-309931cdeca1" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 735.917533] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-feaf18c3-295c-41df-89f1-309931cdeca1" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 735.917881] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-feaf18c3-295c-41df-89f1-309931cdeca1" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 735.917916] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('feaf18c3-295c-41df-89f1-309931cdeca1',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 735.919910] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock member-feaf18c3-295c-41df-89f1-309931cdeca1 taken with stack trace [, , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 735.920070] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-feaf18c3-295c-41df-89f1-309931cdeca1" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 735.920367] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock port-13cc4b42-31ba-4498-8dc9-20a42a02730b taken with stack trace [, , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 735.920511] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-13cc4b42-31ba-4498-8dc9-20a42a02730b" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 735.920583] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-13cc4b42-31ba-4498-8dc9-20a42a02730b" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 735.920825] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-13cc4b42-31ba-4498-8dc9-20a42a02730b" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 735.920872] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('13cc4b42-31ba-4498-8dc9-20a42a02730b',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 735.953486] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 735.953486] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 735.953486] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 735.953486] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 735.953486] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 735.953486] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 735.953486] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e01148a4-883d-4ac9-887d-a7302ffdd9d7 is going to be updated. [ 735.993393] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 735.993393] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 735.993633] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 735.993871] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 735.994037] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 736.011601] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e01148a4-883d-4ac9-887d-a7302ffdd9d7 in Status: IN_PROGRESS for 2s [ 736.424471] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock member-feaf18c3-295c-41df-89f1-309931cdeca1 taken with stack trace [, , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 736.424471] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-feaf18c3-295c-41df-89f1-309931cdeca1" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 736.424471] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 13cc4b42-31ba-4498-8dc9-20a42a02730b with status ACTIVE [ 736.424735] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 736.424735] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 736.424735] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 736.424996] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 736.425125] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 736.426801] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 736.426801] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 736.426801] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 736.426801] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 736.426801] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 736.426801] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 736.426801] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 736.426801] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 736.426801] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 736.426801] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 736.426801] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 13cc4b42-31ba-4498-8dc9-20a42a02730b is going to be updated. [ 736.461795] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 736.461795] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 736.462151] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 736.462151] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 736.463047] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 736.463047] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-13cc4b42-31ba-4498-8dc9-20a42a02730b" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 736.579537] env[65370]: INFO networking_nsxv3.common.synchronization [req-3292cbf1-7c27-43c3-bb32-49d7c9a81ccd req-b6acd929-2264-42ca-abf9-c15d2fe61860 tempest-ServerDiskConfigTestJSON-902849627 tempest-ServerDiskConfigTestJSON-902849627-project-member] Enqueued Resource ID: 420136f3-91df-4669-b5e3-cee436aeacb9 with Priority: HIGHEST for action security_group_members [ 736.580205] env[65370]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 420136f3-91df-4669-b5e3-cee436aeacb9 with Priority: HIGHEST for action security_group_members [ 736.580535] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock member-420136f3-91df-4669-b5e3-cee436aeacb9 taken with stack trace [, , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 736.580657] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-420136f3-91df-4669-b5e3-cee436aeacb9" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 736.580726] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-420136f3-91df-4669-b5e3-cee436aeacb9" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 736.581015] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-420136f3-91df-4669-b5e3-cee436aeacb9" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 736.581398] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 736.581501] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 736.581564] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 736.581802] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 736.581916] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 736.582030] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('420136f3-91df-4669-b5e3-cee436aeacb9',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 737.085091] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 737.085613] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 737.085613] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 737.085613] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 737.085751] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 737.085943] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 737.086047] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 737.086114] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 737.086407] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 737.086582] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 737.086675] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 420136f3-91df-4669-b5e3-cee436aeacb9 already deleted. [ 737.086780] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-420136f3-91df-4669-b5e3-cee436aeacb9" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 737.103555] env[65370]: DEBUG networking_nsxv3.common.locking [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Lock network-974 taken with stack trace [, , , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 737.103746] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquiring lock "network-974" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 737.103862] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquired lock "network-974" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 737.104219] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquired external semaphore "network-974" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 737.104477] env[65370]: DEBUG networking_nsxv3.common.locking [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 737.104627] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquiring lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 737.104737] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquired lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 737.105361] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquired external semaphore "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 737.105612] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Releasing lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 737.105879] env[65370]: DEBUG dogpile.cache.region [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] No value present for key: 'zone-id' {{(pid=65370) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 737.106045] env[65370]: DEBUG dogpile.lock [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] NeedRegenerationException {{(pid=65370) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 737.106206] env[65370]: DEBUG dogpile.lock [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] no value, waiting for create lock {{(pid=65370) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 737.106354] env[65370]: DEBUG dogpile.lock [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] value creation lock acquired {{(pid=65370) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 737.106503] env[65370]: DEBUG dogpile.cache.region [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] No value present for key: 'zone-id' {{(pid=65370) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 737.106659] env[65370]: DEBUG dogpile.lock [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Calling creation function for not-yet-present value {{(pid=65370) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 737.106830] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 737.130096] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 737.130309] env[65370]: DEBUG dogpile.cache.region [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=65370) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 737.130422] env[65370]: DEBUG dogpile.lock [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Released creation lock {{(pid=65370) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 737.130601] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Releasing lock "network-974" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 737.130927] env[65370]: DEBUG networking_nsxv3.common.locking [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Lock port-3fe2221c-88dc-4ed4-b3ca-60c53fd8e7ae taken with stack trace [, , , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 737.131102] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquiring lock "port-3fe2221c-88dc-4ed4-b3ca-60c53fd8e7ae" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 737.131198] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquired lock "port-3fe2221c-88dc-4ed4-b3ca-60c53fd8e7ae" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 737.131700] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquired external semaphore "port-3fe2221c-88dc-4ed4-b3ca-60c53fd8e7ae" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 737.131837] env[65370]: DEBUG networking_nsxv3.api.rpc [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3fe2221c-88dc-4ed4-b3ca-60c53fd8e7ae',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 737.336908] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: feaf18c3-295c-41df-89f1-309931cdeca1 in Status: SUCCESS [ 737.337209] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-feaf18c3-295c-41df-89f1-309931cdeca1" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 737.337401] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-feaf18c3-295c-41df-89f1-309931cdeca1" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 737.337839] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-feaf18c3-295c-41df-89f1-309931cdeca1" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 737.338221] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 737.338221] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 737.338391] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 737.338500] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 737.338570] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 737.338638] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('feaf18c3-295c-41df-89f1-309931cdeca1',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 737.636840] env[65370]: DEBUG networking_nsxv3.common.locking [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 737.637279] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquiring lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 737.637279] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquired lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 737.637458] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquired external semaphore "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 737.637671] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Releasing lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 737.637913] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Segment Port 3fe2221c-88dc-4ed4-b3ca-60c53fd8e7ae not found, creating... [ 737.638334] env[65370]: DEBUG networking_nsxv3.common.locking [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 737.638520] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquiring lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 737.638639] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquired lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 737.638867] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquired external semaphore "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 737.639122] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Releasing lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 737.639285] env[65370]: DEBUG networking_nsxv3.common.locking [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 737.639505] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquiring lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 737.639555] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquired lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 737.639948] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquired external semaphore "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 737.639948] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Releasing lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 737.640097] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Resource: SegmentPort with ID: 3fe2221c-88dc-4ed4-b3ca-60c53fd8e7ae is going to be created. [ 737.664221] env[65370]: DEBUG networking_nsxv3.common.locking [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 737.664509] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquiring lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 737.664580] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquired lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 737.665136] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquired external semaphore "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 737.665494] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Releasing lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 737.665779] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Releasing lock "port-3fe2221c-88dc-4ed4-b3ca-60c53fd8e7ae" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 737.727523] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 5132c293-b680-4491-ba2b-122515a71eaf in Status: SUCCESS [ 737.728075] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-5132c293-b680-4491-ba2b-122515a71eaf" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 737.841484] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('feaf18c3-295c-41df-89f1-309931cdeca1',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 738.022186] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e01148a4-883d-4ac9-887d-a7302ffdd9d7 in Status: SUCCESS [ 738.022272] env[65370]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e01148a4-883d-4ac9-887d-a7302ffdd9d7 deletion is rescheduled due to dependency. [ 738.022365] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e01148a4-883d-4ac9-887d-a7302ffdd9d7" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 738.345259] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('feaf18c3-295c-41df-89f1-309931cdeca1',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 738.404732] env[65370]: INFO networking_nsxv3.common.synchronization [req-3292cbf1-7c27-43c3-bb32-49d7c9a81ccd req-4c0ed85b-ceab-4df5-8d51-4d53fd4c5ea9 service nova] Enqueued Resource ID: 420136f3-91df-4669-b5e3-cee436aeacb9 with Priority: HIGHEST for action security_group_rules [ 738.404943] env[65370]: INFO networking_nsxv3.common.synchronization [req-3292cbf1-7c27-43c3-bb32-49d7c9a81ccd req-4c0ed85b-ceab-4df5-8d51-4d53fd4c5ea9 service nova] Enqueued Resource ID: 420136f3-91df-4669-b5e3-cee436aeacb9 with Priority: HIGHEST for action security_group_members [ 738.405094] env[65370]: INFO networking_nsxv3.common.synchronization [req-3292cbf1-7c27-43c3-bb32-49d7c9a81ccd req-4c0ed85b-ceab-4df5-8d51-4d53fd4c5ea9 service nova] Enqueued Resource ID: 3fe2221c-88dc-4ed4-b3ca-60c53fd8e7ae with Priority: HIGHEST for action port [ 738.405766] env[65370]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 420136f3-91df-4669-b5e3-cee436aeacb9 with Priority: HIGHEST for action security_group_rules [ 738.405883] env[65370]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 420136f3-91df-4669-b5e3-cee436aeacb9 with Priority: HIGHEST for action security_group_members [ 738.405978] env[65370]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3fe2221c-88dc-4ed4-b3ca-60c53fd8e7ae with Priority: HIGHEST for action port [ 738.406920] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock rules-420136f3-91df-4669-b5e3-cee436aeacb9 taken with stack trace [, , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 738.407072] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-420136f3-91df-4669-b5e3-cee436aeacb9" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 738.407161] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-420136f3-91df-4669-b5e3-cee436aeacb9" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 738.407516] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-420136f3-91df-4669-b5e3-cee436aeacb9" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 738.407605] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('420136f3-91df-4669-b5e3-cee436aeacb9',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 738.408626] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock member-420136f3-91df-4669-b5e3-cee436aeacb9 taken with stack trace [, , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 738.408757] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-420136f3-91df-4669-b5e3-cee436aeacb9" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 738.408825] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-420136f3-91df-4669-b5e3-cee436aeacb9" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 738.409026] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-420136f3-91df-4669-b5e3-cee436aeacb9" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 738.409187] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 738.409313] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 738.409401] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 738.409604] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 738.409689] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 738.409791] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('420136f3-91df-4669-b5e3-cee436aeacb9',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 738.411125] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock port-3fe2221c-88dc-4ed4-b3ca-60c53fd8e7ae taken with stack trace [, , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 738.411261] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-3fe2221c-88dc-4ed4-b3ca-60c53fd8e7ae" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 738.411347] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-3fe2221c-88dc-4ed4-b3ca-60c53fd8e7ae" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 738.411524] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-3fe2221c-88dc-4ed4-b3ca-60c53fd8e7ae" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 738.411615] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3fe2221c-88dc-4ed4-b3ca-60c53fd8e7ae',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 738.522091] env[65370]: INFO networking_nsxv3.common.synchronization [req-17ad75b5-e602-4c49-bf7b-b0fb8e089528 req-a785d6dd-87f9-47d9-92a4-a4b783d45480 tempest-SecurityGroupRulesTestJSON-1280346518 tempest-SecurityGroupRulesTestJSON-1280346518-project-member] Enqueued Resource ID: 0dbbaa67-0aee-44e9-ae9c-7909a0a4d171 with Priority: HIGHEST for action security_group_rules [ 738.522791] env[65370]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0dbbaa67-0aee-44e9-ae9c-7909a0a4d171 with Priority: HIGHEST for action security_group_rules [ 738.522932] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock rules-0dbbaa67-0aee-44e9-ae9c-7909a0a4d171 taken with stack trace [, , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 738.523517] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-0dbbaa67-0aee-44e9-ae9c-7909a0a4d171" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 738.523614] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-0dbbaa67-0aee-44e9-ae9c-7909a0a4d171" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 738.524370] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-0dbbaa67-0aee-44e9-ae9c-7909a0a4d171" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 738.524452] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('0dbbaa67-0aee-44e9-ae9c-7909a0a4d171',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 738.773246] env[65370]: INFO networking_nsxv3.common.synchronization [req-516d9a5e-4470-4f2a-9943-2840f9fe070a req-c75869a9-39ad-438d-8ecf-8ff677beea5a tempest-VolumesAdminNegativeTest-1748062384 tempest-VolumesAdminNegativeTest-1748062384-project-member] Enqueued Resource ID: 14c6c739-bd84-4bc8-9d1c-9bc29741c32d with Priority: HIGHEST for action security_group_members [ 738.773813] env[65370]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 14c6c739-bd84-4bc8-9d1c-9bc29741c32d with Priority: HIGHEST for action security_group_members [ 738.774248] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock member-14c6c739-bd84-4bc8-9d1c-9bc29741c32d taken with stack trace [, , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 738.774537] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-14c6c739-bd84-4bc8-9d1c-9bc29741c32d" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 738.774695] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-14c6c739-bd84-4bc8-9d1c-9bc29741c32d" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 738.774941] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-14c6c739-bd84-4bc8-9d1c-9bc29741c32d" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 738.775158] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 738.775370] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 738.775468] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 738.775680] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 738.775810] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 738.775934] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('14c6c739-bd84-4bc8-9d1c-9bc29741c32d',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 738.847541] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 738.847730] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 738.848050] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 738.848610] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 738.848833] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 738.848947] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: feaf18c3-295c-41df-89f1-309931cdeca1 is going to be updated. [ 738.881557] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 738.881803] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 738.882257] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 738.883269] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 738.883459] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 738.894281] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: feaf18c3-295c-41df-89f1-309931cdeca1 in Status: IN_PROGRESS for 2s [ 738.914087] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock member-420136f3-91df-4669-b5e3-cee436aeacb9 taken with stack trace [, , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 738.917021] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-420136f3-91df-4669-b5e3-cee436aeacb9" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 738.917021] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('420136f3-91df-4669-b5e3-cee436aeacb9',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 738.917021] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 3fe2221c-88dc-4ed4-b3ca-60c53fd8e7ae with status ACTIVE [ 738.917021] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 738.917021] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 738.917021] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 738.917021] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 738.917525] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 738.917798] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 738.918030] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 738.918240] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 738.918634] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 738.918850] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 738.919379] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 738.919836] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 738.920910] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 738.920910] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 738.920910] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 738.921230] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 3fe2221c-88dc-4ed4-b3ca-60c53fd8e7ae is going to be updated. [ 738.953138] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 738.953138] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 738.953138] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 738.953138] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 738.953138] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 738.953138] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-3fe2221c-88dc-4ed4-b3ca-60c53fd8e7ae" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 739.050735] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 739.050735] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 739.050735] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 739.050735] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 739.050735] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 739.050735] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 0dbbaa67-0aee-44e9-ae9c-7909a0a4d171 already deleted. [ 739.050735] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-0dbbaa67-0aee-44e9-ae9c-7909a0a4d171" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 739.106064] env[65370]: INFO networking_nsxv3.common.synchronization [req-1ded8605-cc36-4b91-bbd4-8ce921dbe688 req-12628814-2f41-4010-b237-0361b33c3b57 tempest-ListServersNegativeTestJSON-1430921204 tempest-ListServersNegativeTestJSON-1430921204-project-member] Enqueued Resource ID: 0cacf152-a4d4-4487-a370-aa2bae090120 with Priority: HIGHEST for action security_group_members [ 739.106064] env[65370]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0cacf152-a4d4-4487-a370-aa2bae090120 with Priority: HIGHEST for action security_group_members [ 739.106064] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock member-0cacf152-a4d4-4487-a370-aa2bae090120 taken with stack trace [, , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 739.106064] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0cacf152-a4d4-4487-a370-aa2bae090120" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 739.106064] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0cacf152-a4d4-4487-a370-aa2bae090120" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 739.106734] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0cacf152-a4d4-4487-a370-aa2bae090120" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 739.107064] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 739.107355] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 739.107534] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 739.107819] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 739.108032] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 739.108243] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0cacf152-a4d4-4487-a370-aa2bae090120',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 739.278317] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 739.279708] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 739.279789] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 739.280054] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 739.303061] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 739.303364] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 739.303502] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 739.303569] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 739.303756] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 739.303838] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 739.303924] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 14c6c739-bd84-4bc8-9d1c-9bc29741c32d is going to be updated. [ 739.336209] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 739.336435] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 739.336506] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 739.336749] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 739.336857] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 739.347936] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 14c6c739-bd84-4bc8-9d1c-9bc29741c32d in Status: IN_PROGRESS for 2s [ 739.427078] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('420136f3-91df-4669-b5e3-cee436aeacb9',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 739.473032] env[65370]: DEBUG networking_nsxv3.common.locking [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Lock network-134 taken with stack trace [, , , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 739.473032] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquiring lock "network-134" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 739.473032] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquired lock "network-134" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 739.473032] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquired external semaphore "network-134" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 739.473643] env[65370]: DEBUG networking_nsxv3.common.locking [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 739.474035] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquiring lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 739.474309] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquired lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 739.474678] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquired external semaphore "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 739.474951] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Releasing lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 739.475459] env[65370]: DEBUG dogpile.cache.region [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] No value present for key: 'zone-id' {{(pid=65370) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 739.475777] env[65370]: DEBUG dogpile.lock [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] NeedRegenerationException {{(pid=65370) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 739.476271] env[65370]: DEBUG dogpile.lock [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] no value, waiting for create lock {{(pid=65370) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 739.477025] env[65370]: DEBUG dogpile.lock [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] value creation lock acquired {{(pid=65370) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 739.477025] env[65370]: DEBUG dogpile.cache.region [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] No value present for key: 'zone-id' {{(pid=65370) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 739.477025] env[65370]: DEBUG dogpile.lock [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Calling creation function for not-yet-present value {{(pid=65370) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 739.477025] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 739.503913] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 739.503913] env[65370]: DEBUG dogpile.cache.region [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Cache value generated in 0.025 seconds for key(s): 'zone-id' {{(pid=65370) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 739.503913] env[65370]: DEBUG dogpile.lock [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Released creation lock {{(pid=65370) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 739.503913] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Releasing lock "network-134" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 739.503913] env[65370]: DEBUG networking_nsxv3.common.locking [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Lock port-3c95a77c-033a-4fc9-9aee-ca80dd02c21c taken with stack trace [, , , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 739.503913] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquiring lock "port-3c95a77c-033a-4fc9-9aee-ca80dd02c21c" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 739.503913] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquired lock "port-3c95a77c-033a-4fc9-9aee-ca80dd02c21c" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 739.503913] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquired external semaphore "port-3c95a77c-033a-4fc9-9aee-ca80dd02c21c" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 739.503913] env[65370]: DEBUG networking_nsxv3.api.rpc [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3c95a77c-033a-4fc9-9aee-ca80dd02c21c',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 739.612311] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 739.612311] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 739.612311] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 739.612311] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 739.614676] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 739.614676] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 739.614676] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 739.614676] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 739.614676] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 739.614676] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 739.614676] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0cacf152-a4d4-4487-a370-aa2bae090120 already deleted. [ 739.614676] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0cacf152-a4d4-4487-a370-aa2bae090120" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 739.930411] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 739.930690] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 739.930786] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 739.931025] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 739.931117] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 739.931217] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 420136f3-91df-4669-b5e3-cee436aeacb9 is going to be created. [ 739.964613] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 739.964613] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 739.964835] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 739.964952] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 739.965120] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 739.976534] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 420136f3-91df-4669-b5e3-cee436aeacb9 in Status: UNINITIALIZED for 2s [ 740.008726] env[65370]: DEBUG networking_nsxv3.common.locking [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 740.009024] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquiring lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 740.009219] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquired lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 740.009733] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquired external semaphore "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 740.009964] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Releasing lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 740.010194] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Segment Port 3c95a77c-033a-4fc9-9aee-ca80dd02c21c not found, creating... [ 740.010577] env[65370]: DEBUG networking_nsxv3.common.locking [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 740.010808] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquiring lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 740.010972] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquired lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 740.011385] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquired external semaphore "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 740.011606] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Releasing lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 740.012077] env[65370]: DEBUG networking_nsxv3.common.locking [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 740.012254] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquiring lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 740.012419] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquired lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 740.012704] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquired external semaphore "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 740.012934] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Releasing lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 740.013101] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Resource: SegmentPort with ID: 3c95a77c-033a-4fc9-9aee-ca80dd02c21c is going to be created. [ 740.041564] env[65370]: DEBUG networking_nsxv3.common.locking [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 740.041564] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquiring lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 740.041564] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquired lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 740.042232] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquired external semaphore "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 740.042232] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Releasing lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 740.042327] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Releasing lock "port-3c95a77c-033a-4fc9-9aee-ca80dd02c21c" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 740.748180] env[65370]: INFO networking_nsxv3.common.synchronization [req-1ded8605-cc36-4b91-bbd4-8ce921dbe688 req-9f8b93aa-1efe-41c5-a09d-a965f91968ea service nova] Enqueued Resource ID: 0cacf152-a4d4-4487-a370-aa2bae090120 with Priority: HIGHEST for action security_group_rules [ 740.748180] env[65370]: INFO networking_nsxv3.common.synchronization [req-1ded8605-cc36-4b91-bbd4-8ce921dbe688 req-9f8b93aa-1efe-41c5-a09d-a965f91968ea service nova] Enqueued Resource ID: 0cacf152-a4d4-4487-a370-aa2bae090120 with Priority: HIGHEST for action security_group_members [ 740.748180] env[65370]: INFO networking_nsxv3.common.synchronization [req-1ded8605-cc36-4b91-bbd4-8ce921dbe688 req-9f8b93aa-1efe-41c5-a09d-a965f91968ea service nova] Enqueued Resource ID: 3c95a77c-033a-4fc9-9aee-ca80dd02c21c with Priority: HIGHEST for action port [ 740.748180] env[65370]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0cacf152-a4d4-4487-a370-aa2bae090120 with Priority: HIGHEST for action security_group_rules [ 740.748180] env[65370]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0cacf152-a4d4-4487-a370-aa2bae090120 with Priority: HIGHEST for action security_group_members [ 740.748180] env[65370]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3c95a77c-033a-4fc9-9aee-ca80dd02c21c with Priority: HIGHEST for action port [ 740.749707] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock rules-0cacf152-a4d4-4487-a370-aa2bae090120 taken with stack trace [, , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 740.750098] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-0cacf152-a4d4-4487-a370-aa2bae090120" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 740.750270] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-0cacf152-a4d4-4487-a370-aa2bae090120" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 740.750701] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-0cacf152-a4d4-4487-a370-aa2bae090120" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 740.750884] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('0cacf152-a4d4-4487-a370-aa2bae090120',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 740.754097] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock member-0cacf152-a4d4-4487-a370-aa2bae090120 taken with stack trace [, , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 740.754097] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0cacf152-a4d4-4487-a370-aa2bae090120" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 740.754097] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0cacf152-a4d4-4487-a370-aa2bae090120" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 740.754097] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0cacf152-a4d4-4487-a370-aa2bae090120" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 740.754097] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 740.754097] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 740.754097] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 740.754846] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 740.755409] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 740.755409] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0cacf152-a4d4-4487-a370-aa2bae090120',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 740.760601] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock port-3c95a77c-033a-4fc9-9aee-ca80dd02c21c taken with stack trace [, , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 740.760601] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-3c95a77c-033a-4fc9-9aee-ca80dd02c21c" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 740.760601] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-3c95a77c-033a-4fc9-9aee-ca80dd02c21c" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 740.760601] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-3c95a77c-033a-4fc9-9aee-ca80dd02c21c" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 740.760601] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3c95a77c-033a-4fc9-9aee-ca80dd02c21c',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 740.904224] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: feaf18c3-295c-41df-89f1-309931cdeca1 in Status: SUCCESS [ 740.904224] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-feaf18c3-295c-41df-89f1-309931cdeca1" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 740.904415] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-feaf18c3-295c-41df-89f1-309931cdeca1" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 740.904616] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-feaf18c3-295c-41df-89f1-309931cdeca1" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 740.904733] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 740.904801] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 740.905410] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 740.905410] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 740.905410] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 740.905410] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-feaf18c3-295c-41df-89f1-309931cdeca1" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 740.905410] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('feaf18c3-295c-41df-89f1-309931cdeca1',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 741.233504] env[65370]: INFO networking_nsxv3.common.synchronization [req-1ded8605-cc36-4b91-bbd4-8ce921dbe688 req-fd35396e-4ed4-4382-9c8f-3aecfb96a337 tempest-ListServersNegativeTestJSON-1430921204 tempest-ListServersNegativeTestJSON-1430921204-project-member] Enqueued Resource ID: 0cacf152-a4d4-4487-a370-aa2bae090120 with Priority: HIGHEST for action security_group_members [ 741.234227] env[65370]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0cacf152-a4d4-4487-a370-aa2bae090120 with Priority: HIGHEST for action security_group_members [ 741.234671] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock member-0cacf152-a4d4-4487-a370-aa2bae090120 taken with stack trace [, , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 741.234823] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0cacf152-a4d4-4487-a370-aa2bae090120" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 741.259923] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock member-0cacf152-a4d4-4487-a370-aa2bae090120 taken with stack trace [, , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 741.259923] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0cacf152-a4d4-4487-a370-aa2bae090120" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 741.262308] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 3c95a77c-033a-4fc9-9aee-ca80dd02c21c with status ACTIVE [ 741.262645] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 741.264434] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 741.264434] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 741.264434] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 741.264434] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 741.264434] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 741.264434] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 741.264434] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 741.264434] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 741.264434] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 741.264434] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 741.264434] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 741.264434] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 741.265252] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 741.265252] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 741.265252] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 3c95a77c-033a-4fc9-9aee-ca80dd02c21c is going to be updated. [ 741.265909] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('0cacf152-a4d4-4487-a370-aa2bae090120',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 741.295424] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 741.295627] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 741.295627] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 741.295971] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 741.296114] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 741.296348] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-3c95a77c-033a-4fc9-9aee-ca80dd02c21c" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 741.359043] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 14c6c739-bd84-4bc8-9d1c-9bc29741c32d in Status: SUCCESS [ 741.359375] env[65370]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 14c6c739-bd84-4bc8-9d1c-9bc29741c32d deletion is rescheduled due to dependency. [ 741.359525] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-14c6c739-bd84-4bc8-9d1c-9bc29741c32d" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 741.407998] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock member-feaf18c3-295c-41df-89f1-309931cdeca1 taken with stack trace [, , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 741.408436] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-feaf18c3-295c-41df-89f1-309931cdeca1" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 741.408436] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-feaf18c3-295c-41df-89f1-309931cdeca1" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 741.408639] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-feaf18c3-295c-41df-89f1-309931cdeca1" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 741.408857] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 741.409012] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 741.409130] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 741.409365] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 741.409496] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 741.409636] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-feaf18c3-295c-41df-89f1-309931cdeca1" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 741.409862] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock member-feaf18c3-295c-41df-89f1-309931cdeca1 taken with stack trace [, , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 741.410039] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-feaf18c3-295c-41df-89f1-309931cdeca1" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 741.410125] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-feaf18c3-295c-41df-89f1-309931cdeca1" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 741.410340] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-feaf18c3-295c-41df-89f1-309931cdeca1" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 741.410524] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 741.410681] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 741.410773] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 741.410995] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 741.411112] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 741.411238] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-feaf18c3-295c-41df-89f1-309931cdeca1" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 741.411334] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('feaf18c3-295c-41df-89f1-309931cdeca1',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 741.548056] env[65370]: DEBUG networking_nsxv3.common.locking [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Lock network-134 taken with stack trace [, , , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 741.548056] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquiring lock "network-134" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 741.548056] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquired lock "network-134" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 741.548056] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquired external semaphore "network-134" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 741.548375] env[65370]: DEBUG networking_nsxv3.common.locking [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 741.548445] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquiring lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 741.548557] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquired lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 741.548770] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquired external semaphore "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 741.548926] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Releasing lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 741.549148] env[65370]: DEBUG dogpile.cache.region [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] No value present for key: 'zone-id' {{(pid=65370) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 741.549255] env[65370]: DEBUG dogpile.lock [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] NeedRegenerationException {{(pid=65370) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 741.549357] env[65370]: DEBUG dogpile.lock [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] no value, waiting for create lock {{(pid=65370) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 741.549456] env[65370]: DEBUG dogpile.lock [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] value creation lock acquired {{(pid=65370) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 741.549558] env[65370]: DEBUG dogpile.cache.region [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] No value present for key: 'zone-id' {{(pid=65370) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 741.549656] env[65370]: DEBUG dogpile.lock [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Calling creation function for not-yet-present value {{(pid=65370) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 741.549778] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 741.569618] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 741.569924] env[65370]: DEBUG dogpile.cache.region [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=65370) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 741.569924] env[65370]: DEBUG dogpile.lock [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Released creation lock {{(pid=65370) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 741.570085] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Releasing lock "network-134" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 741.570526] env[65370]: DEBUG networking_nsxv3.common.locking [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Lock port-f7f00c1d-e132-40f0-89c2-be4d1e587b95 taken with stack trace [, , , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 741.570766] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquiring lock "port-f7f00c1d-e132-40f0-89c2-be4d1e587b95" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 741.570947] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquired lock "port-f7f00c1d-e132-40f0-89c2-be4d1e587b95" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 741.571402] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquired external semaphore "port-f7f00c1d-e132-40f0-89c2-be4d1e587b95" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 741.571628] env[65370]: DEBUG networking_nsxv3.api.rpc [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f7f00c1d-e132-40f0-89c2-be4d1e587b95',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 741.768069] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('0cacf152-a4d4-4487-a370-aa2bae090120',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 741.914035] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for feaf18c3-295c-41df-89f1-309931cdeca1: rpc.has_security_group_logging(os_id): False [ 741.936503] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 741.936778] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 741.936854] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 741.937126] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 741.958847] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 741.959869] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 741.959869] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 741.959869] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 741.959869] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 741.959869] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 741.960205] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 741.960205] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 741.960205] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 741.960359] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 741.960454] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 741.960648] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 741.960762] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 741.961320] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 741.961320] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 741.961320] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 741.961320] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: feaf18c3-295c-41df-89f1-309931cdeca1 is going to be updated. [ 741.985577] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 420136f3-91df-4669-b5e3-cee436aeacb9 in Status: SUCCESS [ 741.985784] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-420136f3-91df-4669-b5e3-cee436aeacb9" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 741.986155] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-420136f3-91df-4669-b5e3-cee436aeacb9" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 741.986362] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-420136f3-91df-4669-b5e3-cee436aeacb9" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 741.986447] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 741.986572] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 741.986639] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 741.986790] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 741.986936] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 741.987055] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-420136f3-91df-4669-b5e3-cee436aeacb9" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 741.987150] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('420136f3-91df-4669-b5e3-cee436aeacb9',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 742.030290] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 742.031095] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 742.031095] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 742.031095] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 742.031350] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 742.048658] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: feaf18c3-295c-41df-89f1-309931cdeca1 in Status: IN_PROGRESS for 2s [ 742.077151] env[65370]: DEBUG networking_nsxv3.common.locking [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 742.077151] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquiring lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 742.077151] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquired lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 742.077151] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquired external semaphore "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 742.077151] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Releasing lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 742.077151] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Segment Port f7f00c1d-e132-40f0-89c2-be4d1e587b95 not found, creating... [ 742.077151] env[65370]: DEBUG networking_nsxv3.common.locking [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 742.077151] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquiring lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 742.077151] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquired lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 742.077151] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquired external semaphore "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 742.077151] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Releasing lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 742.078104] env[65370]: DEBUG networking_nsxv3.common.locking [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 742.078636] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquiring lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 742.078937] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquired lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 742.079471] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquired external semaphore "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 742.079807] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Releasing lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 742.082200] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Resource: SegmentPort with ID: f7f00c1d-e132-40f0-89c2-be4d1e587b95 is going to be created. [ 742.106841] env[65370]: DEBUG networking_nsxv3.common.locking [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 742.107219] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquiring lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 742.107517] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquired lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 742.107653] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquired external semaphore "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 742.107831] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Releasing lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 742.108320] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Releasing lock "port-f7f00c1d-e132-40f0-89c2-be4d1e587b95" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 742.270200] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 742.270416] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 742.270517] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 742.270785] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 742.270889] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 742.270991] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0cacf152-a4d4-4487-a370-aa2bae090120 is going to be created. [ 742.308749] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 742.308899] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 742.308970] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 742.309199] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 742.309394] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 742.322479] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0cacf152-a4d4-4487-a370-aa2bae090120 in Status: UNINITIALIZED for 2s [ 742.494491] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock member-420136f3-91df-4669-b5e3-cee436aeacb9 taken with stack trace [, , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 742.494677] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-420136f3-91df-4669-b5e3-cee436aeacb9" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 742.494710] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-420136f3-91df-4669-b5e3-cee436aeacb9" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 742.495240] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-420136f3-91df-4669-b5e3-cee436aeacb9" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 742.495240] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 742.495240] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 742.495404] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 742.495475] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 742.495536] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 742.495629] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-420136f3-91df-4669-b5e3-cee436aeacb9" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 742.495782] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock member-420136f3-91df-4669-b5e3-cee436aeacb9 taken with stack trace [, , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 742.495876] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-420136f3-91df-4669-b5e3-cee436aeacb9" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 742.495960] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-420136f3-91df-4669-b5e3-cee436aeacb9" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 742.496090] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-420136f3-91df-4669-b5e3-cee436aeacb9" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 742.496311] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 742.496311] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 742.496440] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 742.496561] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 742.496649] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 742.496730] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-420136f3-91df-4669-b5e3-cee436aeacb9" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 742.496816] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('420136f3-91df-4669-b5e3-cee436aeacb9',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 742.999310] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 420136f3-91df-4669-b5e3-cee436aeacb9: rpc.has_security_group_logging(os_id): False [ 743.018967] env[65370]: INFO networking_nsxv3.common.synchronization [req-1ded8605-cc36-4b91-bbd4-8ce921dbe688 req-c591ff81-b9ee-413f-9917-f54c5a007ec6 service nova] Enqueued Resource ID: 0cacf152-a4d4-4487-a370-aa2bae090120 with Priority: HIGHEST for action security_group_rules [ 743.019247] env[65370]: INFO networking_nsxv3.common.synchronization [req-1ded8605-cc36-4b91-bbd4-8ce921dbe688 req-c591ff81-b9ee-413f-9917-f54c5a007ec6 service nova] Enqueued Resource ID: 0cacf152-a4d4-4487-a370-aa2bae090120 with Priority: HIGHEST for action security_group_members [ 743.019441] env[65370]: INFO networking_nsxv3.common.synchronization [req-1ded8605-cc36-4b91-bbd4-8ce921dbe688 req-c591ff81-b9ee-413f-9917-f54c5a007ec6 service nova] Enqueued Resource ID: f7f00c1d-e132-40f0-89c2-be4d1e587b95 with Priority: HIGHEST for action port [ 743.020397] env[65370]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0cacf152-a4d4-4487-a370-aa2bae090120 with Priority: HIGHEST for action security_group_rules [ 743.020592] env[65370]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0cacf152-a4d4-4487-a370-aa2bae090120 with Priority: HIGHEST for action security_group_members [ 743.020711] env[65370]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f7f00c1d-e132-40f0-89c2-be4d1e587b95 with Priority: HIGHEST for action port [ 743.022037] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 743.022209] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 743.022312] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 743.022483] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 743.022621] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 743.022907] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 743.022995] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 743.023080] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 743.023492] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 743.023590] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 743.023806] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 743.023908] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 743.023962] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 743.024156] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 743.024267] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 743.024556] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 743.024683] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 743.024752] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 743.024930] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 743.024978] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 743.025093] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 420136f3-91df-4669-b5e3-cee436aeacb9 is going to be created. [ 743.029079] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock rules-0cacf152-a4d4-4487-a370-aa2bae090120 taken with stack trace [, , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 743.029079] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-0cacf152-a4d4-4487-a370-aa2bae090120" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 743.029079] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock member-0cacf152-a4d4-4487-a370-aa2bae090120 taken with stack trace [, , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 743.029079] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0cacf152-a4d4-4487-a370-aa2bae090120" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 743.029079] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock port-f7f00c1d-e132-40f0-89c2-be4d1e587b95 taken with stack trace [, , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 743.029079] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-f7f00c1d-e132-40f0-89c2-be4d1e587b95" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 743.029079] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-f7f00c1d-e132-40f0-89c2-be4d1e587b95" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 743.029079] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-f7f00c1d-e132-40f0-89c2-be4d1e587b95" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 743.029079] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f7f00c1d-e132-40f0-89c2-be4d1e587b95',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 743.093571] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 743.093790] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 743.093790] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 743.093988] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 743.094187] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 743.107483] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 420136f3-91df-4669-b5e3-cee436aeacb9 in Status: IN_PROGRESS for 2s [ 743.259828] env[65370]: INFO networking_nsxv3.common.synchronization [req-a2b4bfe6-c477-4f11-9b4d-7b2e57160a41 req-a1bcbc69-70c5-43e1-ba7d-d56ab664f2e3 tempest-SecurityGroupRulesTestJSON-1280346518 tempest-SecurityGroupRulesTestJSON-1280346518-project-member] Enqueued Resource ID: 0dbbaa67-0aee-44e9-ae9c-7909a0a4d171 with Priority: HIGHEST for action security_group_rules [ 743.260402] env[65370]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0dbbaa67-0aee-44e9-ae9c-7909a0a4d171 with Priority: HIGHEST for action security_group_rules [ 743.260709] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock rules-0dbbaa67-0aee-44e9-ae9c-7909a0a4d171 taken with stack trace [, , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 743.260834] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-0dbbaa67-0aee-44e9-ae9c-7909a0a4d171" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 743.260900] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-0dbbaa67-0aee-44e9-ae9c-7909a0a4d171" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 743.261112] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-0dbbaa67-0aee-44e9-ae9c-7909a0a4d171" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 743.261192] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('0dbbaa67-0aee-44e9-ae9c-7909a0a4d171',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 743.534027] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port f7f00c1d-e132-40f0-89c2-be4d1e587b95 with status ACTIVE [ 743.534027] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 743.534027] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 743.534027] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 743.534027] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 743.534027] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 743.534027] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 743.534027] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 743.534027] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 743.534027] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 743.534027] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 743.534027] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 743.534027] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 743.534027] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 743.534027] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 743.534027] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 743.534027] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: f7f00c1d-e132-40f0-89c2-be4d1e587b95 is going to be updated. [ 743.558039] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 743.560115] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 743.560115] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 743.560115] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 743.560115] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 743.560115] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-f7f00c1d-e132-40f0-89c2-be4d1e587b95" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 743.784958] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 743.784958] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 743.784958] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 743.785325] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 743.786039] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 743.786039] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 0dbbaa67-0aee-44e9-ae9c-7909a0a4d171 already deleted. [ 743.786039] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-0dbbaa67-0aee-44e9-ae9c-7909a0a4d171" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 744.065137] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: feaf18c3-295c-41df-89f1-309931cdeca1 in Status: SUCCESS [ 744.065137] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-feaf18c3-295c-41df-89f1-309931cdeca1" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 744.332601] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0cacf152-a4d4-4487-a370-aa2bae090120 in Status: SUCCESS [ 744.332805] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0cacf152-a4d4-4487-a370-aa2bae090120" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 744.333017] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0cacf152-a4d4-4487-a370-aa2bae090120" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 744.333318] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0cacf152-a4d4-4487-a370-aa2bae090120" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 744.333671] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 744.333887] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 744.333962] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 744.334290] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 744.334401] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 744.334520] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0cacf152-a4d4-4487-a370-aa2bae090120',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 744.474827] env[65370]: INFO networking_nsxv3.common.synchronization [None req-52ae8a4c-e4ff-443f-9c23-a387d7d37c85 tempest-ImagesOneServerNegativeTestJSON-1384686973 tempest-ImagesOneServerNegativeTestJSON-1384686973-project-member] Enqueued Resource ID: 722d23d9-051d-49bc-9a6f-82d9111ef481 with Priority: HIGHEST for action security_group_rules [ 744.476712] env[65370]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 722d23d9-051d-49bc-9a6f-82d9111ef481 with Priority: HIGHEST for action security_group_rules [ 744.477261] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock rules-722d23d9-051d-49bc-9a6f-82d9111ef481 taken with stack trace [, , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 744.477346] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-722d23d9-051d-49bc-9a6f-82d9111ef481" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 744.477437] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-722d23d9-051d-49bc-9a6f-82d9111ef481" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 744.478199] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-722d23d9-051d-49bc-9a6f-82d9111ef481" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 744.478296] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('722d23d9-051d-49bc-9a6f-82d9111ef481',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 744.590316] env[65370]: INFO networking_nsxv3.common.synchronization [None req-61d0ee02-62ec-434d-9537-caf9b60596f1 tempest-ImagesOneServerNegativeTestJSON-1384686973 tempest-ImagesOneServerNegativeTestJSON-1384686973-project-member] Enqueued Resource ID: 722d23d9-051d-49bc-9a6f-82d9111ef481 with Priority: HIGHEST for action security_group_rules [ 744.590918] env[65370]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 722d23d9-051d-49bc-9a6f-82d9111ef481 with Priority: HIGHEST for action security_group_rules [ 744.592614] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock rules-722d23d9-051d-49bc-9a6f-82d9111ef481 taken with stack trace [, , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 744.593220] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-722d23d9-051d-49bc-9a6f-82d9111ef481" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 744.838131] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('0cacf152-a4d4-4487-a370-aa2bae090120',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 745.003975] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 745.004165] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 745.004204] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 745.004444] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 745.004526] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 745.004655] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 722d23d9-051d-49bc-9a6f-82d9111ef481 already deleted. [ 745.004712] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-722d23d9-051d-49bc-9a6f-82d9111ef481" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 745.004849] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-722d23d9-051d-49bc-9a6f-82d9111ef481" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 745.005021] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-722d23d9-051d-49bc-9a6f-82d9111ef481" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 745.005096] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('722d23d9-051d-49bc-9a6f-82d9111ef481',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 745.121339] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 420136f3-91df-4669-b5e3-cee436aeacb9 in Status: SUCCESS [ 745.121672] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-420136f3-91df-4669-b5e3-cee436aeacb9" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 745.340429] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('0cacf152-a4d4-4487-a370-aa2bae090120',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 745.372187] env[65370]: INFO networking_nsxv3.common.synchronization [req-025901a3-0963-4790-a642-d56017f744f1 req-0fd9930a-6275-430a-88b9-579c7a346432 tempest-SecurityGroupRulesTestJSON-1280346518 tempest-SecurityGroupRulesTestJSON-1280346518-project-member] Enqueued Resource ID: 0dbbaa67-0aee-44e9-ae9c-7909a0a4d171 with Priority: HIGHEST for action security_group_rules [ 745.373793] env[65370]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0dbbaa67-0aee-44e9-ae9c-7909a0a4d171 with Priority: HIGHEST for action security_group_rules [ 745.373793] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock rules-0dbbaa67-0aee-44e9-ae9c-7909a0a4d171 taken with stack trace [, , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 745.373985] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-0dbbaa67-0aee-44e9-ae9c-7909a0a4d171" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 745.373985] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-0dbbaa67-0aee-44e9-ae9c-7909a0a4d171" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 745.374252] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-0dbbaa67-0aee-44e9-ae9c-7909a0a4d171" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 745.374355] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('0dbbaa67-0aee-44e9-ae9c-7909a0a4d171',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 745.536081] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 745.536268] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 745.536359] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 745.536580] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 745.536632] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 745.536718] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 722d23d9-051d-49bc-9a6f-82d9111ef481 already deleted. [ 745.536904] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-722d23d9-051d-49bc-9a6f-82d9111ef481" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 745.844034] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 745.844034] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 745.844034] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 745.844284] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 745.844316] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 745.844412] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0cacf152-a4d4-4487-a370-aa2bae090120 is going to be updated. [ 745.893901] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 745.894077] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 745.894140] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 745.894371] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 745.894568] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 745.901150] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 745.901351] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 745.901460] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 745.901731] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 745.901846] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 745.901947] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 0dbbaa67-0aee-44e9-ae9c-7909a0a4d171 already deleted. [ 745.902055] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-0dbbaa67-0aee-44e9-ae9c-7909a0a4d171" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 745.909213] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0cacf152-a4d4-4487-a370-aa2bae090120 in Status: IN_PROGRESS for 2s [ 746.093746] env[65370]: INFO networking_nsxv3.common.synchronization [req-1ded8605-cc36-4b91-bbd4-8ce921dbe688 req-7bb4aa48-bad8-4648-ae87-0a8f8b4f8e99 tempest-ListServersNegativeTestJSON-1430921204 tempest-ListServersNegativeTestJSON-1430921204-project-member] Enqueued Resource ID: 0cacf152-a4d4-4487-a370-aa2bae090120 with Priority: HIGHEST for action security_group_members [ 746.094857] env[65370]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0cacf152-a4d4-4487-a370-aa2bae090120 with Priority: HIGHEST for action security_group_members [ 746.094857] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock member-0cacf152-a4d4-4487-a370-aa2bae090120 taken with stack trace [, , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 746.094857] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0cacf152-a4d4-4487-a370-aa2bae090120" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 746.320412] env[65370]: INFO networking_nsxv3.common.synchronization [req-8cf0639a-5a48-4858-823c-74eb5f224b89 req-edd54fa5-914f-4865-9da7-3c70c62c8c93 tempest-ServerRescueTestJSONUnderV235-1438794252 tempest-ServerRescueTestJSONUnderV235-1438794252-project-member] Enqueued Resource ID: 5132c293-b680-4491-ba2b-122515a71eaf with Priority: HIGHEST for action security_group_members [ 746.321263] env[65370]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5132c293-b680-4491-ba2b-122515a71eaf with Priority: HIGHEST for action security_group_members [ 746.322431] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock member-5132c293-b680-4491-ba2b-122515a71eaf taken with stack trace [, , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 746.322431] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5132c293-b680-4491-ba2b-122515a71eaf" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 746.322431] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5132c293-b680-4491-ba2b-122515a71eaf" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 746.322431] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5132c293-b680-4491-ba2b-122515a71eaf" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 746.322431] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 746.322431] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 746.322431] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 746.322431] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 746.322431] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 746.322431] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5132c293-b680-4491-ba2b-122515a71eaf',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 746.676628] env[65370]: DEBUG networking_nsxv3.common.locking [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Lock network-134 taken with stack trace [, , , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 746.676628] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquiring lock "network-134" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 746.676628] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquired lock "network-134" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 746.676628] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquired external semaphore "network-134" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 746.677110] env[65370]: DEBUG networking_nsxv3.common.locking [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 746.677110] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquiring lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 746.677558] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquired lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 746.677558] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquired external semaphore "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 746.677558] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Releasing lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 746.677819] env[65370]: DEBUG dogpile.cache.region [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] No value present for key: 'zone-id' {{(pid=65370) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 746.678028] env[65370]: DEBUG dogpile.lock [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] NeedRegenerationException {{(pid=65370) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 746.678211] env[65370]: DEBUG dogpile.lock [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] no value, waiting for create lock {{(pid=65370) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 746.678284] env[65370]: DEBUG dogpile.lock [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] value creation lock acquired {{(pid=65370) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 746.678343] env[65370]: DEBUG dogpile.cache.region [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] No value present for key: 'zone-id' {{(pid=65370) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 746.678439] env[65370]: DEBUG dogpile.lock [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Calling creation function for not-yet-present value {{(pid=65370) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 746.678569] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 746.700144] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 746.700540] env[65370]: DEBUG dogpile.cache.region [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=65370) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 746.700794] env[65370]: DEBUG dogpile.lock [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Released creation lock {{(pid=65370) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 746.700992] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Releasing lock "network-134" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 746.701435] env[65370]: DEBUG networking_nsxv3.common.locking [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Lock port-14abbe38-c370-46d6-88c9-b8444585d56d taken with stack trace [, , , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 746.701619] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquiring lock "port-14abbe38-c370-46d6-88c9-b8444585d56d" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 746.701761] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquired lock "port-14abbe38-c370-46d6-88c9-b8444585d56d" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 746.702178] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquired external semaphore "port-14abbe38-c370-46d6-88c9-b8444585d56d" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 746.702322] env[65370]: DEBUG networking_nsxv3.api.rpc [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('14abbe38-c370-46d6-88c9-b8444585d56d',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 746.824677] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 746.824965] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 746.825108] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 746.825473] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 746.825639] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 746.825949] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 746.826173] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 746.826258] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 746.826555] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 746.826715] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 746.826873] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5132c293-b680-4491-ba2b-122515a71eaf is going to be updated. [ 746.865190] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 746.865190] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 746.865455] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 746.865578] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 746.865737] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 746.879239] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5132c293-b680-4491-ba2b-122515a71eaf in Status: IN_PROGRESS for 2s [ 747.205170] env[65370]: DEBUG networking_nsxv3.common.locking [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 747.205551] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquiring lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 747.205696] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquired lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 747.205977] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquired external semaphore "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 747.206163] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Releasing lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 747.206383] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Segment Port 14abbe38-c370-46d6-88c9-b8444585d56d not found, creating... [ 747.206665] env[65370]: DEBUG networking_nsxv3.common.locking [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 747.206878] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquiring lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 747.206994] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquired lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 747.207226] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquired external semaphore "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 747.207387] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Releasing lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 747.208055] env[65370]: DEBUG networking_nsxv3.common.locking [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 747.208336] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquiring lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 747.208531] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquired lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 747.208876] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquired external semaphore "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 747.209139] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Releasing lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 747.209374] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Resource: SegmentPort with ID: 14abbe38-c370-46d6-88c9-b8444585d56d is going to be created. [ 747.240910] env[65370]: DEBUG networking_nsxv3.common.locking [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 747.241177] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquiring lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 747.241242] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquired lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 747.241582] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquired external semaphore "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 747.241822] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Releasing lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 747.242056] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Releasing lock "port-14abbe38-c370-46d6-88c9-b8444585d56d" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 747.924315] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0cacf152-a4d4-4487-a370-aa2bae090120 in Status: SUCCESS [ 747.924783] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0cacf152-a4d4-4487-a370-aa2bae090120" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 747.925037] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0cacf152-a4d4-4487-a370-aa2bae090120" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 747.925484] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0cacf152-a4d4-4487-a370-aa2bae090120" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 747.925773] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 747.925995] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 747.926132] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 747.926516] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 747.926664] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 747.926772] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0cacf152-a4d4-4487-a370-aa2bae090120" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 747.926899] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('0cacf152-a4d4-4487-a370-aa2bae090120',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 747.928032] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0cacf152-a4d4-4487-a370-aa2bae090120" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 747.928286] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0cacf152-a4d4-4487-a370-aa2bae090120" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 747.928513] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 747.928653] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 747.928725] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 747.928922] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 747.929032] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 747.930145] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0cacf152-a4d4-4487-a370-aa2bae090120',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 748.054034] env[65370]: INFO networking_nsxv3.common.synchronization [req-1ded8605-cc36-4b91-bbd4-8ce921dbe688 req-36e4a5d6-f191-492d-834c-b159c73f8249 service nova] Enqueued Resource ID: 0cacf152-a4d4-4487-a370-aa2bae090120 with Priority: HIGHEST for action security_group_rules [ 748.054194] env[65370]: INFO networking_nsxv3.common.synchronization [req-1ded8605-cc36-4b91-bbd4-8ce921dbe688 req-36e4a5d6-f191-492d-834c-b159c73f8249 service nova] Enqueued Resource ID: 0cacf152-a4d4-4487-a370-aa2bae090120 with Priority: HIGHEST for action security_group_members [ 748.054194] env[65370]: INFO networking_nsxv3.common.synchronization [req-1ded8605-cc36-4b91-bbd4-8ce921dbe688 req-36e4a5d6-f191-492d-834c-b159c73f8249 service nova] Enqueued Resource ID: 14abbe38-c370-46d6-88c9-b8444585d56d with Priority: HIGHEST for action port [ 748.054694] env[65370]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0cacf152-a4d4-4487-a370-aa2bae090120 with Priority: HIGHEST for action security_group_rules [ 748.054829] env[65370]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0cacf152-a4d4-4487-a370-aa2bae090120 with Priority: HIGHEST for action security_group_members [ 748.054922] env[65370]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 14abbe38-c370-46d6-88c9-b8444585d56d with Priority: HIGHEST for action port [ 748.055197] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock rules-0cacf152-a4d4-4487-a370-aa2bae090120 taken with stack trace [, , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 748.055768] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-0cacf152-a4d4-4487-a370-aa2bae090120" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 748.055768] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock member-0cacf152-a4d4-4487-a370-aa2bae090120 taken with stack trace [, , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 748.055768] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0cacf152-a4d4-4487-a370-aa2bae090120" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 748.055978] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock port-14abbe38-c370-46d6-88c9-b8444585d56d taken with stack trace [, , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 748.055978] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-14abbe38-c370-46d6-88c9-b8444585d56d" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 748.055978] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-14abbe38-c370-46d6-88c9-b8444585d56d" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 748.056196] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-14abbe38-c370-46d6-88c9-b8444585d56d" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 748.056317] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('14abbe38-c370-46d6-88c9-b8444585d56d',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 748.433141] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock member-0cacf152-a4d4-4487-a370-aa2bae090120 taken with stack trace [, , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 748.433324] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0cacf152-a4d4-4487-a370-aa2bae090120" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 748.434715] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('0cacf152-a4d4-4487-a370-aa2bae090120',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 748.559236] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 14abbe38-c370-46d6-88c9-b8444585d56d with status ACTIVE [ 748.559480] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 748.559718] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 748.559815] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 748.560329] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 748.560571] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 748.560790] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 748.560906] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 748.560996] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 748.561251] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 748.561401] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 748.561860] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 748.561984] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 748.562044] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 748.562200] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 748.562280] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 748.562359] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 14abbe38-c370-46d6-88c9-b8444585d56d is going to be updated. [ 748.584013] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 748.584189] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 748.584236] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 748.584524] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 748.584659] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 748.584824] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-14abbe38-c370-46d6-88c9-b8444585d56d" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 748.713087] env[65370]: INFO networking_nsxv3.common.synchronization [None req-1ad72c9c-656a-42d1-b11c-1c06ebf1b2ff None None] Enqueued Resource ID: 99bcc845-a6fc-479c-9f7b-65e1e73b0999 with Priority: HIGHEST for action port [ 748.713829] env[65370]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 99bcc845-a6fc-479c-9f7b-65e1e73b0999 with Priority: HIGHEST for action port [ 748.714183] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock port-99bcc845-a6fc-479c-9f7b-65e1e73b0999 taken with stack trace [, , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 748.714353] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-99bcc845-a6fc-479c-9f7b-65e1e73b0999" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 748.714420] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-99bcc845-a6fc-479c-9f7b-65e1e73b0999" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 748.714657] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-99bcc845-a6fc-479c-9f7b-65e1e73b0999" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 748.714749] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('99bcc845-a6fc-479c-9f7b-65e1e73b0999',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 748.894278] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5132c293-b680-4491-ba2b-122515a71eaf in Status: SUCCESS [ 748.894859] env[65370]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5132c293-b680-4491-ba2b-122515a71eaf deletion is rescheduled due to dependency. [ 748.894981] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5132c293-b680-4491-ba2b-122515a71eaf" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 748.938182] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('0cacf152-a4d4-4487-a370-aa2bae090120',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 749.142023] env[65370]: INFO networking_nsxv3.common.synchronization [req-87edf332-176c-4852-86da-5585e94229bc req-cf92d5d4-17fa-4416-b4d9-d4f0df9cd1e0 tempest-MigrationsAdminTest-1653527346 tempest-MigrationsAdminTest-1653527346-project-member] Enqueued Resource ID: 00a251e9-7a00-4293-9092-9556bc8b91c2 with Priority: HIGHEST for action security_group_members [ 749.142023] env[65370]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 00a251e9-7a00-4293-9092-9556bc8b91c2 with Priority: HIGHEST for action security_group_members [ 749.142023] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock member-00a251e9-7a00-4293-9092-9556bc8b91c2 taken with stack trace [, , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 749.142023] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-00a251e9-7a00-4293-9092-9556bc8b91c2" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 749.142023] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-00a251e9-7a00-4293-9092-9556bc8b91c2" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 749.142023] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-00a251e9-7a00-4293-9092-9556bc8b91c2" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 749.142547] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 749.143176] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 749.143176] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 749.143176] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 749.143404] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 749.143404] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('00a251e9-7a00-4293-9092-9556bc8b91c2',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 749.217260] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 99bcc845-a6fc-479c-9f7b-65e1e73b0999 [ 749.217761] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 749.217761] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 749.217884] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 749.218105] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 749.218235] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 749.218376] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:99bcc845-a6fc-479c-9f7b-65e1e73b0999 already deleted. [ 749.218481] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-99bcc845-a6fc-479c-9f7b-65e1e73b0999" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 749.442411] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 749.443911] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 749.443911] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 749.443911] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 749.443911] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 749.444301] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0cacf152-a4d4-4487-a370-aa2bae090120 is going to be updated. [ 749.499708] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 749.500016] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 749.500164] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 749.500409] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 749.500571] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 749.513063] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0cacf152-a4d4-4487-a370-aa2bae090120 in Status: IN_PROGRESS for 2s [ 749.646563] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('00a251e9-7a00-4293-9092-9556bc8b91c2',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 750.153548] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('00a251e9-7a00-4293-9092-9556bc8b91c2',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 750.189306] env[65370]: DEBUG networking_nsxv3.common.locking [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Lock network-449 taken with stack trace [, , , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 750.189306] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquiring lock "network-449" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 750.189306] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquired lock "network-449" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 750.189541] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquired external semaphore "network-449" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 750.190218] env[65370]: DEBUG networking_nsxv3.common.locking [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 750.190218] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquiring lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 750.190218] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquired lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 750.190416] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquired external semaphore "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 750.190527] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Releasing lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 750.190843] env[65370]: DEBUG dogpile.cache.region [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] No value present for key: 'zone-id' {{(pid=65370) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 750.190983] env[65370]: DEBUG dogpile.lock [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] NeedRegenerationException {{(pid=65370) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 750.191128] env[65370]: DEBUG dogpile.lock [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] no value, waiting for create lock {{(pid=65370) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 750.191257] env[65370]: DEBUG dogpile.lock [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] value creation lock acquired {{(pid=65370) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 750.191393] env[65370]: DEBUG dogpile.cache.region [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] No value present for key: 'zone-id' {{(pid=65370) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 750.191584] env[65370]: DEBUG dogpile.lock [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Calling creation function for not-yet-present value {{(pid=65370) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 750.191763] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 750.212055] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 750.212222] env[65370]: DEBUG dogpile.cache.region [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=65370) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 750.212351] env[65370]: DEBUG dogpile.lock [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Released creation lock {{(pid=65370) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 750.213190] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Releasing lock "network-449" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 750.213517] env[65370]: DEBUG networking_nsxv3.common.locking [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Lock port-a6e4d6eb-44b0-4e93-856d-a9a3d4043d16 taken with stack trace [, , , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 750.213682] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquiring lock "port-a6e4d6eb-44b0-4e93-856d-a9a3d4043d16" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 750.213792] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquired lock "port-a6e4d6eb-44b0-4e93-856d-a9a3d4043d16" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 750.214364] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquired external semaphore "port-a6e4d6eb-44b0-4e93-856d-a9a3d4043d16" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 750.214540] env[65370]: DEBUG networking_nsxv3.api.rpc [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a6e4d6eb-44b0-4e93-856d-a9a3d4043d16',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 750.658262] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 750.660685] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 750.660685] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 750.660685] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 750.660685] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 750.660685] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 00a251e9-7a00-4293-9092-9556bc8b91c2 is going to be updated. [ 750.712031] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 750.712031] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 750.712031] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 750.712031] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 750.712031] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 750.720430] env[65370]: DEBUG networking_nsxv3.common.locking [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 750.720430] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquiring lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 750.720430] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquired lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 750.720430] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquired external semaphore "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 750.720430] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Releasing lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 750.720430] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Segment Port a6e4d6eb-44b0-4e93-856d-a9a3d4043d16 not found, creating... [ 750.720430] env[65370]: DEBUG networking_nsxv3.common.locking [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 750.720430] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquiring lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 750.720430] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquired lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 750.720430] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquired external semaphore "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 750.720430] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Releasing lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 750.721771] env[65370]: DEBUG networking_nsxv3.common.locking [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 750.722186] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquiring lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 750.722491] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquired lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 750.725068] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquired external semaphore "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 750.725068] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Releasing lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 750.725068] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Resource: SegmentPort with ID: a6e4d6eb-44b0-4e93-856d-a9a3d4043d16 is going to be created. [ 750.726657] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 00a251e9-7a00-4293-9092-9556bc8b91c2 in Status: IN_PROGRESS for 2s [ 750.757119] env[65370]: DEBUG networking_nsxv3.common.locking [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 750.757618] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquiring lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 750.757866] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquired lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 750.758378] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquired external semaphore "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 750.758378] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Releasing lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 750.758662] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Releasing lock "port-a6e4d6eb-44b0-4e93-856d-a9a3d4043d16" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 751.531893] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0cacf152-a4d4-4487-a370-aa2bae090120 in Status: SUCCESS [ 751.532419] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0cacf152-a4d4-4487-a370-aa2bae090120" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 751.532728] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0cacf152-a4d4-4487-a370-aa2bae090120" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 751.535150] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0cacf152-a4d4-4487-a370-aa2bae090120" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 751.535376] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 751.535509] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 751.535595] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 751.535835] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 751.536039] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 751.536153] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0cacf152-a4d4-4487-a370-aa2bae090120',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 751.598939] env[65370]: INFO networking_nsxv3.common.synchronization [req-87edf332-176c-4852-86da-5585e94229bc req-8ea9df66-8bc9-41ff-8fcc-53f45c3760a3 service nova] Enqueued Resource ID: 00a251e9-7a00-4293-9092-9556bc8b91c2 with Priority: HIGHEST for action security_group_rules [ 751.598939] env[65370]: INFO networking_nsxv3.common.synchronization [req-87edf332-176c-4852-86da-5585e94229bc req-8ea9df66-8bc9-41ff-8fcc-53f45c3760a3 service nova] Enqueued Resource ID: 00a251e9-7a00-4293-9092-9556bc8b91c2 with Priority: HIGHEST for action security_group_members [ 751.598939] env[65370]: INFO networking_nsxv3.common.synchronization [req-87edf332-176c-4852-86da-5585e94229bc req-8ea9df66-8bc9-41ff-8fcc-53f45c3760a3 service nova] Enqueued Resource ID: a6e4d6eb-44b0-4e93-856d-a9a3d4043d16 with Priority: HIGHEST for action port [ 751.599550] env[65370]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 00a251e9-7a00-4293-9092-9556bc8b91c2 with Priority: HIGHEST for action security_group_rules [ 751.599697] env[65370]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 00a251e9-7a00-4293-9092-9556bc8b91c2 with Priority: HIGHEST for action security_group_members [ 751.599793] env[65370]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a6e4d6eb-44b0-4e93-856d-a9a3d4043d16 with Priority: HIGHEST for action port [ 751.600099] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock rules-00a251e9-7a00-4293-9092-9556bc8b91c2 taken with stack trace [, , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 751.600195] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-00a251e9-7a00-4293-9092-9556bc8b91c2" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 751.600300] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-00a251e9-7a00-4293-9092-9556bc8b91c2" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 751.600460] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-00a251e9-7a00-4293-9092-9556bc8b91c2" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 751.600543] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('00a251e9-7a00-4293-9092-9556bc8b91c2',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 751.601605] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock member-00a251e9-7a00-4293-9092-9556bc8b91c2 taken with stack trace [, , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 751.601605] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-00a251e9-7a00-4293-9092-9556bc8b91c2" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 751.601770] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock port-a6e4d6eb-44b0-4e93-856d-a9a3d4043d16 taken with stack trace [, , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 751.601875] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-a6e4d6eb-44b0-4e93-856d-a9a3d4043d16" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 751.601875] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-a6e4d6eb-44b0-4e93-856d-a9a3d4043d16" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 751.602039] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-a6e4d6eb-44b0-4e93-856d-a9a3d4043d16" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 751.602116] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a6e4d6eb-44b0-4e93-856d-a9a3d4043d16',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 751.721368] env[65370]: INFO networking_nsxv3.common.synchronization [None req-c0581817-c8a4-4fcb-a8b2-4687a89f98ca None None] Enqueued Resource ID: 5612423d-c95e-4c35-87b7-f51fc6087946 with Priority: HIGHEST for action port [ 751.721368] env[65370]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5612423d-c95e-4c35-87b7-f51fc6087946 with Priority: HIGHEST for action port [ 751.721368] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock port-5612423d-c95e-4c35-87b7-f51fc6087946 taken with stack trace [, , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 751.721368] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-5612423d-c95e-4c35-87b7-f51fc6087946" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 751.721368] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-5612423d-c95e-4c35-87b7-f51fc6087946" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 751.721931] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-5612423d-c95e-4c35-87b7-f51fc6087946" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 751.722126] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5612423d-c95e-4c35-87b7-f51fc6087946',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 752.040186] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('0cacf152-a4d4-4487-a370-aa2bae090120',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 752.105483] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock member-00a251e9-7a00-4293-9092-9556bc8b91c2 taken with stack trace [, , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 752.105674] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-00a251e9-7a00-4293-9092-9556bc8b91c2" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 752.105819] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port a6e4d6eb-44b0-4e93-856d-a9a3d4043d16 with status ACTIVE [ 752.105990] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 752.106116] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 752.106166] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 752.106392] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 752.106498] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 752.106665] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 752.106867] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 752.106867] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 752.107106] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 752.107106] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 752.107267] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 752.107332] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 752.107368] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 752.107493] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 752.107566] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 752.107878] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: a6e4d6eb-44b0-4e93-856d-a9a3d4043d16 is going to be updated. [ 752.135114] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 752.135349] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 752.135447] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 752.135704] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 752.135852] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 752.136027] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-a6e4d6eb-44b0-4e93-856d-a9a3d4043d16" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 752.223975] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 5612423d-c95e-4c35-87b7-f51fc6087946 [ 752.224697] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 752.224697] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 752.224697] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 752.224889] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 752.224889] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 752.226210] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:5612423d-c95e-4c35-87b7-f51fc6087946 already deleted. [ 752.226210] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-5612423d-c95e-4c35-87b7-f51fc6087946" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 752.542400] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('0cacf152-a4d4-4487-a370-aa2bae090120',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 752.600236] env[65370]: INFO networking_nsxv3.common.synchronization [req-aaa50e5b-1228-4a4a-ac85-9b6267e7543c req-b9d7fc23-9131-4391-ab62-c95923e22bf3 tempest-ServersTestFqdnHostnames-1392648948 tempest-ServersTestFqdnHostnames-1392648948-project-member] Enqueued Resource ID: 6f93689f-ae79-496c-bd6b-5fcec0a3824f with Priority: HIGHEST for action security_group_members [ 752.600894] env[65370]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6f93689f-ae79-496c-bd6b-5fcec0a3824f with Priority: HIGHEST for action security_group_members [ 752.601243] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock member-6f93689f-ae79-496c-bd6b-5fcec0a3824f taken with stack trace [, , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 752.601367] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6f93689f-ae79-496c-bd6b-5fcec0a3824f" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 752.601429] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6f93689f-ae79-496c-bd6b-5fcec0a3824f" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 752.601673] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6f93689f-ae79-496c-bd6b-5fcec0a3824f" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 752.601822] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 752.601929] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 752.601994] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 752.602452] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 752.602542] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 752.603847] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6f93689f-ae79-496c-bd6b-5fcec0a3824f',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 752.743838] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 00a251e9-7a00-4293-9092-9556bc8b91c2 in Status: SUCCESS [ 752.745135] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-00a251e9-7a00-4293-9092-9556bc8b91c2" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 752.745410] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-00a251e9-7a00-4293-9092-9556bc8b91c2" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 752.745651] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-00a251e9-7a00-4293-9092-9556bc8b91c2" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 752.747015] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 752.747015] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 752.747015] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 752.747015] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 752.747015] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 752.747015] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('00a251e9-7a00-4293-9092-9556bc8b91c2',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 753.046159] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 753.046159] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 753.048053] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 753.048053] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 753.048053] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 753.048053] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0cacf152-a4d4-4487-a370-aa2bae090120 is going to be updated. [ 753.075891] env[65370]: DEBUG networking_nsxv3.common.locking [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Lock network-853 taken with stack trace [, , , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 753.075891] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquiring lock "network-853" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 753.075891] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquired lock "network-853" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 753.075891] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquired external semaphore "network-853" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 753.076432] env[65370]: DEBUG networking_nsxv3.common.locking [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 753.076432] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquiring lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 753.076620] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquired lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 753.076769] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquired external semaphore "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 753.076884] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Releasing lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 753.077453] env[65370]: DEBUG dogpile.cache.region [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] No value present for key: 'zone-id' {{(pid=65370) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 753.077453] env[65370]: DEBUG dogpile.lock [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] NeedRegenerationException {{(pid=65370) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 753.077453] env[65370]: DEBUG dogpile.lock [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] no value, waiting for create lock {{(pid=65370) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 753.077453] env[65370]: DEBUG dogpile.lock [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] value creation lock acquired {{(pid=65370) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 753.077779] env[65370]: DEBUG dogpile.cache.region [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] No value present for key: 'zone-id' {{(pid=65370) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 753.077779] env[65370]: DEBUG dogpile.lock [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Calling creation function for not-yet-present value {{(pid=65370) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 753.077779] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 753.079710] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 753.079844] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 753.079898] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 753.080058] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 753.080199] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 753.092529] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0cacf152-a4d4-4487-a370-aa2bae090120 in Status: IN_PROGRESS for 2s [ 753.103527] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 753.103720] env[65370]: DEBUG dogpile.cache.region [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Cache value generated in 0.026 seconds for key(s): 'zone-id' {{(pid=65370) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 753.103985] env[65370]: DEBUG dogpile.lock [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Released creation lock {{(pid=65370) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 753.103985] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Releasing lock "network-853" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 753.104356] env[65370]: DEBUG networking_nsxv3.common.locking [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Lock port-c0d993d7-2eff-4f86-8738-15dd992c490c taken with stack trace [, , , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 753.104617] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquiring lock "port-c0d993d7-2eff-4f86-8738-15dd992c490c" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 753.104772] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquired lock "port-c0d993d7-2eff-4f86-8738-15dd992c490c" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 753.105601] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquired external semaphore "port-c0d993d7-2eff-4f86-8738-15dd992c490c" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 753.105601] env[65370]: DEBUG networking_nsxv3.api.rpc [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c0d993d7-2eff-4f86-8738-15dd992c490c',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 753.106785] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 753.106913] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 753.107213] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 753.107446] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 753.107576] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 753.107839] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 753.107939] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 753.108032] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 753.108222] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 753.108306] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 753.108393] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6f93689f-ae79-496c-bd6b-5fcec0a3824f already deleted. [ 753.108484] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6f93689f-ae79-496c-bd6b-5fcec0a3824f" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 753.256123] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('00a251e9-7a00-4293-9092-9556bc8b91c2',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 753.610243] env[65370]: DEBUG networking_nsxv3.common.locking [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 753.610594] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquiring lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 753.610687] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquired lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 753.610972] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquired external semaphore "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 753.611137] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Releasing lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 753.611381] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Segment Port c0d993d7-2eff-4f86-8738-15dd992c490c not found, creating... [ 753.611687] env[65370]: DEBUG networking_nsxv3.common.locking [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 753.612512] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquiring lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 753.612727] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquired lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 753.613177] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquired external semaphore "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 753.613437] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Releasing lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 753.613864] env[65370]: DEBUG networking_nsxv3.common.locking [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 753.614093] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquiring lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 753.614221] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquired lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 753.614529] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquired external semaphore "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 753.614726] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Releasing lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 753.614939] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Resource: SegmentPort with ID: c0d993d7-2eff-4f86-8738-15dd992c490c is going to be created. [ 753.643156] env[65370]: DEBUG networking_nsxv3.common.locking [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 753.643470] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquiring lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 753.643566] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquired lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 753.643781] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquired external semaphore "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 753.644085] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Releasing lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 753.644399] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Releasing lock "port-c0d993d7-2eff-4f86-8738-15dd992c490c" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 753.754954] env[65370]: INFO networking_nsxv3.common.synchronization [None req-8da8ac91-2f1a-425b-a959-71c6d953381f None None] Enqueued Resource ID: 3616066d-2ea5-4349-8864-fca6f60e2016 with Priority: HIGHEST for action port [ 753.755441] env[65370]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3616066d-2ea5-4349-8864-fca6f60e2016 with Priority: HIGHEST for action port [ 753.755849] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock port-3616066d-2ea5-4349-8864-fca6f60e2016 taken with stack trace [, , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 753.755983] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-3616066d-2ea5-4349-8864-fca6f60e2016" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 753.756061] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-3616066d-2ea5-4349-8864-fca6f60e2016" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 753.756300] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-3616066d-2ea5-4349-8864-fca6f60e2016" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 753.756451] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3616066d-2ea5-4349-8864-fca6f60e2016',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 753.760233] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('00a251e9-7a00-4293-9092-9556bc8b91c2',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 754.261443] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 3616066d-2ea5-4349-8864-fca6f60e2016 [ 754.261443] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 754.261443] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 754.261443] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 754.261443] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 754.261443] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 754.261443] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:3616066d-2ea5-4349-8864-fca6f60e2016 already deleted. [ 754.261443] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-3616066d-2ea5-4349-8864-fca6f60e2016" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 754.263525] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 754.263915] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 754.266089] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 754.266089] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 754.266089] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 754.266089] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 00a251e9-7a00-4293-9092-9556bc8b91c2 is going to be updated. [ 754.302342] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 754.302342] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 754.302342] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 754.302342] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 754.302342] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 754.318088] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 00a251e9-7a00-4293-9092-9556bc8b91c2 in Status: IN_PROGRESS for 2s [ 754.392613] env[65370]: INFO networking_nsxv3.common.synchronization [req-aaa50e5b-1228-4a4a-ac85-9b6267e7543c req-ff3eaea5-c880-4a38-a846-d3c3b399f20a service nova] Enqueued Resource ID: 6f93689f-ae79-496c-bd6b-5fcec0a3824f with Priority: HIGHEST for action security_group_rules [ 754.392823] env[65370]: INFO networking_nsxv3.common.synchronization [req-aaa50e5b-1228-4a4a-ac85-9b6267e7543c req-ff3eaea5-c880-4a38-a846-d3c3b399f20a service nova] Enqueued Resource ID: 6f93689f-ae79-496c-bd6b-5fcec0a3824f with Priority: HIGHEST for action security_group_members [ 754.392957] env[65370]: INFO networking_nsxv3.common.synchronization [req-aaa50e5b-1228-4a4a-ac85-9b6267e7543c req-ff3eaea5-c880-4a38-a846-d3c3b399f20a service nova] Enqueued Resource ID: c0d993d7-2eff-4f86-8738-15dd992c490c with Priority: HIGHEST for action port [ 754.393547] env[65370]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6f93689f-ae79-496c-bd6b-5fcec0a3824f with Priority: HIGHEST for action security_group_rules [ 754.393960] env[65370]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6f93689f-ae79-496c-bd6b-5fcec0a3824f with Priority: HIGHEST for action security_group_members [ 754.393960] env[65370]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c0d993d7-2eff-4f86-8738-15dd992c490c with Priority: HIGHEST for action port [ 754.394361] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock rules-6f93689f-ae79-496c-bd6b-5fcec0a3824f taken with stack trace [, , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 754.394523] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-6f93689f-ae79-496c-bd6b-5fcec0a3824f" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 754.394569] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-6f93689f-ae79-496c-bd6b-5fcec0a3824f" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 754.394745] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-6f93689f-ae79-496c-bd6b-5fcec0a3824f" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 754.394862] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('6f93689f-ae79-496c-bd6b-5fcec0a3824f',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 754.395807] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock member-6f93689f-ae79-496c-bd6b-5fcec0a3824f taken with stack trace [, , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 754.395930] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6f93689f-ae79-496c-bd6b-5fcec0a3824f" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 754.395982] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6f93689f-ae79-496c-bd6b-5fcec0a3824f" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 754.396179] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6f93689f-ae79-496c-bd6b-5fcec0a3824f" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 754.396456] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 754.397452] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 754.397452] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 754.397452] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 754.397452] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 754.397452] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6f93689f-ae79-496c-bd6b-5fcec0a3824f',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 754.398940] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock port-c0d993d7-2eff-4f86-8738-15dd992c490c taken with stack trace [, , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 754.398940] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-c0d993d7-2eff-4f86-8738-15dd992c490c" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 754.398940] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-c0d993d7-2eff-4f86-8738-15dd992c490c" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 754.398940] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-c0d993d7-2eff-4f86-8738-15dd992c490c" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 754.398940] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c0d993d7-2eff-4f86-8738-15dd992c490c',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 754.902043] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock member-6f93689f-ae79-496c-bd6b-5fcec0a3824f taken with stack trace [, , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 754.902493] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6f93689f-ae79-496c-bd6b-5fcec0a3824f" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 754.902493] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('6f93689f-ae79-496c-bd6b-5fcec0a3824f',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 754.904710] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port c0d993d7-2eff-4f86-8738-15dd992c490c with status ACTIVE [ 754.904978] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 754.905125] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 754.905188] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 754.905991] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 754.905991] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 754.905991] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 754.905991] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 754.905991] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 754.907338] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 754.907338] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 754.907471] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 754.907636] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 754.907717] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 754.908682] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 754.908682] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 754.908682] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: c0d993d7-2eff-4f86-8738-15dd992c490c is going to be updated. [ 754.943416] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 754.943777] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 754.943878] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 754.944189] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 754.944497] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 754.944800] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-c0d993d7-2eff-4f86-8738-15dd992c490c" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 755.108403] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0cacf152-a4d4-4487-a370-aa2bae090120 in Status: SUCCESS [ 755.108728] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0cacf152-a4d4-4487-a370-aa2bae090120" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 755.108946] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0cacf152-a4d4-4487-a370-aa2bae090120" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 755.109197] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0cacf152-a4d4-4487-a370-aa2bae090120" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 755.109419] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 755.109542] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 755.109623] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 755.109814] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 755.109892] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 755.109982] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0cacf152-a4d4-4487-a370-aa2bae090120',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 755.411571] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('6f93689f-ae79-496c-bd6b-5fcec0a3824f',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 755.616207] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('0cacf152-a4d4-4487-a370-aa2bae090120',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 755.915100] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 755.915533] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 755.915533] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 755.915702] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 755.915846] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 755.915925] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6f93689f-ae79-496c-bd6b-5fcec0a3824f is going to be created. [ 755.946017] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 755.946250] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 755.946250] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 755.946550] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 755.946719] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 755.956060] env[65370]: INFO networking_nsxv3.common.synchronization [None req-0647be1b-f38b-4f1f-a095-a0392bb144ab None None] Enqueued Resource ID: aa3574d8-a18d-436b-ab81-e18374240a1d with Priority: HIGHEST for action port [ 755.956690] env[65370]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: aa3574d8-a18d-436b-ab81-e18374240a1d with Priority: HIGHEST for action port [ 755.957010] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock port-aa3574d8-a18d-436b-ab81-e18374240a1d taken with stack trace [, , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 755.957153] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-aa3574d8-a18d-436b-ab81-e18374240a1d" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 755.957218] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-aa3574d8-a18d-436b-ab81-e18374240a1d" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 755.957485] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-aa3574d8-a18d-436b-ab81-e18374240a1d" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 755.957565] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('aa3574d8-a18d-436b-ab81-e18374240a1d',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 755.959436] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6f93689f-ae79-496c-bd6b-5fcec0a3824f in Status: UNINITIALIZED for 2s [ 756.118803] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('0cacf152-a4d4-4487-a370-aa2bae090120',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 756.326041] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 00a251e9-7a00-4293-9092-9556bc8b91c2 in Status: SUCCESS [ 756.326251] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-00a251e9-7a00-4293-9092-9556bc8b91c2" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 756.326464] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-00a251e9-7a00-4293-9092-9556bc8b91c2" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 756.326744] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-00a251e9-7a00-4293-9092-9556bc8b91c2" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 756.326961] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 756.327102] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 756.327172] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 756.327336] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 756.327425] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 756.327536] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-00a251e9-7a00-4293-9092-9556bc8b91c2" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 756.327652] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('00a251e9-7a00-4293-9092-9556bc8b91c2',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 756.461328] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port aa3574d8-a18d-436b-ab81-e18374240a1d [ 756.461668] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 756.461879] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 756.462025] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 756.462310] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 756.462456] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 756.462615] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:aa3574d8-a18d-436b-ab81-e18374240a1d already deleted. [ 756.462754] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-aa3574d8-a18d-436b-ab81-e18374240a1d" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 756.621466] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 756.621640] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 756.621723] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 756.622040] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 756.622216] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 756.622346] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0cacf152-a4d4-4487-a370-aa2bae090120 is going to be updated. [ 756.651933] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 756.652203] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 756.652284] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 756.652584] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 756.652750] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 756.665843] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0cacf152-a4d4-4487-a370-aa2bae090120 in Status: IN_PROGRESS for 2s [ 756.829886] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock member-00a251e9-7a00-4293-9092-9556bc8b91c2 taken with stack trace [, , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 756.830181] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-00a251e9-7a00-4293-9092-9556bc8b91c2" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 756.830270] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-00a251e9-7a00-4293-9092-9556bc8b91c2" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 756.830566] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-00a251e9-7a00-4293-9092-9556bc8b91c2" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 756.830798] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 756.830931] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 756.831045] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 756.831289] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 756.831424] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 756.831558] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-00a251e9-7a00-4293-9092-9556bc8b91c2" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 756.831795] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock member-00a251e9-7a00-4293-9092-9556bc8b91c2 taken with stack trace [, , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 756.831967] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-00a251e9-7a00-4293-9092-9556bc8b91c2" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 756.832056] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-00a251e9-7a00-4293-9092-9556bc8b91c2" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 756.832292] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-00a251e9-7a00-4293-9092-9556bc8b91c2" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 756.832454] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 756.832586] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 756.832651] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 756.833208] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 756.833284] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 756.833377] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-00a251e9-7a00-4293-9092-9556bc8b91c2" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 756.833521] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('00a251e9-7a00-4293-9092-9556bc8b91c2',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 757.336067] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 00a251e9-7a00-4293-9092-9556bc8b91c2: rpc.has_security_group_logging(os_id): False [ 757.357554] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 757.357554] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 757.357554] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 757.357832] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 757.382236] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 757.382492] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 757.382625] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 757.382689] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 757.382961] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 757.383052] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 757.383337] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 757.383470] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 757.383547] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 757.383768] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 757.383893] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 757.384287] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 757.384392] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 757.384427] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 757.384606] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 757.384728] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 757.384820] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 00a251e9-7a00-4293-9092-9556bc8b91c2 is going to be updated. [ 757.468039] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 757.468218] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 757.468298] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 757.468497] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 757.468646] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 757.498715] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 00a251e9-7a00-4293-9092-9556bc8b91c2 in Status: IN_PROGRESS for 2s [ 757.560077] env[65370]: INFO networking_nsxv3.common.synchronization [req-1acda922-f0aa-40f8-9fea-beeb810cfded req-8d890ca2-bfcb-4020-8a46-03fef7533585 tempest-SecurityGroupsTestJSON-1618218766 tempest-SecurityGroupsTestJSON-1618218766-project-member] Enqueued Resource ID: 8d9c7efa-60b6-44af-830b-f32145b1b403 with Priority: HIGHEST for action security_group_members [ 757.560730] env[65370]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8d9c7efa-60b6-44af-830b-f32145b1b403 with Priority: HIGHEST for action security_group_members [ 757.561141] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock member-8d9c7efa-60b6-44af-830b-f32145b1b403 taken with stack trace [, , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 757.561293] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8d9c7efa-60b6-44af-830b-f32145b1b403" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 757.561364] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8d9c7efa-60b6-44af-830b-f32145b1b403" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 757.561607] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8d9c7efa-60b6-44af-830b-f32145b1b403" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 757.561829] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 757.561957] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 757.562059] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 757.562299] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 757.562417] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 757.562527] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('8d9c7efa-60b6-44af-830b-f32145b1b403',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 757.971888] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6f93689f-ae79-496c-bd6b-5fcec0a3824f in Status: SUCCESS [ 757.972286] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6f93689f-ae79-496c-bd6b-5fcec0a3824f" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 757.972442] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6f93689f-ae79-496c-bd6b-5fcec0a3824f" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 757.972726] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6f93689f-ae79-496c-bd6b-5fcec0a3824f" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 757.972954] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 757.973095] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 757.973144] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 757.973316] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 757.973437] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 757.973533] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6f93689f-ae79-496c-bd6b-5fcec0a3824f" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 757.973661] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('6f93689f-ae79-496c-bd6b-5fcec0a3824f',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 758.009026] env[65370]: DEBUG networking_nsxv3.common.locking [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Lock network-633 taken with stack trace [, , , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 758.009026] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquiring lock "network-633" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 758.009026] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquired lock "network-633" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 758.009026] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquired external semaphore "network-633" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 758.009593] env[65370]: DEBUG networking_nsxv3.common.locking [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 758.009900] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquiring lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 758.010216] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquired lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 758.010614] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquired external semaphore "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 758.013020] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Releasing lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 758.013020] env[65370]: DEBUG dogpile.cache.region [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] No value present for key: 'zone-id' {{(pid=65370) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 758.013020] env[65370]: DEBUG dogpile.lock [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] NeedRegenerationException {{(pid=65370) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 758.013020] env[65370]: DEBUG dogpile.lock [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] no value, waiting for create lock {{(pid=65370) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 758.013020] env[65370]: DEBUG dogpile.lock [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] value creation lock acquired {{(pid=65370) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 758.013020] env[65370]: DEBUG dogpile.cache.region [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] No value present for key: 'zone-id' {{(pid=65370) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 758.013020] env[65370]: DEBUG dogpile.lock [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Calling creation function for not-yet-present value {{(pid=65370) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 758.013020] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 758.037685] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 758.037685] env[65370]: DEBUG dogpile.cache.region [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Cache value generated in 0.024 seconds for key(s): 'zone-id' {{(pid=65370) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 758.037685] env[65370]: DEBUG dogpile.lock [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Released creation lock {{(pid=65370) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 758.037685] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Releasing lock "network-633" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 758.037685] env[65370]: DEBUG networking_nsxv3.common.locking [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Lock port-f50b5939-e040-4b41-bb53-4e3dff89fdb6 taken with stack trace [, , , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 758.037685] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquiring lock "port-f50b5939-e040-4b41-bb53-4e3dff89fdb6" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 758.037685] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquired lock "port-f50b5939-e040-4b41-bb53-4e3dff89fdb6" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 758.037685] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquired external semaphore "port-f50b5939-e040-4b41-bb53-4e3dff89fdb6" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 758.037685] env[65370]: DEBUG networking_nsxv3.api.rpc [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f50b5939-e040-4b41-bb53-4e3dff89fdb6',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 758.069425] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('8d9c7efa-60b6-44af-830b-f32145b1b403',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 758.477187] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('6f93689f-ae79-496c-bd6b-5fcec0a3824f',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 758.540861] env[65370]: DEBUG networking_nsxv3.common.locking [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 758.540861] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquiring lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 758.540861] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquired lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 758.541371] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquired external semaphore "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 758.541435] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Releasing lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 758.542601] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Segment Port f50b5939-e040-4b41-bb53-4e3dff89fdb6 not found, creating... [ 758.542601] env[65370]: DEBUG networking_nsxv3.common.locking [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 758.542601] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquiring lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 758.542974] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquired lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 758.544077] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquired external semaphore "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 758.544077] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Releasing lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 758.544385] env[65370]: DEBUG networking_nsxv3.common.locking [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 758.544742] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquiring lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 758.544855] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquired lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 758.545993] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquired external semaphore "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 758.545993] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Releasing lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 758.545993] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Resource: SegmentPort with ID: f50b5939-e040-4b41-bb53-4e3dff89fdb6 is going to be created. [ 758.576236] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('8d9c7efa-60b6-44af-830b-f32145b1b403',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 758.593338] env[65370]: DEBUG networking_nsxv3.common.locking [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 758.593587] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquiring lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 758.593669] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquired lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 758.593988] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquired external semaphore "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 758.594274] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Releasing lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 758.594499] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Releasing lock "port-f50b5939-e040-4b41-bb53-4e3dff89fdb6" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 758.682500] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0cacf152-a4d4-4487-a370-aa2bae090120 in Status: SUCCESS [ 758.682716] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0cacf152-a4d4-4487-a370-aa2bae090120" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 758.682897] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0cacf152-a4d4-4487-a370-aa2bae090120" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 758.683151] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0cacf152-a4d4-4487-a370-aa2bae090120" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 758.683436] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 758.683562] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 758.683628] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 758.683848] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 758.683919] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 758.684011] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0cacf152-a4d4-4487-a370-aa2bae090120" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 758.684176] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock member-0cacf152-a4d4-4487-a370-aa2bae090120 taken with stack trace [, , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 758.684270] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0cacf152-a4d4-4487-a370-aa2bae090120" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 758.684365] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0cacf152-a4d4-4487-a370-aa2bae090120" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 758.684471] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0cacf152-a4d4-4487-a370-aa2bae090120" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 758.684607] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 758.684699] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 758.684761] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 758.684988] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 758.684988] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 758.685113] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0cacf152-a4d4-4487-a370-aa2bae090120" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 758.685171] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('0cacf152-a4d4-4487-a370-aa2bae090120',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 758.982216] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 6f93689f-ae79-496c-bd6b-5fcec0a3824f: rpc.has_security_group_logging(os_id): False [ 759.005689] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 759.005794] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 759.005865] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 759.006345] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 759.006345] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 759.006502] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 759.006625] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 759.009018] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 759.009273] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 759.011369] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 759.011369] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 6f93689f-ae79-496c-bd6b-5fcec0a3824f is going to be created. [ 759.075512] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 759.075766] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 759.075766] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 759.076020] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 759.076225] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 759.079191] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 759.079322] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 759.079391] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 759.079613] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 759.079648] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 759.079901] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8d9c7efa-60b6-44af-830b-f32145b1b403 is going to be updated. [ 759.096302] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 6f93689f-ae79-496c-bd6b-5fcec0a3824f in Status: IN_PROGRESS for 2s [ 759.126835] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 759.126835] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 759.126835] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 759.127084] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 759.127084] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 759.150106] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8d9c7efa-60b6-44af-830b-f32145b1b403 in Status: IN_PROGRESS for 2s [ 759.187345] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 0cacf152-a4d4-4487-a370-aa2bae090120: rpc.has_security_group_logging(os_id): False [ 759.224653] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 759.224984] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 759.225078] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 759.225786] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 759.225786] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 759.225786] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 759.225978] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 759.226788] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 759.227150] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 759.227325] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 759.227674] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 759.228541] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 759.228541] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 759.228541] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 759.228541] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 759.229095] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 759.229284] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 759.229381] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 759.229650] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 759.229725] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 759.229961] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 0cacf152-a4d4-4487-a370-aa2bae090120 is going to be created. [ 759.329019] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 759.329245] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 759.329386] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 759.329709] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 759.330438] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 759.349855] env[65370]: INFO networking_nsxv3.common.synchronization [req-1acda922-f0aa-40f8-9fea-beeb810cfded req-b12b902e-354c-4584-876b-e8ea87a8fec1 service nova] Enqueued Resource ID: 8d9c7efa-60b6-44af-830b-f32145b1b403 with Priority: HIGHEST for action security_group_rules [ 759.350037] env[65370]: INFO networking_nsxv3.common.synchronization [req-1acda922-f0aa-40f8-9fea-beeb810cfded req-b12b902e-354c-4584-876b-e8ea87a8fec1 service nova] Enqueued Resource ID: 8d9c7efa-60b6-44af-830b-f32145b1b403 with Priority: HIGHEST for action security_group_members [ 759.350178] env[65370]: INFO networking_nsxv3.common.synchronization [req-1acda922-f0aa-40f8-9fea-beeb810cfded req-b12b902e-354c-4584-876b-e8ea87a8fec1 service nova] Enqueued Resource ID: f50b5939-e040-4b41-bb53-4e3dff89fdb6 with Priority: HIGHEST for action port [ 759.350416] env[65370]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8d9c7efa-60b6-44af-830b-f32145b1b403 with Priority: HIGHEST for action security_group_rules [ 759.350551] env[65370]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8d9c7efa-60b6-44af-830b-f32145b1b403 with Priority: HIGHEST for action security_group_members [ 759.350930] env[65370]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f50b5939-e040-4b41-bb53-4e3dff89fdb6 with Priority: HIGHEST for action port [ 759.351496] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock rules-8d9c7efa-60b6-44af-830b-f32145b1b403 taken with stack trace [, , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 759.351496] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-8d9c7efa-60b6-44af-830b-f32145b1b403" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 759.351496] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-8d9c7efa-60b6-44af-830b-f32145b1b403" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 759.352268] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-8d9c7efa-60b6-44af-830b-f32145b1b403" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 759.352268] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('8d9c7efa-60b6-44af-830b-f32145b1b403',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 759.352964] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock member-8d9c7efa-60b6-44af-830b-f32145b1b403 taken with stack trace [, , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 759.353108] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8d9c7efa-60b6-44af-830b-f32145b1b403" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 759.353496] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock port-f50b5939-e040-4b41-bb53-4e3dff89fdb6 taken with stack trace [, , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 759.353496] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-f50b5939-e040-4b41-bb53-4e3dff89fdb6" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 759.353496] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-f50b5939-e040-4b41-bb53-4e3dff89fdb6" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 759.353833] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-f50b5939-e040-4b41-bb53-4e3dff89fdb6" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 759.353833] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f50b5939-e040-4b41-bb53-4e3dff89fdb6',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 759.370569] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 0cacf152-a4d4-4487-a370-aa2bae090120 in Status: IN_PROGRESS for 2s [ 759.528026] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 00a251e9-7a00-4293-9092-9556bc8b91c2 in Status: SUCCESS [ 759.528374] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-00a251e9-7a00-4293-9092-9556bc8b91c2" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 759.859061] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock member-8d9c7efa-60b6-44af-830b-f32145b1b403 taken with stack trace [, , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 759.859061] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8d9c7efa-60b6-44af-830b-f32145b1b403" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 759.859061] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port f50b5939-e040-4b41-bb53-4e3dff89fdb6 with status ACTIVE [ 759.859061] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 759.859061] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 759.859061] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 759.859061] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 759.859061] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 759.859061] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 759.859061] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 759.859061] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 759.859061] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 759.859061] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 759.859061] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 759.859893] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 759.859893] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 759.859893] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 759.859893] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 759.859893] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: f50b5939-e040-4b41-bb53-4e3dff89fdb6 is going to be updated. [ 759.895813] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 759.896049] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 759.896163] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 759.896633] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 759.896633] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 759.896730] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-f50b5939-e040-4b41-bb53-4e3dff89fdb6" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 760.665640] env[65370]: INFO networking_nsxv3.common.synchronization [None req-4735a26b-caae-40ad-ac17-2e5bdf00f213 tempest-ServersTestBootFromVolume-1353776408 tempest-ServersTestBootFromVolume-1353776408-project-member] Enqueued Resource ID: c26b8d0b-5a65-4082-8dff-404228d547c4 with Priority: HIGHEST for action security_group_rules [ 760.666555] env[65370]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c26b8d0b-5a65-4082-8dff-404228d547c4 with Priority: HIGHEST for action security_group_rules [ 760.668022] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock rules-c26b8d0b-5a65-4082-8dff-404228d547c4 taken with stack trace [, , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 760.668022] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-c26b8d0b-5a65-4082-8dff-404228d547c4" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 760.668022] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-c26b8d0b-5a65-4082-8dff-404228d547c4" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 760.668022] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-c26b8d0b-5a65-4082-8dff-404228d547c4" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 760.668022] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('c26b8d0b-5a65-4082-8dff-404228d547c4',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 761.112552] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 6f93689f-ae79-496c-bd6b-5fcec0a3824f in Status: SUCCESS [ 761.112801] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-6f93689f-ae79-496c-bd6b-5fcec0a3824f" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 761.161041] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8d9c7efa-60b6-44af-830b-f32145b1b403 in Status: SUCCESS [ 761.162038] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8d9c7efa-60b6-44af-830b-f32145b1b403" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 761.163231] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8d9c7efa-60b6-44af-830b-f32145b1b403" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 761.163466] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8d9c7efa-60b6-44af-830b-f32145b1b403" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 761.163684] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 761.163810] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 761.163875] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 761.164048] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 761.164133] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 761.164231] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('8d9c7efa-60b6-44af-830b-f32145b1b403',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 761.197552] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 761.197709] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 761.197752] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 761.198257] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 761.198257] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 761.198257] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: c26b8d0b-5a65-4082-8dff-404228d547c4 already deleted. [ 761.198257] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-c26b8d0b-5a65-4082-8dff-404228d547c4" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 761.216767] env[65370]: INFO networking_nsxv3.common.synchronization [None req-e009022c-6447-4b7e-a209-6ab44d493df0 tempest-ServersTestBootFromVolume-1353776408 tempest-ServersTestBootFromVolume-1353776408-project-member] Enqueued Resource ID: c26b8d0b-5a65-4082-8dff-404228d547c4 with Priority: HIGHEST for action security_group_rules [ 761.216767] env[65370]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c26b8d0b-5a65-4082-8dff-404228d547c4 with Priority: HIGHEST for action security_group_rules [ 761.217415] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock rules-c26b8d0b-5a65-4082-8dff-404228d547c4 taken with stack trace [, , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 761.217415] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-c26b8d0b-5a65-4082-8dff-404228d547c4" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 761.217415] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-c26b8d0b-5a65-4082-8dff-404228d547c4" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 761.217830] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-c26b8d0b-5a65-4082-8dff-404228d547c4" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 761.218083] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('c26b8d0b-5a65-4082-8dff-404228d547c4',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 761.390354] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 0cacf152-a4d4-4487-a370-aa2bae090120 in Status: SUCCESS [ 761.390354] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-0cacf152-a4d4-4487-a370-aa2bae090120" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 761.390354] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-0cacf152-a4d4-4487-a370-aa2bae090120" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 761.390354] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-0cacf152-a4d4-4487-a370-aa2bae090120" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 761.390354] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('0cacf152-a4d4-4487-a370-aa2bae090120',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 761.670060] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('8d9c7efa-60b6-44af-830b-f32145b1b403',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 761.746709] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 761.746845] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 761.746928] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 761.747230] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 761.747332] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 761.747431] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: c26b8d0b-5a65-4082-8dff-404228d547c4 already deleted. [ 761.747513] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-c26b8d0b-5a65-4082-8dff-404228d547c4" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 761.892275] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock member-0cacf152-a4d4-4487-a370-aa2bae090120 taken with stack trace [, , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 761.892507] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0cacf152-a4d4-4487-a370-aa2bae090120" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 761.895296] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0cacf152-a4d4-4487-a370-aa2bae090120" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 761.895296] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0cacf152-a4d4-4487-a370-aa2bae090120" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 761.895296] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 761.895296] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 761.895296] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 761.895296] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 761.895296] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 761.895296] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0cacf152-a4d4-4487-a370-aa2bae090120" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 761.895296] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('0cacf152-a4d4-4487-a370-aa2bae090120',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 762.173349] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('8d9c7efa-60b6-44af-830b-f32145b1b403',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 762.399402] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock member-0cacf152-a4d4-4487-a370-aa2bae090120 taken with stack trace [, , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 762.399631] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0cacf152-a4d4-4487-a370-aa2bae090120" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 762.399631] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0cacf152-a4d4-4487-a370-aa2bae090120" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 762.399853] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0cacf152-a4d4-4487-a370-aa2bae090120" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 762.400034] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 762.400134] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 762.400196] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 762.400370] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 762.400503] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 762.400643] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0cacf152-a4d4-4487-a370-aa2bae090120" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 762.400807] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock member-0cacf152-a4d4-4487-a370-aa2bae090120 taken with stack trace [, , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 762.400902] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0cacf152-a4d4-4487-a370-aa2bae090120" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 762.400963] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0cacf152-a4d4-4487-a370-aa2bae090120" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 762.401123] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0cacf152-a4d4-4487-a370-aa2bae090120" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 762.401263] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 762.401357] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 762.401418] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 762.401553] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 762.401630] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 762.401705] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0cacf152-a4d4-4487-a370-aa2bae090120" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 762.401794] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('0cacf152-a4d4-4487-a370-aa2bae090120',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 762.680201] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 762.680201] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 762.680201] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 762.680201] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 762.680201] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 762.680201] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8d9c7efa-60b6-44af-830b-f32145b1b403 is going to be updated. [ 762.719032] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 762.719032] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 762.719032] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 762.719032] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 762.719032] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 762.729481] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8d9c7efa-60b6-44af-830b-f32145b1b403 in Status: IN_PROGRESS for 2s [ 762.903872] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 0cacf152-a4d4-4487-a370-aa2bae090120: rpc.has_security_group_logging(os_id): False [ 762.924883] env[65370]: INFO networking_nsxv3.common.synchronization [req-841398f9-a442-416b-b38e-b897b1d1c536 req-c4b9826e-4763-438e-bbec-4b58e540c403 tempest-ImagesTestJSON-246049254 tempest-ImagesTestJSON-246049254-project-member] Enqueued Resource ID: 67f4a0c1-3a3c-4ed8-9358-3a9645aba154 with Priority: HIGHEST for action security_group_members [ 762.925677] env[65370]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 67f4a0c1-3a3c-4ed8-9358-3a9645aba154 with Priority: HIGHEST for action security_group_members [ 762.926925] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock member-67f4a0c1-3a3c-4ed8-9358-3a9645aba154 taken with stack trace [, , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 762.927182] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-67f4a0c1-3a3c-4ed8-9358-3a9645aba154" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 762.927236] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-67f4a0c1-3a3c-4ed8-9358-3a9645aba154" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 762.927542] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-67f4a0c1-3a3c-4ed8-9358-3a9645aba154" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 762.927750] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 762.927928] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 762.927976] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 762.928535] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 762.928535] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 762.928535] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('67f4a0c1-3a3c-4ed8-9358-3a9645aba154',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 762.932613] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 762.932779] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 762.932900] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 762.933361] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 762.933361] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 762.933361] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 762.933537] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 762.933537] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 762.933601] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 762.933701] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 762.933906] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 762.933991] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 762.933991] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 762.934160] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 762.934201] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 762.934385] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 762.934475] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 762.934535] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 762.934670] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 762.934744] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 762.934831] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 0cacf152-a4d4-4487-a370-aa2bae090120 is going to be updated. [ 763.023718] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 763.023975] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 763.024187] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 763.024483] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 763.024646] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 763.038826] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 0cacf152-a4d4-4487-a370-aa2bae090120 in Status: IN_PROGRESS for 2s [ 763.431543] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 763.432096] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 763.432096] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 763.432319] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 763.472288] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 763.472288] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 763.472288] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 763.472288] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 763.472288] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 763.472288] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 763.472288] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 67f4a0c1-3a3c-4ed8-9358-3a9645aba154 is going to be updated. [ 763.563563] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 763.563779] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 763.563913] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 763.564167] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 763.564316] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 763.602694] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 67f4a0c1-3a3c-4ed8-9358-3a9645aba154 in Status: IN_PROGRESS for 2s [ 764.183068] env[65370]: INFO networking_nsxv3.common.synchronization [req-16148a24-9afb-4c2b-8af2-b94e0a645a7e req-416bc646-2710-426e-b9ed-451c963c6f26 tempest-DeleteServersTestJSON-1160924027 tempest-DeleteServersTestJSON-1160924027-project-member] Enqueued Resource ID: 1eaa763e-4469-4428-92d0-ba20a6c99edc with Priority: HIGHEST for action security_group_members [ 764.184433] env[65370]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1eaa763e-4469-4428-92d0-ba20a6c99edc with Priority: HIGHEST for action security_group_members [ 764.184433] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock member-1eaa763e-4469-4428-92d0-ba20a6c99edc taken with stack trace [, , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 764.184540] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1eaa763e-4469-4428-92d0-ba20a6c99edc" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 764.184540] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1eaa763e-4469-4428-92d0-ba20a6c99edc" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 764.185940] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1eaa763e-4469-4428-92d0-ba20a6c99edc" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 764.185940] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 764.185940] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 764.185940] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 764.185940] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 764.185940] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 764.185940] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1eaa763e-4469-4428-92d0-ba20a6c99edc',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 764.687894] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 764.688166] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 764.688166] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 764.688430] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 764.688537] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 764.688751] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 764.689286] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 764.689286] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 764.689286] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 764.689286] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 764.689570] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1eaa763e-4469-4428-92d0-ba20a6c99edc is going to be updated. [ 764.735220] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 764.735607] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 764.735607] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 764.736082] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 764.736082] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 764.744221] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8d9c7efa-60b6-44af-830b-f32145b1b403 in Status: SUCCESS [ 764.744490] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8d9c7efa-60b6-44af-830b-f32145b1b403" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 764.744689] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8d9c7efa-60b6-44af-830b-f32145b1b403" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 764.744928] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8d9c7efa-60b6-44af-830b-f32145b1b403" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 764.745377] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 764.745523] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 764.745588] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 764.745756] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 764.745864] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 764.745984] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8d9c7efa-60b6-44af-830b-f32145b1b403" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 764.746055] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('8d9c7efa-60b6-44af-830b-f32145b1b403',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 764.748504] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1eaa763e-4469-4428-92d0-ba20a6c99edc in Status: IN_PROGRESS for 2s [ 765.053554] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 0cacf152-a4d4-4487-a370-aa2bae090120 in Status: SUCCESS [ 765.053865] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-0cacf152-a4d4-4487-a370-aa2bae090120" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 765.054364] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-0cacf152-a4d4-4487-a370-aa2bae090120" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 765.054564] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-0cacf152-a4d4-4487-a370-aa2bae090120" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 765.054650] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('0cacf152-a4d4-4487-a370-aa2bae090120',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 765.250028] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock member-8d9c7efa-60b6-44af-830b-f32145b1b403 taken with stack trace [, , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 765.250420] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8d9c7efa-60b6-44af-830b-f32145b1b403" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 765.250420] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8d9c7efa-60b6-44af-830b-f32145b1b403" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 765.250704] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8d9c7efa-60b6-44af-830b-f32145b1b403" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 765.250957] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 765.251139] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 765.251234] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 765.251470] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 765.251614] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 765.251963] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8d9c7efa-60b6-44af-830b-f32145b1b403" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 765.252052] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock member-8d9c7efa-60b6-44af-830b-f32145b1b403 taken with stack trace [, , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 765.252299] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8d9c7efa-60b6-44af-830b-f32145b1b403" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 765.252299] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8d9c7efa-60b6-44af-830b-f32145b1b403" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 765.252533] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8d9c7efa-60b6-44af-830b-f32145b1b403" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 765.252742] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 765.252894] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 765.253012] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 765.253472] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 765.253622] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 765.253743] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8d9c7efa-60b6-44af-830b-f32145b1b403" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 765.253865] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('8d9c7efa-60b6-44af-830b-f32145b1b403',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 765.341525] env[65370]: INFO networking_nsxv3.common.synchronization [None req-6aa3f6f6-c449-4a6e-895c-5249cb88257b None None] Enqueued Resource ID: f53c0132-2ffe-48a0-9915-9992dc705ac7 with Priority: HIGHEST for action port [ 765.342267] env[65370]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f53c0132-2ffe-48a0-9915-9992dc705ac7 with Priority: HIGHEST for action port [ 765.342695] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock port-f53c0132-2ffe-48a0-9915-9992dc705ac7 taken with stack trace [, , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 765.343437] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-f53c0132-2ffe-48a0-9915-9992dc705ac7" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 765.343437] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-f53c0132-2ffe-48a0-9915-9992dc705ac7" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 765.343437] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-f53c0132-2ffe-48a0-9915-9992dc705ac7" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 765.343437] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f53c0132-2ffe-48a0-9915-9992dc705ac7',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 765.560786] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock member-0cacf152-a4d4-4487-a370-aa2bae090120 taken with stack trace [, , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 765.560786] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0cacf152-a4d4-4487-a370-aa2bae090120" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 765.560786] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0cacf152-a4d4-4487-a370-aa2bae090120" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 765.561084] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0cacf152-a4d4-4487-a370-aa2bae090120" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 765.561356] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 765.561356] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 765.561356] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 765.561569] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 765.561569] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 765.561664] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0cacf152-a4d4-4487-a370-aa2bae090120" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 765.561759] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('0cacf152-a4d4-4487-a370-aa2bae090120',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 765.616597] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 67f4a0c1-3a3c-4ed8-9358-3a9645aba154 in Status: SUCCESS [ 765.616597] env[65370]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 67f4a0c1-3a3c-4ed8-9358-3a9645aba154 deletion is rescheduled due to dependency. [ 765.616597] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-67f4a0c1-3a3c-4ed8-9358-3a9645aba154" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 765.762400] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 8d9c7efa-60b6-44af-830b-f32145b1b403: rpc.has_security_group_logging(os_id): False [ 765.792555] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 765.792754] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 765.792754] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 765.793052] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 765.819358] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 765.819638] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 765.819833] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 765.819927] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 765.820291] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 765.820291] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 765.820656] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 765.820723] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 765.820778] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 765.820945] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 765.821032] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 765.821293] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 765.821408] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 765.821408] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 765.821520] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 765.821617] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 765.821711] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 8d9c7efa-60b6-44af-830b-f32145b1b403 is going to be updated. [ 765.847073] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port f53c0132-2ffe-48a0-9915-9992dc705ac7 [ 765.847073] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 765.847073] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 765.847073] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 765.847324] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 765.847376] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 765.847879] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:f53c0132-2ffe-48a0-9915-9992dc705ac7 already deleted. [ 765.847879] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-f53c0132-2ffe-48a0-9915-9992dc705ac7" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 765.900058] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 765.900253] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 765.900318] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 765.901353] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 765.901353] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 765.919294] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 8d9c7efa-60b6-44af-830b-f32145b1b403 in Status: IN_PROGRESS for 2s [ 766.067054] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock member-0cacf152-a4d4-4487-a370-aa2bae090120 taken with stack trace [, , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 766.067054] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0cacf152-a4d4-4487-a370-aa2bae090120" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 766.067293] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0cacf152-a4d4-4487-a370-aa2bae090120" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 766.067328] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0cacf152-a4d4-4487-a370-aa2bae090120" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 766.068233] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 766.068233] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 766.068233] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 766.068233] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 766.068233] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 766.068233] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0cacf152-a4d4-4487-a370-aa2bae090120" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 766.068507] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock member-0cacf152-a4d4-4487-a370-aa2bae090120 taken with stack trace [, , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 766.068507] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0cacf152-a4d4-4487-a370-aa2bae090120" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 766.068507] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0cacf152-a4d4-4487-a370-aa2bae090120" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 766.068607] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0cacf152-a4d4-4487-a370-aa2bae090120" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 766.068830] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 766.068979] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 766.069070] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 766.069212] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 766.069289] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 766.069370] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0cacf152-a4d4-4487-a370-aa2bae090120" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 766.069855] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('0cacf152-a4d4-4487-a370-aa2bae090120',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 766.579520] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 0cacf152-a4d4-4487-a370-aa2bae090120: rpc.has_security_group_logging(os_id): False [ 766.602536] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 766.602728] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 766.602728] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 766.602876] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 766.603200] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 766.603200] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 766.603375] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 766.603375] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 766.603533] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 766.603607] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 766.603858] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 766.603953] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 766.604017] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 766.604179] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 766.604217] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 766.604487] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 766.604487] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 766.604633] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 766.604671] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 766.604718] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 766.604799] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 0cacf152-a4d4-4487-a370-aa2bae090120 is going to be updated. [ 766.698169] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 766.698169] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 766.698412] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 766.698571] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 766.698843] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 766.722125] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 0cacf152-a4d4-4487-a370-aa2bae090120 in Status: IN_PROGRESS for 2s [ 766.762253] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1eaa763e-4469-4428-92d0-ba20a6c99edc in Status: SUCCESS [ 766.763040] env[65370]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1eaa763e-4469-4428-92d0-ba20a6c99edc deletion is rescheduled due to dependency. [ 766.763040] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1eaa763e-4469-4428-92d0-ba20a6c99edc" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 767.117273] env[65370]: INFO networking_nsxv3.common.synchronization [None req-4733d806-1cfa-4ed4-a7df-c32da2df65c7 None None] Enqueued Resource ID: 62ec5fe8-c114-432a-b64a-6814b9760a56 with Priority: HIGHEST for action port [ 767.118828] env[65370]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 62ec5fe8-c114-432a-b64a-6814b9760a56 with Priority: HIGHEST for action port [ 767.118828] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock port-62ec5fe8-c114-432a-b64a-6814b9760a56 taken with stack trace [, , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 767.118828] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-62ec5fe8-c114-432a-b64a-6814b9760a56" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 767.118828] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-62ec5fe8-c114-432a-b64a-6814b9760a56" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 767.118828] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-62ec5fe8-c114-432a-b64a-6814b9760a56" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 767.118828] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('62ec5fe8-c114-432a-b64a-6814b9760a56',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 767.621710] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 62ec5fe8-c114-432a-b64a-6814b9760a56 [ 767.622061] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 767.622061] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 767.622169] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 767.622374] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 767.622893] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 767.622893] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:62ec5fe8-c114-432a-b64a-6814b9760a56 already deleted. [ 767.622893] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-62ec5fe8-c114-432a-b64a-6814b9760a56" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 767.938535] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 8d9c7efa-60b6-44af-830b-f32145b1b403 in Status: SUCCESS [ 767.938843] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-8d9c7efa-60b6-44af-830b-f32145b1b403" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 768.510290] env[65370]: INFO networking_nsxv3.common.synchronization [None req-37d6be65-eb5f-4dee-aa15-3b02095e8485 None None] Enqueued Resource ID: e40ba664-7b88-4723-8ab1-a58c47fb17b6 with Priority: HIGHEST for action port [ 768.511438] env[65370]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e40ba664-7b88-4723-8ab1-a58c47fb17b6 with Priority: HIGHEST for action port [ 768.511986] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock port-e40ba664-7b88-4723-8ab1-a58c47fb17b6 taken with stack trace [, , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 768.512291] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-e40ba664-7b88-4723-8ab1-a58c47fb17b6" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 768.514799] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-e40ba664-7b88-4723-8ab1-a58c47fb17b6" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 768.514799] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-e40ba664-7b88-4723-8ab1-a58c47fb17b6" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 768.514799] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e40ba664-7b88-4723-8ab1-a58c47fb17b6',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 768.739264] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 0cacf152-a4d4-4487-a370-aa2bae090120 in Status: SUCCESS [ 768.739651] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-0cacf152-a4d4-4487-a370-aa2bae090120" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 769.016322] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port e40ba664-7b88-4723-8ab1-a58c47fb17b6 [ 769.017264] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 769.018298] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 769.018298] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 769.018298] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 769.018298] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 769.018298] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:e40ba664-7b88-4723-8ab1-a58c47fb17b6 already deleted. [ 769.018298] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-e40ba664-7b88-4723-8ab1-a58c47fb17b6" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 769.724837] env[65370]: INFO networking_nsxv3.common.synchronization [None req-18a8d516-9dd8-4d06-96de-f859f3581f6c tempest-ServersTestJSON-152322471 tempest-ServersTestJSON-152322471-project-member] Enqueued Resource ID: 21a3b55c-64ce-4782-808a-31350166c184 with Priority: HIGHEST for action security_group_rules [ 769.726615] env[65370]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 21a3b55c-64ce-4782-808a-31350166c184 with Priority: HIGHEST for action security_group_rules [ 769.728096] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock rules-21a3b55c-64ce-4782-808a-31350166c184 taken with stack trace [, , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 769.728250] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-21a3b55c-64ce-4782-808a-31350166c184" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 769.728308] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-21a3b55c-64ce-4782-808a-31350166c184" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 769.728981] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-21a3b55c-64ce-4782-808a-31350166c184" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 769.729102] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('21a3b55c-64ce-4782-808a-31350166c184',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 769.933100] env[65370]: INFO networking_nsxv3.common.synchronization [None req-4474e61b-3c76-4bdd-a40e-31c0d4624253 tempest-ServersTestJSON-152322471 tempest-ServersTestJSON-152322471-project-member] Enqueued Resource ID: 21a3b55c-64ce-4782-808a-31350166c184 with Priority: HIGHEST for action security_group_rules [ 769.934342] env[65370]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 21a3b55c-64ce-4782-808a-31350166c184 with Priority: HIGHEST for action security_group_rules [ 769.934930] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock rules-21a3b55c-64ce-4782-808a-31350166c184 taken with stack trace [, , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 769.934930] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-21a3b55c-64ce-4782-808a-31350166c184" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 770.260188] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 770.260410] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 770.260509] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 770.260743] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 770.260849] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 770.260937] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 21a3b55c-64ce-4782-808a-31350166c184 already deleted. [ 770.261033] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-21a3b55c-64ce-4782-808a-31350166c184" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 770.261192] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-21a3b55c-64ce-4782-808a-31350166c184" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 770.261354] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-21a3b55c-64ce-4782-808a-31350166c184" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 770.261452] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('21a3b55c-64ce-4782-808a-31350166c184',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 770.789036] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 770.790202] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 770.790202] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 770.790202] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 770.790202] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 770.790202] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 21a3b55c-64ce-4782-808a-31350166c184 already deleted. [ 770.790202] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-21a3b55c-64ce-4782-808a-31350166c184" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 771.184998] env[65370]: INFO networking_nsxv3.common.synchronization [None req-3ca48a09-f5e1-45c1-aa77-9fcb5ab81178 None None] Enqueued Resource ID: 1517d56b-bbf6-47d2-a782-dc2b514b62ca with Priority: HIGHEST for action port [ 771.185658] env[65370]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1517d56b-bbf6-47d2-a782-dc2b514b62ca with Priority: HIGHEST for action port [ 771.185658] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock port-1517d56b-bbf6-47d2-a782-dc2b514b62ca taken with stack trace [, , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 771.186701] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-1517d56b-bbf6-47d2-a782-dc2b514b62ca" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 771.187572] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-1517d56b-bbf6-47d2-a782-dc2b514b62ca" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 771.187572] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-1517d56b-bbf6-47d2-a782-dc2b514b62ca" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 771.187572] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1517d56b-bbf6-47d2-a782-dc2b514b62ca',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 771.690501] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 1517d56b-bbf6-47d2-a782-dc2b514b62ca [ 771.690831] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 771.690831] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 771.690831] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 771.691121] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 771.691205] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 771.691303] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:1517d56b-bbf6-47d2-a782-dc2b514b62ca already deleted. [ 771.691386] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-1517d56b-bbf6-47d2-a782-dc2b514b62ca" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 772.854786] env[65370]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-22548ca9-c949-4428-b53c-fd85bd762917 None None] NSXv3 Agent Agent loop - iteration:0 completed [ 772.854786] env[65370]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-22548ca9-c949-4428-b53c-fd85bd762917 None None] NSXv3 Agent Agent loop - iteration:1 started [ 773.114299] env[65370]: INFO networking_nsxv3.common.synchronization [req-92be7157-028f-499c-aa1a-45646f3768b0 req-1ffad494-2ea3-4a3a-aa65-09a986d1dfad tempest-ListServersNegativeTestJSON-1430921204 tempest-ListServersNegativeTestJSON-1430921204-project-member] Enqueued Resource ID: 0cacf152-a4d4-4487-a370-aa2bae090120 with Priority: HIGHEST for action security_group_members [ 773.114747] env[65370]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0cacf152-a4d4-4487-a370-aa2bae090120 with Priority: HIGHEST for action security_group_members [ 773.115068] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock member-0cacf152-a4d4-4487-a370-aa2bae090120 taken with stack trace [, , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 773.115206] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0cacf152-a4d4-4487-a370-aa2bae090120" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 773.115274] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0cacf152-a4d4-4487-a370-aa2bae090120" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 773.115514] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0cacf152-a4d4-4487-a370-aa2bae090120" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 773.117759] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 773.117759] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 773.117759] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 773.117759] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 773.117759] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 773.117759] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0cacf152-a4d4-4487-a370-aa2bae090120',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 773.619075] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('0cacf152-a4d4-4487-a370-aa2bae090120',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 774.120970] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('0cacf152-a4d4-4487-a370-aa2bae090120',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 774.418168] env[65370]: INFO networking_nsxv3.common.synchronization [req-e47af03f-dcc9-4c92-beda-9ffe7a4dd64b req-f6ade6c4-2113-4f4a-b250-e6b68be68f09 tempest-ImagesOneServerNegativeTestJSON-1384686973 tempest-ImagesOneServerNegativeTestJSON-1384686973-project-member] Enqueued Resource ID: e2790d7c-6d0c-45bc-84d1-8cb00d26b9b0 with Priority: HIGHEST for action security_group_members [ 774.418752] env[65370]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e2790d7c-6d0c-45bc-84d1-8cb00d26b9b0 with Priority: HIGHEST for action security_group_members [ 774.419206] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock member-e2790d7c-6d0c-45bc-84d1-8cb00d26b9b0 taken with stack trace [, , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 774.419351] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e2790d7c-6d0c-45bc-84d1-8cb00d26b9b0" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 774.419413] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e2790d7c-6d0c-45bc-84d1-8cb00d26b9b0" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 774.419614] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e2790d7c-6d0c-45bc-84d1-8cb00d26b9b0" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 774.419897] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 774.419990] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 774.420094] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 774.420259] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 774.420445] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 774.420657] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e2790d7c-6d0c-45bc-84d1-8cb00d26b9b0',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 774.624808] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 774.624949] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 774.625082] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 774.625380] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 774.625759] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 774.625759] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0cacf152-a4d4-4487-a370-aa2bae090120 is going to be updated. [ 774.686503] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 774.686653] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 774.686778] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 774.687011] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 774.687296] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 774.710066] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0cacf152-a4d4-4487-a370-aa2bae090120 in Status: IN_PROGRESS for 2s [ 774.923289] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 774.923586] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 774.923659] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 774.923898] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 774.923997] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 774.924203] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 774.924320] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 774.924383] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 774.924574] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 774.924671] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 774.924811] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e2790d7c-6d0c-45bc-84d1-8cb00d26b9b0 is going to be updated. [ 774.979791] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 774.979920] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 774.980021] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 774.980392] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 774.980615] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 774.994296] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e2790d7c-6d0c-45bc-84d1-8cb00d26b9b0 in Status: IN_PROGRESS for 2s [ 775.081459] env[65370]: DEBUG networking_nsxv3.common.locking [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Lock network-823 taken with stack trace [, , , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 775.081657] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquiring lock "network-823" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 775.081763] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquired lock "network-823" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 775.082054] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquired external semaphore "network-823" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 775.082325] env[65370]: DEBUG networking_nsxv3.common.locking [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 775.082475] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquiring lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 775.082628] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquired lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 775.082816] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquired external semaphore "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 775.082955] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Releasing lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 775.083181] env[65370]: DEBUG dogpile.cache.region [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] No value present for key: 'zone-id' {{(pid=65370) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 775.083288] env[65370]: DEBUG dogpile.lock [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] NeedRegenerationException {{(pid=65370) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 775.083388] env[65370]: DEBUG dogpile.lock [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] no value, waiting for create lock {{(pid=65370) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 775.083490] env[65370]: DEBUG dogpile.lock [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] value creation lock acquired {{(pid=65370) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 775.083591] env[65370]: DEBUG dogpile.cache.region [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] No value present for key: 'zone-id' {{(pid=65370) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 775.083687] env[65370]: DEBUG dogpile.lock [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Calling creation function for not-yet-present value {{(pid=65370) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 775.083811] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 775.123209] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 775.123577] env[65370]: DEBUG dogpile.cache.region [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Cache value generated in 0.039 seconds for key(s): 'zone-id' {{(pid=65370) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 775.123704] env[65370]: DEBUG dogpile.lock [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Released creation lock {{(pid=65370) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 775.123947] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Releasing lock "network-823" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 775.124383] env[65370]: DEBUG networking_nsxv3.common.locking [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Lock port-ee16b460-e371-4663-8b9c-0e62719bb680 taken with stack trace [, , , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 775.124623] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquiring lock "port-ee16b460-e371-4663-8b9c-0e62719bb680" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 775.124837] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquired lock "port-ee16b460-e371-4663-8b9c-0e62719bb680" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 775.125282] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquired external semaphore "port-ee16b460-e371-4663-8b9c-0e62719bb680" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 775.125466] env[65370]: DEBUG networking_nsxv3.api.rpc [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ee16b460-e371-4663-8b9c-0e62719bb680',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 775.629852] env[65370]: DEBUG networking_nsxv3.common.locking [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 775.629852] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquiring lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 775.629852] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquired lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 775.629852] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquired external semaphore "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 775.629852] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Releasing lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 775.629852] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Segment Port ee16b460-e371-4663-8b9c-0e62719bb680 not found, creating... [ 775.630400] env[65370]: DEBUG networking_nsxv3.common.locking [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 775.630718] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquiring lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 775.630718] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquired lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 775.631142] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquired external semaphore "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 775.631280] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Releasing lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 775.631587] env[65370]: DEBUG networking_nsxv3.common.locking [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 775.631894] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquiring lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 775.631894] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquired lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 775.632148] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquired external semaphore "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 775.632272] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Releasing lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 775.632798] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Resource: SegmentPort with ID: ee16b460-e371-4663-8b9c-0e62719bb680 is going to be created. [ 775.660166] env[65370]: DEBUG networking_nsxv3.common.locking [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 775.660396] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquiring lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 775.660552] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquired lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 775.660878] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquired external semaphore "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 775.661731] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Releasing lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 775.661980] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Releasing lock "port-ee16b460-e371-4663-8b9c-0e62719bb680" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 776.414131] env[65370]: INFO networking_nsxv3.common.synchronization [req-e47af03f-dcc9-4c92-beda-9ffe7a4dd64b req-6fc934f0-2f6f-4bb5-aee7-99c83c2e6bee service nova] Enqueued Resource ID: e2790d7c-6d0c-45bc-84d1-8cb00d26b9b0 with Priority: HIGHEST for action security_group_rules [ 776.414390] env[65370]: INFO networking_nsxv3.common.synchronization [req-e47af03f-dcc9-4c92-beda-9ffe7a4dd64b req-6fc934f0-2f6f-4bb5-aee7-99c83c2e6bee service nova] Enqueued Resource ID: e2790d7c-6d0c-45bc-84d1-8cb00d26b9b0 with Priority: HIGHEST for action security_group_members [ 776.414445] env[65370]: INFO networking_nsxv3.common.synchronization [req-e47af03f-dcc9-4c92-beda-9ffe7a4dd64b req-6fc934f0-2f6f-4bb5-aee7-99c83c2e6bee service nova] Enqueued Resource ID: ee16b460-e371-4663-8b9c-0e62719bb680 with Priority: HIGHEST for action port [ 776.415880] env[65370]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e2790d7c-6d0c-45bc-84d1-8cb00d26b9b0 with Priority: HIGHEST for action security_group_rules [ 776.415880] env[65370]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e2790d7c-6d0c-45bc-84d1-8cb00d26b9b0 with Priority: HIGHEST for action security_group_members [ 776.415880] env[65370]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ee16b460-e371-4663-8b9c-0e62719bb680 with Priority: HIGHEST for action port [ 776.416050] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e2790d7c-6d0c-45bc-84d1-8cb00d26b9b0 taken with stack trace [, , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 776.416238] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e2790d7c-6d0c-45bc-84d1-8cb00d26b9b0" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 776.416334] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e2790d7c-6d0c-45bc-84d1-8cb00d26b9b0" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 776.416580] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e2790d7c-6d0c-45bc-84d1-8cb00d26b9b0" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 776.416722] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e2790d7c-6d0c-45bc-84d1-8cb00d26b9b0',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 776.417691] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock member-e2790d7c-6d0c-45bc-84d1-8cb00d26b9b0 taken with stack trace [, , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 776.417794] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e2790d7c-6d0c-45bc-84d1-8cb00d26b9b0" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 776.419327] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock port-ee16b460-e371-4663-8b9c-0e62719bb680 taken with stack trace [, , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 776.419505] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-ee16b460-e371-4663-8b9c-0e62719bb680" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 776.419740] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-ee16b460-e371-4663-8b9c-0e62719bb680" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 776.420903] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-ee16b460-e371-4663-8b9c-0e62719bb680" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 776.421023] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ee16b460-e371-4663-8b9c-0e62719bb680',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 776.726607] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0cacf152-a4d4-4487-a370-aa2bae090120 in Status: SUCCESS [ 776.726884] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0cacf152-a4d4-4487-a370-aa2bae090120" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 776.923917] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock member-e2790d7c-6d0c-45bc-84d1-8cb00d26b9b0 taken with stack trace [, , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 776.924086] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e2790d7c-6d0c-45bc-84d1-8cb00d26b9b0" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 776.927993] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port ee16b460-e371-4663-8b9c-0e62719bb680 with status ACTIVE [ 776.929184] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 776.929184] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 776.929184] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 776.929184] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 776.929184] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 776.929184] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 776.929184] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 776.929184] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 776.929573] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 776.929573] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 776.929573] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 776.930908] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 776.931043] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 776.931229] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 776.931344] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 776.931465] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: ee16b460-e371-4663-8b9c-0e62719bb680 is going to be updated. [ 776.963475] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 776.963687] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 776.963739] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 776.964055] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 776.964112] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 776.964262] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-ee16b460-e371-4663-8b9c-0e62719bb680" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 777.010235] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e2790d7c-6d0c-45bc-84d1-8cb00d26b9b0 in Status: SUCCESS [ 777.010235] env[65370]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e2790d7c-6d0c-45bc-84d1-8cb00d26b9b0 deletion is rescheduled due to dependency. [ 777.010235] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e2790d7c-6d0c-45bc-84d1-8cb00d26b9b0" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 777.010235] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e2790d7c-6d0c-45bc-84d1-8cb00d26b9b0" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 777.010235] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e2790d7c-6d0c-45bc-84d1-8cb00d26b9b0" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 777.010235] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 777.010235] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 777.010235] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 777.010235] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 777.010235] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 777.010235] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e2790d7c-6d0c-45bc-84d1-8cb00d26b9b0',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 777.077035] env[65370]: INFO networking_nsxv3.common.synchronization [req-50d02e82-b07a-42b1-940b-1941227cc3bb req-85329f63-1519-4eee-adf5-760bc32814b5 tempest-InstanceActionsNegativeTestJSON-817155203 tempest-InstanceActionsNegativeTestJSON-817155203-project-member] Enqueued Resource ID: ed2131cc-559f-4cd6-b558-72473509c325 with Priority: HIGHEST for action security_group_members [ 777.077035] env[65370]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ed2131cc-559f-4cd6-b558-72473509c325 with Priority: HIGHEST for action security_group_members [ 777.077261] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock member-ed2131cc-559f-4cd6-b558-72473509c325 taken with stack trace [, , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 777.077333] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ed2131cc-559f-4cd6-b558-72473509c325" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 777.077390] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ed2131cc-559f-4cd6-b558-72473509c325" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 777.077644] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ed2131cc-559f-4cd6-b558-72473509c325" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 777.077805] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 777.077902] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 777.078502] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 777.080132] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 777.080132] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 777.080132] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ed2131cc-559f-4cd6-b558-72473509c325',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 777.513473] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('e2790d7c-6d0c-45bc-84d1-8cb00d26b9b0',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 777.582512] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 777.582669] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 777.582818] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 777.583189] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 777.583294] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 777.583503] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 777.583620] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 777.583677] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 777.583842] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 777.583918] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 777.584020] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ed2131cc-559f-4cd6-b558-72473509c325 already deleted. [ 777.584117] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ed2131cc-559f-4cd6-b558-72473509c325" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 777.756022] env[65370]: DEBUG networking_nsxv3.common.locking [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Lock network-829 taken with stack trace [, , , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 777.756803] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquiring lock "network-829" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 777.756803] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquired lock "network-829" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 777.758223] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquired external semaphore "network-829" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 777.758223] env[65370]: DEBUG networking_nsxv3.common.locking [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 777.758223] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquiring lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 777.758223] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquired lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 777.758223] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquired external semaphore "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 777.758223] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Releasing lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 777.758626] env[65370]: DEBUG dogpile.cache.region [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] No value present for key: 'zone-id' {{(pid=65370) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 777.758626] env[65370]: DEBUG dogpile.lock [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] NeedRegenerationException {{(pid=65370) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 777.758705] env[65370]: DEBUG dogpile.lock [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] no value, waiting for create lock {{(pid=65370) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 777.758806] env[65370]: DEBUG dogpile.lock [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] value creation lock acquired {{(pid=65370) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 777.758914] env[65370]: DEBUG dogpile.cache.region [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] No value present for key: 'zone-id' {{(pid=65370) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 777.759038] env[65370]: DEBUG dogpile.lock [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Calling creation function for not-yet-present value {{(pid=65370) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 777.759186] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 777.790122] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 777.790122] env[65370]: DEBUG dogpile.cache.region [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Cache value generated in 0.028 seconds for key(s): 'zone-id' {{(pid=65370) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 777.790122] env[65370]: DEBUG dogpile.lock [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Released creation lock {{(pid=65370) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 777.790122] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Releasing lock "network-829" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 777.790122] env[65370]: DEBUG networking_nsxv3.common.locking [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Lock port-29c981f9-365c-4b61-bada-a040c03d093a taken with stack trace [, , , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 777.790122] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquiring lock "port-29c981f9-365c-4b61-bada-a040c03d093a" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 777.790122] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquired lock "port-29c981f9-365c-4b61-bada-a040c03d093a" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 777.790122] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquired external semaphore "port-29c981f9-365c-4b61-bada-a040c03d093a" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 777.790122] env[65370]: DEBUG networking_nsxv3.api.rpc [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('29c981f9-365c-4b61-bada-a040c03d093a',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 778.016960] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('e2790d7c-6d0c-45bc-84d1-8cb00d26b9b0',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 778.291893] env[65370]: DEBUG networking_nsxv3.common.locking [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 778.295024] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquiring lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 778.295024] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquired lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 778.295024] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquired external semaphore "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 778.295024] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Releasing lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 778.295024] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Segment Port 29c981f9-365c-4b61-bada-a040c03d093a not found, creating... [ 778.295024] env[65370]: DEBUG networking_nsxv3.common.locking [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 778.295024] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquiring lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 778.295024] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquired lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 778.295769] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquired external semaphore "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 778.295769] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Releasing lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 778.296344] env[65370]: DEBUG networking_nsxv3.common.locking [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 778.296757] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquiring lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 778.297232] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquired lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 778.297232] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquired external semaphore "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 778.297346] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Releasing lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 778.297440] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Resource: SegmentPort with ID: 29c981f9-365c-4b61-bada-a040c03d093a is going to be created. [ 778.326309] env[65370]: DEBUG networking_nsxv3.common.locking [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 778.326309] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquiring lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 778.326309] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquired lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 778.326309] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquired external semaphore "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 778.326558] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Releasing lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 778.326960] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Releasing lock "port-29c981f9-365c-4b61-bada-a040c03d093a" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 778.525269] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 778.525707] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 778.526033] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 778.526670] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 778.526793] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 778.526916] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e2790d7c-6d0c-45bc-84d1-8cb00d26b9b0 is going to be updated. [ 778.598598] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 778.598598] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 778.598598] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 778.598598] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 778.598598] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 778.609108] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e2790d7c-6d0c-45bc-84d1-8cb00d26b9b0 in Status: IN_PROGRESS for 2s [ 778.809255] env[65370]: INFO networking_nsxv3.common.synchronization [None req-766c95d2-eb6a-4212-9de2-e6e2d955e69a None None] Enqueued Resource ID: 7f91b1d7-441b-4819-aa14-74eb48900c5b with Priority: HIGHEST for action port [ 778.809518] env[65370]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7f91b1d7-441b-4819-aa14-74eb48900c5b with Priority: HIGHEST for action port [ 778.810118] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock port-7f91b1d7-441b-4819-aa14-74eb48900c5b taken with stack trace [, , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 778.810273] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-7f91b1d7-441b-4819-aa14-74eb48900c5b" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 778.810347] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-7f91b1d7-441b-4819-aa14-74eb48900c5b" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 778.810807] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-7f91b1d7-441b-4819-aa14-74eb48900c5b" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 778.810916] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7f91b1d7-441b-4819-aa14-74eb48900c5b',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 779.117883] env[65370]: INFO networking_nsxv3.common.synchronization [req-50d02e82-b07a-42b1-940b-1941227cc3bb req-2f51c486-be99-4572-a185-c6718e4157f8 service nova] Enqueued Resource ID: ed2131cc-559f-4cd6-b558-72473509c325 with Priority: HIGHEST for action security_group_rules [ 779.118056] env[65370]: INFO networking_nsxv3.common.synchronization [req-50d02e82-b07a-42b1-940b-1941227cc3bb req-2f51c486-be99-4572-a185-c6718e4157f8 service nova] Enqueued Resource ID: ed2131cc-559f-4cd6-b558-72473509c325 with Priority: HIGHEST for action security_group_members [ 779.118332] env[65370]: INFO networking_nsxv3.common.synchronization [req-50d02e82-b07a-42b1-940b-1941227cc3bb req-2f51c486-be99-4572-a185-c6718e4157f8 service nova] Enqueued Resource ID: 29c981f9-365c-4b61-bada-a040c03d093a with Priority: HIGHEST for action port [ 779.118967] env[65370]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ed2131cc-559f-4cd6-b558-72473509c325 with Priority: HIGHEST for action security_group_rules [ 779.119122] env[65370]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ed2131cc-559f-4cd6-b558-72473509c325 with Priority: HIGHEST for action security_group_members [ 779.119169] env[65370]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 29c981f9-365c-4b61-bada-a040c03d093a with Priority: HIGHEST for action port [ 779.119481] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock rules-ed2131cc-559f-4cd6-b558-72473509c325 taken with stack trace [, , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 779.119575] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-ed2131cc-559f-4cd6-b558-72473509c325" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 779.119623] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-ed2131cc-559f-4cd6-b558-72473509c325" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 779.120025] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-ed2131cc-559f-4cd6-b558-72473509c325" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 779.120087] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('ed2131cc-559f-4cd6-b558-72473509c325',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 779.121089] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock member-ed2131cc-559f-4cd6-b558-72473509c325 taken with stack trace [, , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 779.121396] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ed2131cc-559f-4cd6-b558-72473509c325" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 779.121396] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ed2131cc-559f-4cd6-b558-72473509c325" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 779.121577] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ed2131cc-559f-4cd6-b558-72473509c325" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 779.121577] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 779.121753] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 779.121753] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 779.121899] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 779.122328] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 779.122328] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ed2131cc-559f-4cd6-b558-72473509c325',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 779.124101] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock port-29c981f9-365c-4b61-bada-a040c03d093a taken with stack trace [, , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 779.124273] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-29c981f9-365c-4b61-bada-a040c03d093a" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 779.124395] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-29c981f9-365c-4b61-bada-a040c03d093a" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 779.124970] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-29c981f9-365c-4b61-bada-a040c03d093a" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 779.125094] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('29c981f9-365c-4b61-bada-a040c03d093a',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 779.313043] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 7f91b1d7-441b-4819-aa14-74eb48900c5b [ 779.313198] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 779.313284] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 779.313355] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 779.313583] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 779.313675] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 779.313770] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:7f91b1d7-441b-4819-aa14-74eb48900c5b already deleted. [ 779.313850] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-7f91b1d7-441b-4819-aa14-74eb48900c5b" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 779.627862] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock member-ed2131cc-559f-4cd6-b558-72473509c325 taken with stack trace [, , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 779.628201] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ed2131cc-559f-4cd6-b558-72473509c325" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 779.628201] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('ed2131cc-559f-4cd6-b558-72473509c325',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 779.630065] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 29c981f9-365c-4b61-bada-a040c03d093a with status ACTIVE [ 779.630284] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 779.630410] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 779.630527] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 779.630678] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 779.631905] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 779.632230] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 779.632372] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 779.632442] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 779.632634] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 779.632716] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 779.634608] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 779.634608] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 779.634608] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 779.634821] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 779.634892] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 779.634988] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 29c981f9-365c-4b61-bada-a040c03d093a is going to be updated. [ 779.664432] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 779.664553] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 779.664590] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 779.664795] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 779.665051] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 779.665141] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-29c981f9-365c-4b61-bada-a040c03d093a" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 780.130798] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('ed2131cc-559f-4cd6-b558-72473509c325',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 780.622665] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e2790d7c-6d0c-45bc-84d1-8cb00d26b9b0 in Status: SUCCESS [ 780.622979] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e2790d7c-6d0c-45bc-84d1-8cb00d26b9b0" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 780.623317] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e2790d7c-6d0c-45bc-84d1-8cb00d26b9b0" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 780.623705] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e2790d7c-6d0c-45bc-84d1-8cb00d26b9b0" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 780.629698] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 780.629698] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 780.629698] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 780.629698] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 780.629698] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 780.629698] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e2790d7c-6d0c-45bc-84d1-8cb00d26b9b0" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 780.629698] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('e2790d7c-6d0c-45bc-84d1-8cb00d26b9b0',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 780.633944] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 780.634107] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 780.634176] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 780.634386] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 780.634483] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 780.634568] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ed2131cc-559f-4cd6-b558-72473509c325 is going to be created. [ 780.672358] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 780.672358] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 780.672358] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 780.672358] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 780.672358] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 780.686557] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ed2131cc-559f-4cd6-b558-72473509c325 in Status: SUCCESS [ 780.687024] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ed2131cc-559f-4cd6-b558-72473509c325" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 780.688777] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ed2131cc-559f-4cd6-b558-72473509c325" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 780.688777] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ed2131cc-559f-4cd6-b558-72473509c325" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 780.688777] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 780.688777] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 780.688777] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 780.688777] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 780.688777] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 780.688777] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ed2131cc-559f-4cd6-b558-72473509c325" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 780.688777] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('ed2131cc-559f-4cd6-b558-72473509c325',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 781.114712] env[65370]: INFO networking_nsxv3.common.synchronization [req-6e7ad121-3bd0-45eb-84a1-0585c1451c92 req-5319a019-6b01-4f09-9ccd-50788b8fab7e tempest-ServersAdminTestJSON-387254877 tempest-ServersAdminTestJSON-387254877-project-member] Enqueued Resource ID: feaf18c3-295c-41df-89f1-309931cdeca1 with Priority: HIGHEST for action security_group_members [ 781.114712] env[65370]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: feaf18c3-295c-41df-89f1-309931cdeca1 with Priority: HIGHEST for action security_group_members [ 781.115038] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock member-feaf18c3-295c-41df-89f1-309931cdeca1 taken with stack trace [, , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 781.115169] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-feaf18c3-295c-41df-89f1-309931cdeca1" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 781.115258] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-feaf18c3-295c-41df-89f1-309931cdeca1" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 781.115534] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-feaf18c3-295c-41df-89f1-309931cdeca1" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 781.115733] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 781.116115] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 781.116115] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 781.116115] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 781.116248] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 781.116512] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('feaf18c3-295c-41df-89f1-309931cdeca1',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 781.134739] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock member-e2790d7c-6d0c-45bc-84d1-8cb00d26b9b0 taken with stack trace [, , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 781.134739] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e2790d7c-6d0c-45bc-84d1-8cb00d26b9b0" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 781.134739] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e2790d7c-6d0c-45bc-84d1-8cb00d26b9b0" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 781.134938] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e2790d7c-6d0c-45bc-84d1-8cb00d26b9b0" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 781.135044] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 781.135154] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 781.135219] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 781.135373] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 781.135791] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 781.135791] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e2790d7c-6d0c-45bc-84d1-8cb00d26b9b0" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 781.135791] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock member-e2790d7c-6d0c-45bc-84d1-8cb00d26b9b0 taken with stack trace [, , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 781.135950] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e2790d7c-6d0c-45bc-84d1-8cb00d26b9b0" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 781.135950] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e2790d7c-6d0c-45bc-84d1-8cb00d26b9b0" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 781.136035] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e2790d7c-6d0c-45bc-84d1-8cb00d26b9b0" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 781.136178] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 781.136269] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 781.136316] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 781.136460] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 781.136524] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 781.136609] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e2790d7c-6d0c-45bc-84d1-8cb00d26b9b0" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 781.136698] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('e2790d7c-6d0c-45bc-84d1-8cb00d26b9b0',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 781.191697] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock member-ed2131cc-559f-4cd6-b558-72473509c325 taken with stack trace [, , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 781.192125] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ed2131cc-559f-4cd6-b558-72473509c325" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 781.192350] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ed2131cc-559f-4cd6-b558-72473509c325" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 781.193641] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ed2131cc-559f-4cd6-b558-72473509c325" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 781.194032] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 781.195107] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 781.195290] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 781.196535] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 781.196535] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 781.196535] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ed2131cc-559f-4cd6-b558-72473509c325" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 781.196535] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock member-ed2131cc-559f-4cd6-b558-72473509c325 taken with stack trace [, , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 781.197129] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ed2131cc-559f-4cd6-b558-72473509c325" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 781.197518] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ed2131cc-559f-4cd6-b558-72473509c325" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 781.197975] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ed2131cc-559f-4cd6-b558-72473509c325" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 781.199912] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 781.200426] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 781.202855] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 781.202855] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 781.202855] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 781.202855] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ed2131cc-559f-4cd6-b558-72473509c325" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 781.202855] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('ed2131cc-559f-4cd6-b558-72473509c325',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 781.618689] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('feaf18c3-295c-41df-89f1-309931cdeca1',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 781.645380] env[65370]: DEBUG networking_nsxv3.common.locking [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Lock network-571 taken with stack trace [, , , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 781.645793] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquiring lock "network-571" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 781.645793] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquired lock "network-571" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 781.645976] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquired external semaphore "network-571" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 781.646231] env[65370]: DEBUG networking_nsxv3.common.locking [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 781.646382] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquiring lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 781.646506] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquired lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 781.646734] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquired external semaphore "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 781.646884] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Releasing lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 781.647731] env[65370]: DEBUG dogpile.cache.region [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] No value present for key: 'zone-id' {{(pid=65370) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 781.647731] env[65370]: DEBUG dogpile.lock [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] NeedRegenerationException {{(pid=65370) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 781.647731] env[65370]: DEBUG dogpile.lock [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] no value, waiting for create lock {{(pid=65370) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 781.647731] env[65370]: DEBUG dogpile.lock [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] value creation lock acquired {{(pid=65370) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 781.647731] env[65370]: DEBUG dogpile.cache.region [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] No value present for key: 'zone-id' {{(pid=65370) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 781.647731] env[65370]: DEBUG dogpile.lock [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Calling creation function for not-yet-present value {{(pid=65370) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 781.648011] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 781.649371] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for e2790d7c-6d0c-45bc-84d1-8cb00d26b9b0: rpc.has_security_group_logging(os_id): False [ 781.670685] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 781.670973] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 781.671088] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 781.671377] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 781.671559] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 781.671861] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 781.672058] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 781.672223] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 781.672402] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 781.672549] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 781.672887] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 781.673048] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 781.673174] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 781.673428] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 781.673561] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 781.673873] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 781.674022] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 781.674118] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 781.674325] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 781.674462] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 781.674594] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e2790d7c-6d0c-45bc-84d1-8cb00d26b9b0 is going to be updated. [ 781.677248] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 781.677463] env[65370]: DEBUG dogpile.cache.region [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Cache value generated in 0.029 seconds for key(s): 'zone-id' {{(pid=65370) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 781.677624] env[65370]: DEBUG dogpile.lock [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Released creation lock {{(pid=65370) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 781.677785] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Releasing lock "network-571" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 781.678206] env[65370]: DEBUG networking_nsxv3.common.locking [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Lock port-1819f5e5-93ee-4ad9-b38c-e0c54465f0fe taken with stack trace [, , , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 781.678430] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquiring lock "port-1819f5e5-93ee-4ad9-b38c-e0c54465f0fe" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 781.678604] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquired lock "port-1819f5e5-93ee-4ad9-b38c-e0c54465f0fe" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 781.678955] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquired external semaphore "port-1819f5e5-93ee-4ad9-b38c-e0c54465f0fe" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 781.679113] env[65370]: DEBUG networking_nsxv3.api.rpc [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1819f5e5-93ee-4ad9-b38c-e0c54465f0fe',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 781.705877] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for ed2131cc-559f-4cd6-b558-72473509c325: rpc.has_security_group_logging(os_id): False [ 781.728194] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 781.728339] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 781.728379] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 781.729020] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 781.729020] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 781.729020] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 781.729020] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 781.729020] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 781.729403] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 781.729403] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 781.729541] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 781.729660] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 781.729733] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 781.729861] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 781.730574] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 781.730574] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 781.730574] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 781.730574] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 781.730574] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 781.730574] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 781.730574] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: ed2131cc-559f-4cd6-b558-72473509c325 is going to be created. [ 781.768045] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 781.768045] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 781.768045] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 781.768045] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 781.768045] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 781.783342] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e2790d7c-6d0c-45bc-84d1-8cb00d26b9b0 in Status: IN_PROGRESS for 2s [ 781.812613] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 781.812613] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 781.812728] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 781.813157] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 781.813240] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 781.827782] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ed2131cc-559f-4cd6-b558-72473509c325 in Status: IN_PROGRESS for 2s [ 782.121896] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('feaf18c3-295c-41df-89f1-309931cdeca1',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 782.185021] env[65370]: DEBUG networking_nsxv3.common.locking [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 782.185021] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquiring lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 782.185021] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquired lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 782.185021] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquired external semaphore "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 782.185021] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Releasing lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 782.185021] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Segment Port 1819f5e5-93ee-4ad9-b38c-e0c54465f0fe not found, creating... [ 782.185021] env[65370]: DEBUG networking_nsxv3.common.locking [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 782.185021] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquiring lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 782.185021] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquired lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 782.185021] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquired external semaphore "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 782.185021] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Releasing lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 782.185438] env[65370]: DEBUG networking_nsxv3.common.locking [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 782.185438] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquiring lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 782.185438] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquired lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 782.185438] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquired external semaphore "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 782.185438] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Releasing lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 782.185438] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Resource: SegmentPort with ID: 1819f5e5-93ee-4ad9-b38c-e0c54465f0fe is going to be created. [ 782.208368] env[65370]: DEBUG networking_nsxv3.common.locking [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 782.208495] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquiring lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 782.208587] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquired lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 782.208837] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquired external semaphore "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 782.209055] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Releasing lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 782.209278] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Releasing lock "port-1819f5e5-93ee-4ad9-b38c-e0c54465f0fe" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 782.253229] env[65370]: INFO networking_nsxv3.common.synchronization [req-5294000f-99d1-450b-9a4d-34a5e5b99ece req-caa61aed-dbb2-4248-a7f7-2e942eaa416f tempest-SecurityGroupsTestJSON-1618218766 tempest-SecurityGroupsTestJSON-1618218766-project-member] Enqueued Resource ID: 78c0a4a2-12c9-4a82-bedc-df813ca8b608 with Priority: HIGHEST for action security_group_members [ 782.253229] env[65370]: INFO networking_nsxv3.common.synchronization [req-5294000f-99d1-450b-9a4d-34a5e5b99ece req-caa61aed-dbb2-4248-a7f7-2e942eaa416f tempest-SecurityGroupsTestJSON-1618218766 tempest-SecurityGroupsTestJSON-1618218766-project-member] Enqueued Resource ID: 8d9c7efa-60b6-44af-830b-f32145b1b403 with Priority: HIGHEST for action security_group_members [ 782.253478] env[65370]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 78c0a4a2-12c9-4a82-bedc-df813ca8b608 with Priority: HIGHEST for action security_group_members [ 782.253590] env[65370]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8d9c7efa-60b6-44af-830b-f32145b1b403 with Priority: HIGHEST for action security_group_members [ 782.256895] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock member-78c0a4a2-12c9-4a82-bedc-df813ca8b608 taken with stack trace [, , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 782.257116] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-78c0a4a2-12c9-4a82-bedc-df813ca8b608" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 782.257116] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-78c0a4a2-12c9-4a82-bedc-df813ca8b608" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 782.257315] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-78c0a4a2-12c9-4a82-bedc-df813ca8b608" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 782.257450] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 782.259063] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 782.259063] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 782.259063] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 782.259063] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 782.259063] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('78c0a4a2-12c9-4a82-bedc-df813ca8b608',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 782.259063] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock member-8d9c7efa-60b6-44af-830b-f32145b1b403 taken with stack trace [, , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 782.260102] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8d9c7efa-60b6-44af-830b-f32145b1b403" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 782.260102] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8d9c7efa-60b6-44af-830b-f32145b1b403" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 782.260102] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8d9c7efa-60b6-44af-830b-f32145b1b403" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 782.260102] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 782.260102] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 782.260102] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 782.260102] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 782.260102] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 782.260102] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('8d9c7efa-60b6-44af-830b-f32145b1b403',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 782.320117] env[65370]: INFO networking_nsxv3.common.synchronization [req-5294000f-99d1-450b-9a4d-34a5e5b99ece req-caa61aed-dbb2-4248-a7f7-2e942eaa416f tempest-SecurityGroupsTestJSON-1618218766 tempest-SecurityGroupsTestJSON-1618218766-project-member] Enqueued Resource ID: 78c0a4a2-12c9-4a82-bedc-df813ca8b608 with Priority: HIGHEST for action security_group_rules [ 782.320307] env[65370]: INFO networking_nsxv3.common.synchronization [req-5294000f-99d1-450b-9a4d-34a5e5b99ece req-caa61aed-dbb2-4248-a7f7-2e942eaa416f tempest-SecurityGroupsTestJSON-1618218766 tempest-SecurityGroupsTestJSON-1618218766-project-member] Enqueued Resource ID: 78c0a4a2-12c9-4a82-bedc-df813ca8b608 with Priority: HIGHEST for action security_group_members [ 782.320433] env[65370]: INFO networking_nsxv3.common.synchronization [req-5294000f-99d1-450b-9a4d-34a5e5b99ece req-caa61aed-dbb2-4248-a7f7-2e942eaa416f tempest-SecurityGroupsTestJSON-1618218766 tempest-SecurityGroupsTestJSON-1618218766-project-member] Enqueued Resource ID: 8d9c7efa-60b6-44af-830b-f32145b1b403 with Priority: HIGHEST for action security_group_rules [ 782.320552] env[65370]: INFO networking_nsxv3.common.synchronization [req-5294000f-99d1-450b-9a4d-34a5e5b99ece req-caa61aed-dbb2-4248-a7f7-2e942eaa416f tempest-SecurityGroupsTestJSON-1618218766 tempest-SecurityGroupsTestJSON-1618218766-project-member] Enqueued Resource ID: 8d9c7efa-60b6-44af-830b-f32145b1b403 with Priority: HIGHEST for action security_group_members [ 782.320673] env[65370]: INFO networking_nsxv3.common.synchronization [req-5294000f-99d1-450b-9a4d-34a5e5b99ece req-caa61aed-dbb2-4248-a7f7-2e942eaa416f tempest-SecurityGroupsTestJSON-1618218766 tempest-SecurityGroupsTestJSON-1618218766-project-member] Enqueued Resource ID: f50b5939-e040-4b41-bb53-4e3dff89fdb6 with Priority: HIGHEST for action port [ 782.321432] env[65370]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 78c0a4a2-12c9-4a82-bedc-df813ca8b608 with Priority: HIGHEST for action security_group_rules [ 782.321669] env[65370]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8d9c7efa-60b6-44af-830b-f32145b1b403 with Priority: HIGHEST for action security_group_rules [ 782.321669] env[65370]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f50b5939-e040-4b41-bb53-4e3dff89fdb6 with Priority: HIGHEST for action port [ 782.321839] env[65370]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 78c0a4a2-12c9-4a82-bedc-df813ca8b608 with Priority: HIGHEST for action security_group_members [ 782.321881] env[65370]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8d9c7efa-60b6-44af-830b-f32145b1b403 with Priority: HIGHEST for action security_group_members [ 782.322145] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock rules-78c0a4a2-12c9-4a82-bedc-df813ca8b608 taken with stack trace [, , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 782.322271] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-78c0a4a2-12c9-4a82-bedc-df813ca8b608" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 782.322377] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-78c0a4a2-12c9-4a82-bedc-df813ca8b608" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 782.322578] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-78c0a4a2-12c9-4a82-bedc-df813ca8b608" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 782.322659] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('78c0a4a2-12c9-4a82-bedc-df813ca8b608',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 782.325142] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock rules-8d9c7efa-60b6-44af-830b-f32145b1b403 taken with stack trace [, , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 782.325281] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-8d9c7efa-60b6-44af-830b-f32145b1b403" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 782.325343] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-8d9c7efa-60b6-44af-830b-f32145b1b403" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 782.326029] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-8d9c7efa-60b6-44af-830b-f32145b1b403" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 782.326029] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('8d9c7efa-60b6-44af-830b-f32145b1b403',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 782.326574] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock port-f50b5939-e040-4b41-bb53-4e3dff89fdb6 taken with stack trace [, , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 782.326695] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-f50b5939-e040-4b41-bb53-4e3dff89fdb6" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 782.326750] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-f50b5939-e040-4b41-bb53-4e3dff89fdb6" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 782.326927] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-f50b5939-e040-4b41-bb53-4e3dff89fdb6" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 782.327166] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f50b5939-e040-4b41-bb53-4e3dff89fdb6',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 782.329094] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock member-78c0a4a2-12c9-4a82-bedc-df813ca8b608 taken with stack trace [, , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 782.329094] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-78c0a4a2-12c9-4a82-bedc-df813ca8b608" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 782.329094] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock member-8d9c7efa-60b6-44af-830b-f32145b1b403 taken with stack trace [, , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 782.329094] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8d9c7efa-60b6-44af-830b-f32145b1b403" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 782.350247] env[65370]: INFO networking_nsxv3.common.synchronization [None req-78bbfeb0-b4ad-4a37-8df0-814141c18b67 None None] Enqueued Resource ID: 1f4bec30-5a4d-4dc6-bfb9-d89fde205b68 with Priority: HIGHEST for action port [ 782.350247] env[65370]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1f4bec30-5a4d-4dc6-bfb9-d89fde205b68 with Priority: HIGHEST for action port [ 782.350247] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock port-1f4bec30-5a4d-4dc6-bfb9-d89fde205b68 taken with stack trace [, , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 782.350247] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-1f4bec30-5a4d-4dc6-bfb9-d89fde205b68" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 782.350247] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-1f4bec30-5a4d-4dc6-bfb9-d89fde205b68" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 782.350247] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-1f4bec30-5a4d-4dc6-bfb9-d89fde205b68" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 782.350247] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1f4bec30-5a4d-4dc6-bfb9-d89fde205b68',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 782.550335] env[65370]: INFO networking_nsxv3.common.synchronization [None req-a73fb100-fcb0-4255-8b65-5c4119ed2098 tempest-ServerActionsTestJSON-720598601 tempest-ServerActionsTestJSON-720598601-project-member] Enqueued Resource ID: fe248172-4be4-4d95-a8ca-c9c2ef203894 with Priority: HIGHEST for action security_group_rules [ 782.550335] env[65370]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fe248172-4be4-4d95-a8ca-c9c2ef203894 with Priority: HIGHEST for action security_group_rules [ 782.550335] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock rules-fe248172-4be4-4d95-a8ca-c9c2ef203894 taken with stack trace [, , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 782.550335] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-fe248172-4be4-4d95-a8ca-c9c2ef203894" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 782.550335] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-fe248172-4be4-4d95-a8ca-c9c2ef203894" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 782.550335] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-fe248172-4be4-4d95-a8ca-c9c2ef203894" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 782.550335] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('fe248172-4be4-4d95-a8ca-c9c2ef203894',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 782.626496] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 782.626668] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 782.626735] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 782.626962] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 782.627065] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 782.627164] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: feaf18c3-295c-41df-89f1-309931cdeca1 is going to be updated. [ 782.672436] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 782.672744] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 782.672744] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 782.672864] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 782.673024] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 782.681895] env[65370]: INFO networking_nsxv3.common.synchronization [None req-69677c1b-f90f-4256-9f6d-266a0bfa07fa tempest-ServerActionsTestJSON-720598601 tempest-ServerActionsTestJSON-720598601-project-member] Enqueued Resource ID: fe248172-4be4-4d95-a8ca-c9c2ef203894 with Priority: HIGHEST for action security_group_rules [ 782.682619] env[65370]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fe248172-4be4-4d95-a8ca-c9c2ef203894 with Priority: HIGHEST for action security_group_rules [ 782.684512] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: feaf18c3-295c-41df-89f1-309931cdeca1 in Status: IN_PROGRESS for 2s [ 782.685234] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock rules-fe248172-4be4-4d95-a8ca-c9c2ef203894 taken with stack trace [, , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 782.685371] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-fe248172-4be4-4d95-a8ca-c9c2ef203894" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 782.763434] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('78c0a4a2-12c9-4a82-bedc-df813ca8b608',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 782.766771] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('8d9c7efa-60b6-44af-830b-f32145b1b403',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 782.804370] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock all taken with stack trace [, , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 782.804543] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "all" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 782.804543] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "all" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 782.804900] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "all" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 782.804900] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_ports_with_revisions called with arguments (1000, 0) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 782.829894] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock member-78c0a4a2-12c9-4a82-bedc-df813ca8b608 taken with stack trace [, , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 782.830087] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-78c0a4a2-12c9-4a82-bedc-df813ca8b608" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 782.831481] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock member-8d9c7efa-60b6-44af-830b-f32145b1b403 taken with stack trace [, , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 782.831615] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8d9c7efa-60b6-44af-830b-f32145b1b403" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 782.831740] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port f50b5939-e040-4b41-bb53-4e3dff89fdb6 with status ACTIVE [ 782.831945] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 782.832088] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 782.832155] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 782.832360] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 782.832678] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 782.832678] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 782.832778] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 782.832778] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 782.832885] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 782.832986] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 782.833142] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 782.833229] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 782.833420] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 782.833505] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 782.833505] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 782.833618] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: f50b5939-e040-4b41-bb53-4e3dff89fdb6 is going to be updated. [ 782.852335] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 1f4bec30-5a4d-4dc6-bfb9-d89fde205b68 [ 782.852617] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 782.853212] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 782.853212] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 782.853212] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 782.853391] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 782.853510] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:1f4bec30-5a4d-4dc6-bfb9-d89fde205b68 already deleted. [ 782.853593] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-1f4bec30-5a4d-4dc6-bfb9-d89fde205b68" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 782.860583] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 782.860583] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 782.860583] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 782.860583] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 782.860583] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 782.860835] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-f50b5939-e040-4b41-bb53-4e3dff89fdb6" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 783.073038] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 783.074263] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 783.074263] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 783.074263] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 783.074263] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 783.074263] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: fe248172-4be4-4d95-a8ca-c9c2ef203894 already deleted. [ 783.074263] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-fe248172-4be4-4d95-a8ca-c9c2ef203894" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 783.074263] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-fe248172-4be4-4d95-a8ca-c9c2ef203894" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 783.074263] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-fe248172-4be4-4d95-a8ca-c9c2ef203894" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 783.074725] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('fe248172-4be4-4d95-a8ca-c9c2ef203894',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 783.266988] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('78c0a4a2-12c9-4a82-bedc-df813ca8b608',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 783.268714] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('8d9c7efa-60b6-44af-830b-f32145b1b403',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 783.307051] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_groups_with_revisions called with arguments (1000, 0) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 783.424578] env[65370]: INFO networking_nsxv3.common.synchronization [req-6e7ad121-3bd0-45eb-84a1-0585c1451c92 req-a43ced4a-aebb-488d-b2c1-9aed096b0d60 service nova] Enqueued Resource ID: feaf18c3-295c-41df-89f1-309931cdeca1 with Priority: HIGHEST for action security_group_rules [ 783.424766] env[65370]: INFO networking_nsxv3.common.synchronization [req-6e7ad121-3bd0-45eb-84a1-0585c1451c92 req-a43ced4a-aebb-488d-b2c1-9aed096b0d60 service nova] Enqueued Resource ID: feaf18c3-295c-41df-89f1-309931cdeca1 with Priority: HIGHEST for action security_group_members [ 783.424897] env[65370]: INFO networking_nsxv3.common.synchronization [req-6e7ad121-3bd0-45eb-84a1-0585c1451c92 req-a43ced4a-aebb-488d-b2c1-9aed096b0d60 service nova] Enqueued Resource ID: 1819f5e5-93ee-4ad9-b38c-e0c54465f0fe with Priority: HIGHEST for action port [ 783.425448] env[65370]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: feaf18c3-295c-41df-89f1-309931cdeca1 with Priority: HIGHEST for action security_group_rules [ 783.425625] env[65370]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: feaf18c3-295c-41df-89f1-309931cdeca1 with Priority: HIGHEST for action security_group_members [ 783.425721] env[65370]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1819f5e5-93ee-4ad9-b38c-e0c54465f0fe with Priority: HIGHEST for action port [ 783.427912] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock rules-feaf18c3-295c-41df-89f1-309931cdeca1 taken with stack trace [, , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 783.429705] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-feaf18c3-295c-41df-89f1-309931cdeca1" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 783.429745] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-feaf18c3-295c-41df-89f1-309931cdeca1" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 783.429956] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-feaf18c3-295c-41df-89f1-309931cdeca1" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 783.430043] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('feaf18c3-295c-41df-89f1-309931cdeca1',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 783.431412] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock member-feaf18c3-295c-41df-89f1-309931cdeca1 taken with stack trace [, , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 783.431412] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-feaf18c3-295c-41df-89f1-309931cdeca1" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 783.432891] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock port-1819f5e5-93ee-4ad9-b38c-e0c54465f0fe taken with stack trace [, , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 783.432891] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-1819f5e5-93ee-4ad9-b38c-e0c54465f0fe" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 783.432891] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-1819f5e5-93ee-4ad9-b38c-e0c54465f0fe" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 783.432891] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-1819f5e5-93ee-4ad9-b38c-e0c54465f0fe" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 783.432891] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1819f5e5-93ee-4ad9-b38c-e0c54465f0fe',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 783.596132] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 783.596275] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 783.598370] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 783.598370] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 783.598370] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 783.598370] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: fe248172-4be4-4d95-a8ca-c9c2ef203894 already deleted. [ 783.598370] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-fe248172-4be4-4d95-a8ca-c9c2ef203894" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 783.769415] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 783.769865] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 783.769865] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 783.769865] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 783.770090] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 783.770090] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 78c0a4a2-12c9-4a82-bedc-df813ca8b608 is going to be created. [ 783.771536] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 783.771674] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 783.771736] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 783.771913] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 783.771998] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 783.772588] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8d9c7efa-60b6-44af-830b-f32145b1b403 is going to be updated. [ 783.809615] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_qos_policies_with_revisions called with arguments (1000, 0) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 783.826528] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 783.826845] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 783.826845] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 783.827832] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 783.827832] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 783.838313] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e2790d7c-6d0c-45bc-84d1-8cb00d26b9b0 in Status: SUCCESS [ 783.838719] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e2790d7c-6d0c-45bc-84d1-8cb00d26b9b0" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 783.850657] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 783.851900] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 783.853030] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 783.853330] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 783.854198] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 783.857992] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 78c0a4a2-12c9-4a82-bedc-df813ca8b608 in Status: UNINITIALIZED for 2s [ 783.859817] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ed2131cc-559f-4cd6-b558-72473509c325 in Status: SUCCESS [ 783.860465] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-ed2131cc-559f-4cd6-b558-72473509c325" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 783.868821] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8d9c7efa-60b6-44af-830b-f32145b1b403 in Status: IN_PROGRESS for 2s [ 783.900028] env[65370]: INFO networking_nsxv3.common.synchronization [req-fb3b3b5b-9091-489e-97fd-aef587168544 req-753414b9-e7f8-43dd-bb9c-7230be2b19a3 tempest-ImagesOneServerTestJSON-1198729989 tempest-ImagesOneServerTestJSON-1198729989-project-member] Enqueued Resource ID: b6c4259c-ea9b-4b2f-84b9-cbedce2ee198 with Priority: HIGHEST for action security_group_members [ 783.900028] env[65370]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b6c4259c-ea9b-4b2f-84b9-cbedce2ee198 with Priority: HIGHEST for action security_group_members [ 783.900293] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock member-b6c4259c-ea9b-4b2f-84b9-cbedce2ee198 taken with stack trace [, , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 783.900418] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b6c4259c-ea9b-4b2f-84b9-cbedce2ee198" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 783.900480] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b6c4259c-ea9b-4b2f-84b9-cbedce2ee198" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 783.900680] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b6c4259c-ea9b-4b2f-84b9-cbedce2ee198" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 783.900833] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 783.900931] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 783.900995] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 783.901150] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 783.901699] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 783.901852] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b6c4259c-ea9b-4b2f-84b9-cbedce2ee198',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 783.936030] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock member-feaf18c3-295c-41df-89f1-309931cdeca1 taken with stack trace [, , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 783.936030] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-feaf18c3-295c-41df-89f1-309931cdeca1" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 783.936030] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 1819f5e5-93ee-4ad9-b38c-e0c54465f0fe with status ACTIVE [ 783.936030] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 783.936030] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 783.936030] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 783.936030] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 783.936030] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 783.936030] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 783.936729] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 783.936729] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 783.936729] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 783.936729] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 783.936729] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 783.936729] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 783.937104] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 783.937104] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 783.937104] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 783.937662] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 1819f5e5-93ee-4ad9-b38c-e0c54465f0fe is going to be updated. [ 783.975028] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 783.975028] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 783.975028] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 783.975028] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 783.975028] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 783.975028] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-1819f5e5-93ee-4ad9-b38c-e0c54465f0fe" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 784.314030] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Inventory metadata is going to be refreshed. [ 784.314030] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Segment. [ 784.404381] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 784.404381] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 784.405409] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 784.405409] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 784.434902] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 784.434902] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 784.434902] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 784.434902] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 784.434902] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 784.434902] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 784.434902] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b6c4259c-ea9b-4b2f-84b9-cbedce2ee198 is going to be updated. [ 784.470637] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 784.470637] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 784.470801] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 784.471073] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 784.472119] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 784.482057] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b6c4259c-ea9b-4b2f-84b9-cbedce2ee198 in Status: IN_PROGRESS for 2s [ 784.698259] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: feaf18c3-295c-41df-89f1-309931cdeca1 in Status: SUCCESS [ 784.698259] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-feaf18c3-295c-41df-89f1-309931cdeca1" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 784.698259] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-feaf18c3-295c-41df-89f1-309931cdeca1" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 784.698969] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-feaf18c3-295c-41df-89f1-309931cdeca1" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 784.699232] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 784.700170] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 784.700170] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 784.700278] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 784.700344] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 784.700762] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('feaf18c3-295c-41df-89f1-309931cdeca1',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 785.039102] env[65370]: INFO networking_nsxv3.common.synchronization [req-662035da-9250-4ce5-96b9-5a7f1195440a req-579ee111-fd85-412b-95fa-2752db6b9ed7 tempest-ServerActionsTestOtherA-1239332614 tempest-ServerActionsTestOtherA-1239332614-project-member] Enqueued Resource ID: b7074d70-d8cb-411f-b8c4-a4007dfd74f8 with Priority: HIGHEST for action security_group_members [ 785.039737] env[65370]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b7074d70-d8cb-411f-b8c4-a4007dfd74f8 with Priority: HIGHEST for action security_group_members [ 785.040216] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock member-b7074d70-d8cb-411f-b8c4-a4007dfd74f8 taken with stack trace [, , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 785.040216] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b7074d70-d8cb-411f-b8c4-a4007dfd74f8" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 785.040349] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b7074d70-d8cb-411f-b8c4-a4007dfd74f8" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 785.040485] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b7074d70-d8cb-411f-b8c4-a4007dfd74f8" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 785.040668] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 785.040778] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 785.040862] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 785.040978] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 785.041074] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 785.041164] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b7074d70-d8cb-411f-b8c4-a4007dfd74f8',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 785.202467] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('feaf18c3-295c-41df-89f1-309931cdeca1',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 785.234712] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 785.234983] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 785.235136] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 785.235456] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 785.250510] env[65370]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider [-] Duplicate resource with OS_ID: 992 ID: cl2-zone-992 [ 785.250899] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 785.252046] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:SegmentPort. [ 785.280629] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 785.280629] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 785.280629] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 785.280629] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 785.285822] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 785.286424] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:SegmentPort Is:1. [ 785.287032] env[65370]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:SegmentPort Are:{'1819f5e5-93ee-4ad9-b38c-e0c54465f0fe'} {{(pid=65370) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 785.287032] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules). [ 785.369099] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 785.369099] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 785.369099] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 785.369099] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 785.372590] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 785.372590] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules Remote IP Prefix). [ 785.526207] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules Remote IP Prefix) taken with stack trace [, , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 785.526207] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules Remote IP Prefix)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 785.527800] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules Remote IP Prefix)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 785.527800] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules Remote IP Prefix)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 785.527800] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules Remote IP Prefix)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 785.528686] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Address Group. [ 785.544250] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 785.548317] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 785.548317] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 785.548317] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 785.574135] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 785.574258] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 785.574414] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 785.574462] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 785.574804] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 785.574947] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 785.575073] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b7074d70-d8cb-411f-b8c4-a4007dfd74f8 is going to be updated. [ 785.618362] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 785.618544] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 785.618694] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 785.618835] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 785.619023] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 785.634153] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Address Group taken with stack trace [, , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 785.634361] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Address Group" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 785.634405] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Address Group" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 785.634597] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Address Group" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 785.635421] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Address Group" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 785.635575] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Security Group (Rules) Is:33. [ 785.635725] env[65370]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Security Group (Rules) Are:{'408a8a38-c326-4f43-84a2-818a13f7e124', '237e1a89-daff-4fd5-b02a-97e1d536d9bd', 'feaf18c3-295c-41df-89f1-309931cdeca1', '23979820-ccb5-4fdf-8d1a-316ad4242d32', 'e01148a4-883d-4ac9-887d-a7302ffdd9d7', 'e4c5be7e-6c74-44a0-bf7b-9581ec4636c2', 'ed2131cc-559f-4cd6-b558-72473509c325', 'ce41a48f-c3f8-4fae-9206-7c7028887496', '81833a12-37d8-4ada-8f82-01b16a0f7a0a', 'aa33d5a3-f440-4aa7-9d41-10cb85d18100', '6f93689f-ae79-496c-bd6b-5fcec0a3824f', '420136f3-91df-4669-b5e3-cee436aeacb9', 'd1777ef4-6140-42f0-bcd4-a267f85cb990', '0cacf152-a4d4-4487-a370-aa2bae090120', 'a316198c-c3c7-4c28-a092-301a77045bc5', 'b8e66f81-0f32-48b8-b81f-542b74cbecd4', '5132c293-b680-4491-ba2b-122515a71eaf', '20ca8821-63b1-4a18-a45d-43ad145b3707', 'b7074d70-d8cb-411f-b8c4-a4007dfd74f8', '8d9c7efa-60b6-44af-830b-f32145b1b403', '14c6c739-bd84-4bc8-9d1c-9bc29741c32d', '67f4a0c1-3a3c-4ed8-9358-3a9645aba154', 'e2790d7c-6d0c-45bc-84d1-8cb00d26b9b0', '1eaa763e-4469-4428-92d0-ba20a6c99edc', 'd65082c9-0b60-42be-a86a-b728b05e4ca4', '7c93cef4-117c-4bf3-aaf5-07dadeb90a88', 'ade9055b-2ef9-426f-9386-65654700ee06', '2011abd7-ba10-4aae-84fb-1b1bfbd238fa', '4269e0a9-b570-412a-9993-d1965229c186', 'b6c4259c-ea9b-4b2f-84b9-cbedce2ee198', '00a251e9-7a00-4293-9092-9556bc8b91c2', '1a7b0f53-ef43-4301-97b8-ab12f1f2ae45', '48cb2a6d-3a04-4700-a0e8-ee3e4e1a679c'} {{(pid=65370) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 785.635837] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Segment QoS. [ 785.638541] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b7074d70-d8cb-411f-b8c4-a4007dfd74f8 in Status: IN_PROGRESS for 2s [ 785.695368] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Segment QoS taken with stack trace [, , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 785.695610] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment QoS" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 785.695757] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment QoS" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 785.696118] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment QoS" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 785.696213] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment QoS" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 785.696361] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Segment QoS Is:0. [ 785.696437] env[65370]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Segment QoS Are:set() {{(pid=65370) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 785.696718] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Members). [ 785.707051] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('feaf18c3-295c-41df-89f1-309931cdeca1',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 785.873083] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 78c0a4a2-12c9-4a82-bedc-df813ca8b608 in Status: SUCCESS [ 785.873392] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-78c0a4a2-12c9-4a82-bedc-df813ca8b608" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 785.873926] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-78c0a4a2-12c9-4a82-bedc-df813ca8b608" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 785.875602] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-78c0a4a2-12c9-4a82-bedc-df813ca8b608" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 785.875602] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 785.875602] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 785.875602] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 785.875602] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 785.875602] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 785.875602] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('78c0a4a2-12c9-4a82-bedc-df813ca8b608',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 785.880229] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8d9c7efa-60b6-44af-830b-f32145b1b403 in Status: SUCCESS [ 785.880287] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8d9c7efa-60b6-44af-830b-f32145b1b403" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 785.882408] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 785.882562] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 785.882635] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 785.883202] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 785.884178] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 785.884396] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Security Group (Members) Is:0. [ 785.884466] env[65370]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Security Group (Members) Are:set() {{(pid=65370) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 785.884592] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Inventory metadata have been refreshed. [ 785.884592] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 1/1 resources of Type:Ports [ 785.884694] env[65370]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 1819f5e5-93ee-4ad9-b38c-e0c54465f0fe with Priority: HIGH for action port [ 785.884770] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 19/33 resources of Type:Security Group Rules [ 785.884833] env[65370]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 408a8a38-c326-4f43-84a2-818a13f7e124 with Priority: HIGH for action security_group_rules [ 785.884934] env[65370]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 237e1a89-daff-4fd5-b02a-97e1d536d9bd with Priority: HIGH for action security_group_rules [ 785.885011] env[65370]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: feaf18c3-295c-41df-89f1-309931cdeca1 with Priority: HIGH for action security_group_rules [ 785.885078] env[65370]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 23979820-ccb5-4fdf-8d1a-316ad4242d32 with Priority: HIGH for action security_group_rules [ 785.885078] env[65370]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: e01148a4-883d-4ac9-887d-a7302ffdd9d7 with Priority: HIGH for action security_group_rules [ 785.885189] env[65370]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: e4c5be7e-6c74-44a0-bf7b-9581ec4636c2 with Priority: HIGH for action security_group_rules [ 785.885189] env[65370]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: ed2131cc-559f-4cd6-b558-72473509c325 with Priority: HIGH for action security_group_rules [ 785.885288] env[65370]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: ce41a48f-c3f8-4fae-9206-7c7028887496 with Priority: HIGH for action security_group_rules [ 785.885340] env[65370]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 81833a12-37d8-4ada-8f82-01b16a0f7a0a with Priority: HIGH for action security_group_rules [ 785.885388] env[65370]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: aa33d5a3-f440-4aa7-9d41-10cb85d18100 with Priority: HIGH for action security_group_rules [ 785.885433] env[65370]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 6f93689f-ae79-496c-bd6b-5fcec0a3824f with Priority: HIGH for action security_group_rules [ 785.885536] env[65370]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 420136f3-91df-4669-b5e3-cee436aeacb9 with Priority: HIGH for action security_group_rules [ 785.885536] env[65370]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: d1777ef4-6140-42f0-bcd4-a267f85cb990 with Priority: HIGH for action security_group_rules [ 785.885662] env[65370]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 0cacf152-a4d4-4487-a370-aa2bae090120 with Priority: HIGH for action security_group_rules [ 785.885662] env[65370]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: a316198c-c3c7-4c28-a092-301a77045bc5 with Priority: HIGH for action security_group_rules [ 785.890604] env[65370]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: b8e66f81-0f32-48b8-b81f-542b74cbecd4 with Priority: HIGH for action security_group_rules [ 785.890604] env[65370]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 5132c293-b680-4491-ba2b-122515a71eaf with Priority: HIGH for action security_group_rules [ 785.890604] env[65370]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 20ca8821-63b1-4a18-a45d-43ad145b3707 with Priority: HIGH for action security_group_rules [ 785.890604] env[65370]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: b7074d70-d8cb-411f-b8c4-a4007dfd74f8 with Priority: HIGH for action security_group_rules [ 785.890604] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "all" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 785.890604] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8d9c7efa-60b6-44af-830b-f32145b1b403" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 785.890604] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8d9c7efa-60b6-44af-830b-f32145b1b403" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 785.890604] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 785.890604] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 785.890604] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 785.890604] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 785.890604] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 785.890604] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('8d9c7efa-60b6-44af-830b-f32145b1b403',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 786.209579] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 786.209579] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 786.209579] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 786.210078] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 786.210078] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 786.210078] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: feaf18c3-295c-41df-89f1-309931cdeca1 is going to be updated. [ 786.242602] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 786.242857] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 786.242977] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 786.243378] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 786.243747] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 786.255702] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: feaf18c3-295c-41df-89f1-309931cdeca1 in Status: IN_PROGRESS for 2s [ 786.389625] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('78c0a4a2-12c9-4a82-bedc-df813ca8b608',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 786.394909] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('8d9c7efa-60b6-44af-830b-f32145b1b403',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 786.495627] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b6c4259c-ea9b-4b2f-84b9-cbedce2ee198 in Status: SUCCESS [ 786.495859] env[65370]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b6c4259c-ea9b-4b2f-84b9-cbedce2ee198 deletion is rescheduled due to dependency. [ 786.495981] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b6c4259c-ea9b-4b2f-84b9-cbedce2ee198" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 786.729191] env[65370]: INFO networking_nsxv3.common.synchronization [req-a9e184ec-17aa-4d76-9af6-2548b4c673cb req-44cb7864-f496-4638-b0c3-b7b2428bf3ff tempest-ServerDiskConfigTestJSON-902849627 tempest-ServerDiskConfigTestJSON-902849627-project-member] Enqueued Resource ID: 420136f3-91df-4669-b5e3-cee436aeacb9 with Priority: HIGHEST for action security_group_members [ 786.729879] env[65370]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 420136f3-91df-4669-b5e3-cee436aeacb9 with Priority: HIGHEST for action security_group_members [ 786.730070] env[65370]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1819f5e5-93ee-4ad9-b38c-e0c54465f0fe with Priority: HIGH for action port [ 786.730169] env[65370]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 237e1a89-daff-4fd5-b02a-97e1d536d9bd with Priority: HIGH for action security_group_rules [ 786.730275] env[65370]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e4c5be7e-6c74-44a0-bf7b-9581ec4636c2 with Priority: HIGH for action security_group_rules [ 786.730381] env[65370]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0cacf152-a4d4-4487-a370-aa2bae090120 with Priority: HIGH for action security_group_rules [ 786.730850] env[65370]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b7074d70-d8cb-411f-b8c4-a4007dfd74f8 with Priority: HIGH for action security_group_rules [ 786.730850] env[65370]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 20ca8821-63b1-4a18-a45d-43ad145b3707 with Priority: HIGH for action security_group_rules [ 786.731124] env[65370]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5132c293-b680-4491-ba2b-122515a71eaf with Priority: HIGH for action security_group_rules [ 786.731124] env[65370]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b8e66f81-0f32-48b8-b81f-542b74cbecd4 with Priority: HIGH for action security_group_rules [ 786.731261] env[65370]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d1777ef4-6140-42f0-bcd4-a267f85cb990 with Priority: HIGH for action security_group_rules [ 786.731429] env[65370]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a316198c-c3c7-4c28-a092-301a77045bc5 with Priority: HIGH for action security_group_rules [ 786.731522] env[65370]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 420136f3-91df-4669-b5e3-cee436aeacb9 with Priority: HIGH for action security_group_rules [ 786.731678] env[65370]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6f93689f-ae79-496c-bd6b-5fcec0a3824f with Priority: HIGH for action security_group_rules [ 786.731841] env[65370]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: aa33d5a3-f440-4aa7-9d41-10cb85d18100 with Priority: HIGH for action security_group_rules [ 786.732832] env[65370]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 81833a12-37d8-4ada-8f82-01b16a0f7a0a with Priority: HIGH for action security_group_rules [ 786.732832] env[65370]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ce41a48f-c3f8-4fae-9206-7c7028887496 with Priority: HIGH for action security_group_rules [ 786.732832] env[65370]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e01148a4-883d-4ac9-887d-a7302ffdd9d7 with Priority: HIGH for action security_group_rules [ 786.732832] env[65370]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ed2131cc-559f-4cd6-b558-72473509c325 with Priority: HIGH for action security_group_rules [ 786.732832] env[65370]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 23979820-ccb5-4fdf-8d1a-316ad4242d32 with Priority: HIGH for action security_group_rules [ 786.732832] env[65370]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 408a8a38-c326-4f43-84a2-818a13f7e124 with Priority: HIGH for action security_group_rules [ 786.732832] env[65370]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: feaf18c3-295c-41df-89f1-309931cdeca1 with Priority: HIGH for action security_group_rules [ 786.733199] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock member-420136f3-91df-4669-b5e3-cee436aeacb9 taken with stack trace [, , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 786.733279] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-420136f3-91df-4669-b5e3-cee436aeacb9" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 786.733463] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-420136f3-91df-4669-b5e3-cee436aeacb9" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 786.733658] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-420136f3-91df-4669-b5e3-cee436aeacb9" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 786.733895] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 786.734034] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 786.734092] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 786.734301] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 786.734393] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 786.734499] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('420136f3-91df-4669-b5e3-cee436aeacb9',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 786.735565] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock port-1819f5e5-93ee-4ad9-b38c-e0c54465f0fe taken with stack trace [, , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 786.735731] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-1819f5e5-93ee-4ad9-b38c-e0c54465f0fe" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 786.735834] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-1819f5e5-93ee-4ad9-b38c-e0c54465f0fe" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 786.736063] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-1819f5e5-93ee-4ad9-b38c-e0c54465f0fe" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 786.736181] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1819f5e5-93ee-4ad9-b38c-e0c54465f0fe',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 786.737539] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock rules-237e1a89-daff-4fd5-b02a-97e1d536d9bd taken with stack trace [, , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 786.737855] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-237e1a89-daff-4fd5-b02a-97e1d536d9bd" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 786.737855] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-237e1a89-daff-4fd5-b02a-97e1d536d9bd" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 786.738118] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-237e1a89-daff-4fd5-b02a-97e1d536d9bd" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 786.738118] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('237e1a89-daff-4fd5-b02a-97e1d536d9bd',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 786.738819] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e4c5be7e-6c74-44a0-bf7b-9581ec4636c2 taken with stack trace [, , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 786.738951] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e4c5be7e-6c74-44a0-bf7b-9581ec4636c2" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 786.739180] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e4c5be7e-6c74-44a0-bf7b-9581ec4636c2" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 786.739180] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e4c5be7e-6c74-44a0-bf7b-9581ec4636c2" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 786.739523] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e4c5be7e-6c74-44a0-bf7b-9581ec4636c2',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 786.740684] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock rules-0cacf152-a4d4-4487-a370-aa2bae090120 taken with stack trace [, , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 786.740906] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-0cacf152-a4d4-4487-a370-aa2bae090120" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 786.740906] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-0cacf152-a4d4-4487-a370-aa2bae090120" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 786.741097] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-0cacf152-a4d4-4487-a370-aa2bae090120" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 786.741175] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('0cacf152-a4d4-4487-a370-aa2bae090120',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 786.742345] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock rules-b7074d70-d8cb-411f-b8c4-a4007dfd74f8 taken with stack trace [, , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 786.742516] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-b7074d70-d8cb-411f-b8c4-a4007dfd74f8" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 786.742633] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-b7074d70-d8cb-411f-b8c4-a4007dfd74f8" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 786.742700] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-b7074d70-d8cb-411f-b8c4-a4007dfd74f8" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 786.742774] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('b7074d70-d8cb-411f-b8c4-a4007dfd74f8',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 786.744043] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock rules-20ca8821-63b1-4a18-a45d-43ad145b3707 taken with stack trace [, , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 786.744354] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-20ca8821-63b1-4a18-a45d-43ad145b3707" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 786.744354] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-20ca8821-63b1-4a18-a45d-43ad145b3707" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 786.744354] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-20ca8821-63b1-4a18-a45d-43ad145b3707" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 786.744469] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('20ca8821-63b1-4a18-a45d-43ad145b3707',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 786.745450] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock rules-5132c293-b680-4491-ba2b-122515a71eaf taken with stack trace [, , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 786.745651] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-5132c293-b680-4491-ba2b-122515a71eaf" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 786.745651] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-5132c293-b680-4491-ba2b-122515a71eaf" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 786.745778] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-5132c293-b680-4491-ba2b-122515a71eaf" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 786.745853] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('5132c293-b680-4491-ba2b-122515a71eaf',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 786.746941] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock rules-b8e66f81-0f32-48b8-b81f-542b74cbecd4 taken with stack trace [, , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 786.747049] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-b8e66f81-0f32-48b8-b81f-542b74cbecd4" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 786.747096] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-b8e66f81-0f32-48b8-b81f-542b74cbecd4" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 786.747314] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-b8e66f81-0f32-48b8-b81f-542b74cbecd4" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 786.747394] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('b8e66f81-0f32-48b8-b81f-542b74cbecd4',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 786.748299] env[65370]: WARNING oslo_messaging._drivers.amqpdriver [-] Number of call queues is 11, greater than warning threshold: 10. There could be a leak. Increasing threshold to: 20 [ 786.748483] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d1777ef4-6140-42f0-bcd4-a267f85cb990 taken with stack trace [, , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 786.748587] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d1777ef4-6140-42f0-bcd4-a267f85cb990" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 786.748696] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d1777ef4-6140-42f0-bcd4-a267f85cb990" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 786.749382] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d1777ef4-6140-42f0-bcd4-a267f85cb990" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 786.749382] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d1777ef4-6140-42f0-bcd4-a267f85cb990',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 786.750318] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a316198c-c3c7-4c28-a092-301a77045bc5 taken with stack trace [, , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 786.750318] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a316198c-c3c7-4c28-a092-301a77045bc5" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 786.750318] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a316198c-c3c7-4c28-a092-301a77045bc5" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 786.750318] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a316198c-c3c7-4c28-a092-301a77045bc5" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 786.750318] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a316198c-c3c7-4c28-a092-301a77045bc5',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 786.751490] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock rules-420136f3-91df-4669-b5e3-cee436aeacb9 taken with stack trace [, , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 786.751490] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-420136f3-91df-4669-b5e3-cee436aeacb9" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 786.751490] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-420136f3-91df-4669-b5e3-cee436aeacb9" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 786.751490] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-420136f3-91df-4669-b5e3-cee436aeacb9" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 786.754700] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('420136f3-91df-4669-b5e3-cee436aeacb9',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 786.754700] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock rules-6f93689f-ae79-496c-bd6b-5fcec0a3824f taken with stack trace [, , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 786.754700] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-6f93689f-ae79-496c-bd6b-5fcec0a3824f" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 786.754700] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-6f93689f-ae79-496c-bd6b-5fcec0a3824f" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 786.754700] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-6f93689f-ae79-496c-bd6b-5fcec0a3824f" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 786.754700] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('6f93689f-ae79-496c-bd6b-5fcec0a3824f',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 786.754700] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock rules-aa33d5a3-f440-4aa7-9d41-10cb85d18100 taken with stack trace [, , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 786.754700] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-aa33d5a3-f440-4aa7-9d41-10cb85d18100" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 786.754700] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-aa33d5a3-f440-4aa7-9d41-10cb85d18100" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 786.754700] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-aa33d5a3-f440-4aa7-9d41-10cb85d18100" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 786.755159] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('aa33d5a3-f440-4aa7-9d41-10cb85d18100',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 786.755773] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock rules-81833a12-37d8-4ada-8f82-01b16a0f7a0a taken with stack trace [, , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 786.755773] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-81833a12-37d8-4ada-8f82-01b16a0f7a0a" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 786.755773] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-81833a12-37d8-4ada-8f82-01b16a0f7a0a" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 786.755952] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-81833a12-37d8-4ada-8f82-01b16a0f7a0a" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 786.755984] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('81833a12-37d8-4ada-8f82-01b16a0f7a0a',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 786.757065] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock rules-ce41a48f-c3f8-4fae-9206-7c7028887496 taken with stack trace [, , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 786.757065] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-ce41a48f-c3f8-4fae-9206-7c7028887496" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 786.757158] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-ce41a48f-c3f8-4fae-9206-7c7028887496" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 786.757263] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-ce41a48f-c3f8-4fae-9206-7c7028887496" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 786.757334] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('ce41a48f-c3f8-4fae-9206-7c7028887496',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 786.758360] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e01148a4-883d-4ac9-887d-a7302ffdd9d7 taken with stack trace [, , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 786.758463] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e01148a4-883d-4ac9-887d-a7302ffdd9d7" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 786.758498] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e01148a4-883d-4ac9-887d-a7302ffdd9d7" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 786.758659] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e01148a4-883d-4ac9-887d-a7302ffdd9d7" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 786.758740] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e01148a4-883d-4ac9-887d-a7302ffdd9d7',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 786.759652] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock rules-ed2131cc-559f-4cd6-b558-72473509c325 taken with stack trace [, , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 786.759772] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-ed2131cc-559f-4cd6-b558-72473509c325" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 786.759821] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-ed2131cc-559f-4cd6-b558-72473509c325" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 786.759981] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-ed2131cc-559f-4cd6-b558-72473509c325" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 786.760065] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('ed2131cc-559f-4cd6-b558-72473509c325',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 786.761347] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock rules-23979820-ccb5-4fdf-8d1a-316ad4242d32 taken with stack trace [, , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 786.761347] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-23979820-ccb5-4fdf-8d1a-316ad4242d32" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 786.761347] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-23979820-ccb5-4fdf-8d1a-316ad4242d32" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 786.761525] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-23979820-ccb5-4fdf-8d1a-316ad4242d32" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 786.761604] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('23979820-ccb5-4fdf-8d1a-316ad4242d32',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 786.761908] env[65370]: WARNING oslo_messaging._drivers.amqpdriver [-] Number of call queues is 21, greater than warning threshold: 20. There could be a leak. Increasing threshold to: 40 [ 786.762971] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock rules-408a8a38-c326-4f43-84a2-818a13f7e124 taken with stack trace [, , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 786.762971] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-408a8a38-c326-4f43-84a2-818a13f7e124" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 786.762971] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-408a8a38-c326-4f43-84a2-818a13f7e124" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 786.763170] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-408a8a38-c326-4f43-84a2-818a13f7e124" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 786.763208] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('408a8a38-c326-4f43-84a2-818a13f7e124',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 786.764192] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock rules-feaf18c3-295c-41df-89f1-309931cdeca1 taken with stack trace [, , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 786.764413] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-feaf18c3-295c-41df-89f1-309931cdeca1" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 786.770205] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock member-237e1a89-daff-4fd5-b02a-97e1d536d9bd taken with stack trace [, , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 786.770390] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-237e1a89-daff-4fd5-b02a-97e1d536d9bd" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 786.770390] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-237e1a89-daff-4fd5-b02a-97e1d536d9bd" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 786.770638] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-237e1a89-daff-4fd5-b02a-97e1d536d9bd" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 786.770865] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 786.770976] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 786.771068] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 786.771256] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 786.771351] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 786.771494] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-237e1a89-daff-4fd5-b02a-97e1d536d9bd" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 786.771561] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('237e1a89-daff-4fd5-b02a-97e1d536d9bd',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 786.892067] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('78c0a4a2-12c9-4a82-bedc-df813ca8b608',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 786.898762] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('8d9c7efa-60b6-44af-830b-f32145b1b403',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 787.266711] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 787.267047] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 787.267047] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 787.267191] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 787.268371] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 1819f5e5-93ee-4ad9-b38c-e0c54465f0fe with status ACTIVE [ 787.268559] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 787.268668] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 787.268730] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 787.268892] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 787.268972] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 787.269147] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 787.269270] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 787.269305] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 787.269637] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 787.269637] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 787.269762] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 787.269762] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 787.269855] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 787.269928] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 787.269995] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 787.270533] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 1819f5e5-93ee-4ad9-b38c-e0c54465f0fe is going to be updated. [ 787.278976] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock member-237e1a89-daff-4fd5-b02a-97e1d536d9bd taken with stack trace [, , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 787.278976] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-237e1a89-daff-4fd5-b02a-97e1d536d9bd" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 787.278976] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-237e1a89-daff-4fd5-b02a-97e1d536d9bd" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 787.278976] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-237e1a89-daff-4fd5-b02a-97e1d536d9bd" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 787.278976] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 787.278976] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 787.278976] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 787.278976] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 787.279412] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 787.279412] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-237e1a89-daff-4fd5-b02a-97e1d536d9bd" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 787.279412] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock member-237e1a89-daff-4fd5-b02a-97e1d536d9bd taken with stack trace [, , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 787.279412] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-237e1a89-daff-4fd5-b02a-97e1d536d9bd" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 787.279412] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-237e1a89-daff-4fd5-b02a-97e1d536d9bd" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 787.279604] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-237e1a89-daff-4fd5-b02a-97e1d536d9bd" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 787.282237] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 787.282237] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 787.282237] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 787.282237] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 787.282237] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 787.282237] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-237e1a89-daff-4fd5-b02a-97e1d536d9bd" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 787.282237] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('237e1a89-daff-4fd5-b02a-97e1d536d9bd',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 787.298068] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 787.298205] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 787.300013] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 787.300123] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 787.300358] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 787.300451] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 787.300548] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 420136f3-91df-4669-b5e3-cee436aeacb9 is going to be updated. [ 787.305418] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 787.305636] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 787.305719] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 787.305915] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 787.306079] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 787.306241] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-1819f5e5-93ee-4ad9-b38c-e0c54465f0fe" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 787.306561] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock member-e4c5be7e-6c74-44a0-bf7b-9581ec4636c2 taken with stack trace [, , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 787.306666] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e4c5be7e-6c74-44a0-bf7b-9581ec4636c2" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 787.306734] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e4c5be7e-6c74-44a0-bf7b-9581ec4636c2" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 787.306895] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e4c5be7e-6c74-44a0-bf7b-9581ec4636c2" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 787.307052] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 787.307381] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 787.307381] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 787.307381] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 787.307530] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 787.307530] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e4c5be7e-6c74-44a0-bf7b-9581ec4636c2" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 787.307594] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('e4c5be7e-6c74-44a0-bf7b-9581ec4636c2',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 787.308556] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock member-6f93689f-ae79-496c-bd6b-5fcec0a3824f taken with stack trace [, , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 787.308674] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6f93689f-ae79-496c-bd6b-5fcec0a3824f" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 787.308882] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6f93689f-ae79-496c-bd6b-5fcec0a3824f" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 787.309063] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6f93689f-ae79-496c-bd6b-5fcec0a3824f" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 787.309213] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 787.309310] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 787.309444] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 787.309616] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 787.309691] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 787.309775] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6f93689f-ae79-496c-bd6b-5fcec0a3824f" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 787.309857] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('6f93689f-ae79-496c-bd6b-5fcec0a3824f',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 787.311569] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock member-0cacf152-a4d4-4487-a370-aa2bae090120 taken with stack trace [, , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 787.311681] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0cacf152-a4d4-4487-a370-aa2bae090120" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 787.311748] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0cacf152-a4d4-4487-a370-aa2bae090120" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 787.311938] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0cacf152-a4d4-4487-a370-aa2bae090120" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 787.312095] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 787.312189] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 787.312344] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 787.312868] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 787.312868] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 787.312868] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0cacf152-a4d4-4487-a370-aa2bae090120" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 787.312868] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('0cacf152-a4d4-4487-a370-aa2bae090120',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 787.317999] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock member-23979820-ccb5-4fdf-8d1a-316ad4242d32 taken with stack trace [, , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 787.318154] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-23979820-ccb5-4fdf-8d1a-316ad4242d32" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 787.318209] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-23979820-ccb5-4fdf-8d1a-316ad4242d32" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 787.318418] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-23979820-ccb5-4fdf-8d1a-316ad4242d32" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 787.318740] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 787.318859] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 787.318926] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 787.319115] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 787.320292] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 787.320292] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-23979820-ccb5-4fdf-8d1a-316ad4242d32" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 787.320292] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('23979820-ccb5-4fdf-8d1a-316ad4242d32',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 787.321939] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock member-408a8a38-c326-4f43-84a2-818a13f7e124 taken with stack trace [, , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 787.322081] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-408a8a38-c326-4f43-84a2-818a13f7e124" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 787.322229] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-408a8a38-c326-4f43-84a2-818a13f7e124" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 787.322355] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-408a8a38-c326-4f43-84a2-818a13f7e124" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 787.322503] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 787.322642] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 787.322709] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 787.322850] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 787.322929] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 787.323027] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-408a8a38-c326-4f43-84a2-818a13f7e124" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 787.323276] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('408a8a38-c326-4f43-84a2-818a13f7e124',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 787.332252] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock member-ed2131cc-559f-4cd6-b558-72473509c325 taken with stack trace [, , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 787.332252] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ed2131cc-559f-4cd6-b558-72473509c325" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 787.332252] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ed2131cc-559f-4cd6-b558-72473509c325" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 787.332252] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ed2131cc-559f-4cd6-b558-72473509c325" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 787.332252] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 787.332252] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 787.332252] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 787.332252] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 787.332731] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 787.332731] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ed2131cc-559f-4cd6-b558-72473509c325" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 787.332731] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('ed2131cc-559f-4cd6-b558-72473509c325',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 787.337770] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock member-b8e66f81-0f32-48b8-b81f-542b74cbecd4 taken with stack trace [, , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 787.337971] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b8e66f81-0f32-48b8-b81f-542b74cbecd4" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 787.338066] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b8e66f81-0f32-48b8-b81f-542b74cbecd4" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 787.338686] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b8e66f81-0f32-48b8-b81f-542b74cbecd4" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 787.338686] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 787.338686] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 787.338902] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 787.339196] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 787.339279] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 787.339394] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b8e66f81-0f32-48b8-b81f-542b74cbecd4" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 787.339562] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('b8e66f81-0f32-48b8-b81f-542b74cbecd4',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 787.357127] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 787.357239] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 787.357296] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 787.357537] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 787.357704] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 787.380247] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 787.380366] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 787.380985] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 787.380985] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 787.396458] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 787.396458] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 787.396458] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 787.396458] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 787.396458] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 787.396973] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 78c0a4a2-12c9-4a82-bedc-df813ca8b608 is going to be updated. [ 787.401309] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 787.401451] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 787.401522] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 787.402459] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 787.402459] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 787.402459] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8d9c7efa-60b6-44af-830b-f32145b1b403 is going to be updated. [ 787.405269] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 787.405401] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 787.409458] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 787.409458] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 787.410028] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 787.410208] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 787.411686] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 787.411686] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 787.412181] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 787.412289] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 787.413919] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 787.413919] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 787.417720] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 787.417720] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 787.423635] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 787.423635] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 787.423635] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 420136f3-91df-4669-b5e3-cee436aeacb9 in Status: IN_PROGRESS for 2s [ 787.423874] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 787.427024] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 787.430708] env[65370]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 787.431425] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 787.431643] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 20ca8821-63b1-4a18-a45d-43ad145b3707 is going to be deleted. [ 787.433157] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 787.433157] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 787.475478] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 787.476049] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: aa33d5a3-f440-4aa7-9d41-10cb85d18100 is going to be deleted. [ 787.476693] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 787.476917] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 787.477022] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 787.477126] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 420136f3-91df-4669-b5e3-cee436aeacb9 is going to be deleted. [ 787.478447] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 787.481018] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 787.486217] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 787.486376] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 787.486482] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 787.487133] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 787.487133] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 787.501282] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 787.501429] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 787.501500] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 787.501710] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 787.501860] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 787.518265] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 78c0a4a2-12c9-4a82-bedc-df813ca8b608 in Status: IN_PROGRESS for 2s [ 787.521758] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8d9c7efa-60b6-44af-830b-f32145b1b403 in Status: IN_PROGRESS for 2s [ 787.531056] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 787.531056] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a316198c-c3c7-4c28-a092-301a77045bc5 is going to be deleted. [ 787.531056] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 787.531056] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 787.531056] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 787.531056] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: b7074d70-d8cb-411f-b8c4-a4007dfd74f8 is going to be deleted. [ 787.532275] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 787.532531] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 787.593028] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 787.593136] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 5132c293-b680-4491-ba2b-122515a71eaf is going to be deleted. [ 787.594337] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 787.594592] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 787.597203] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 787.597460] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 787.610035] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 787.610035] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 787.639059] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 787.641239] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 787.642978] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 787.642978] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d1777ef4-6140-42f0-bcd4-a267f85cb990 is going to be deleted. [ 787.645920] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 787.647086] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 787.657285] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b7074d70-d8cb-411f-b8c4-a4007dfd74f8 in Status: SUCCESS [ 787.657470] env[65370]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b7074d70-d8cb-411f-b8c4-a4007dfd74f8 deletion is rescheduled due to dependency. [ 787.657829] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b7074d70-d8cb-411f-b8c4-a4007dfd74f8" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 787.700196] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 787.700196] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: ce41a48f-c3f8-4fae-9206-7c7028887496 is going to be deleted. [ 787.700196] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 787.700554] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 787.734316] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 787.734520] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 787.746753] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 787.746888] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 787.776026] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 787.776026] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 787.784422] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 237e1a89-daff-4fd5-b02a-97e1d536d9bd: rpc.has_security_group_logging(os_id): False [ 787.787062] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 787.787280] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 787.818195] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 787.818292] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e01148a4-883d-4ac9-887d-a7302ffdd9d7 is going to be deleted. [ 787.819575] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 787.819831] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 787.827099] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock member-e4c5be7e-6c74-44a0-bf7b-9581ec4636c2 taken with stack trace [, , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 787.827295] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e4c5be7e-6c74-44a0-bf7b-9581ec4636c2" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 787.827362] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e4c5be7e-6c74-44a0-bf7b-9581ec4636c2" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 787.827577] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e4c5be7e-6c74-44a0-bf7b-9581ec4636c2" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 787.827766] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 787.827867] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 787.827929] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 787.828085] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 787.828171] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 787.828266] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e4c5be7e-6c74-44a0-bf7b-9581ec4636c2" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 787.828414] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock member-e4c5be7e-6c74-44a0-bf7b-9581ec4636c2 taken with stack trace [, , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 787.828506] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e4c5be7e-6c74-44a0-bf7b-9581ec4636c2" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 787.828567] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e4c5be7e-6c74-44a0-bf7b-9581ec4636c2" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 787.828705] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e4c5be7e-6c74-44a0-bf7b-9581ec4636c2" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 787.828840] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 787.828928] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 787.828988] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 787.829134] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 787.829224] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 787.829287] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e4c5be7e-6c74-44a0-bf7b-9581ec4636c2" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 787.829375] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('e4c5be7e-6c74-44a0-bf7b-9581ec4636c2',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 787.830932] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('23979820-ccb5-4fdf-8d1a-316ad4242d32',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 787.831832] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('6f93689f-ae79-496c-bd6b-5fcec0a3824f',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 787.832657] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock member-0cacf152-a4d4-4487-a370-aa2bae090120 taken with stack trace [, , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 787.832773] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0cacf152-a4d4-4487-a370-aa2bae090120" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 787.832846] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0cacf152-a4d4-4487-a370-aa2bae090120" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 787.833045] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0cacf152-a4d4-4487-a370-aa2bae090120" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 787.833350] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 787.833350] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 787.833350] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 787.833764] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 787.835212] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 787.835212] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0cacf152-a4d4-4487-a370-aa2bae090120" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 787.835212] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock member-0cacf152-a4d4-4487-a370-aa2bae090120 taken with stack trace [, , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 787.835330] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0cacf152-a4d4-4487-a370-aa2bae090120" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 787.835384] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0cacf152-a4d4-4487-a370-aa2bae090120" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 787.835562] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0cacf152-a4d4-4487-a370-aa2bae090120" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 787.835724] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 787.835932] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 787.836026] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 787.836189] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 787.836275] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 787.836516] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0cacf152-a4d4-4487-a370-aa2bae090120" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 787.836516] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('0cacf152-a4d4-4487-a370-aa2bae090120',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 787.854095] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock member-ed2131cc-559f-4cd6-b558-72473509c325 taken with stack trace [, , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 787.854234] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ed2131cc-559f-4cd6-b558-72473509c325" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 787.854346] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ed2131cc-559f-4cd6-b558-72473509c325" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 787.855135] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ed2131cc-559f-4cd6-b558-72473509c325" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 787.855135] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 787.855135] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 787.855135] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 787.855861] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 787.855861] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 787.855861] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ed2131cc-559f-4cd6-b558-72473509c325" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 787.856174] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock member-ed2131cc-559f-4cd6-b558-72473509c325 taken with stack trace [, , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 787.856287] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ed2131cc-559f-4cd6-b558-72473509c325" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 787.856349] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ed2131cc-559f-4cd6-b558-72473509c325" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 787.856645] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ed2131cc-559f-4cd6-b558-72473509c325" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 787.856815] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 787.856914] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 787.857000] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 787.857128] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 787.857209] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 787.857287] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ed2131cc-559f-4cd6-b558-72473509c325" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 787.857375] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('ed2131cc-559f-4cd6-b558-72473509c325',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 787.858293] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('408a8a38-c326-4f43-84a2-818a13f7e124',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 787.860198] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('b8e66f81-0f32-48b8-b81f-542b74cbecd4',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 788.033569] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 788.033569] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 788.033569] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 788.033569] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 788.033569] env[65370]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 788.033962] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 788.033962] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 81833a12-37d8-4ada-8f82-01b16a0f7a0a is going to be deleted. [ 788.035190] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 788.035569] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 788.035569] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 788.035701] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-20ca8821-63b1-4a18-a45d-43ad145b3707" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 788.035810] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 788.035977] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 788.036079] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 788.036179] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-aa33d5a3-f440-4aa7-9d41-10cb85d18100" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 788.036787] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 788.036962] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 788.037079] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 788.037196] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-420136f3-91df-4669-b5e3-cee436aeacb9" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 788.037639] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 788.037805] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 788.037910] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 788.038041] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-5132c293-b680-4491-ba2b-122515a71eaf" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 788.038179] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 788.038907] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 788.038907] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 788.038907] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-b7074d70-d8cb-411f-b8c4-a4007dfd74f8" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 788.038907] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 788.038907] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 788.038907] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 788.038907] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a316198c-c3c7-4c28-a092-301a77045bc5" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 788.039179] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 788.039179] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 788.039244] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 788.039347] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d1777ef4-6140-42f0-bcd4-a267f85cb990" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 788.039872] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 788.039872] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 788.039872] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 788.039872] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-ce41a48f-c3f8-4fae-9206-7c7028887496" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 788.040051] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 788.040178] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 788.078128] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 788.078298] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 788.094911] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 788.095346] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 788.095579] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 788.095668] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 788.095882] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 788.096073] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 788.096402] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 788.096531] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 788.096601] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 788.096792] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 788.097023] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 788.097262] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 788.097403] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 788.097403] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 788.097625] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 788.097757] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 788.097893] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 237e1a89-daff-4fd5-b02a-97e1d536d9bd is going to be updated. [ 788.099270] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 788.099498] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 788.099648] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 788.099851] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e01148a4-883d-4ac9-887d-a7302ffdd9d7" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 788.229296] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 788.229453] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 788.229491] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 788.229758] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 788.229827] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 788.229893] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-81833a12-37d8-4ada-8f82-01b16a0f7a0a" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 788.259752] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 788.259937] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 788.260021] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 788.260232] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 788.260381] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 788.271081] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: feaf18c3-295c-41df-89f1-309931cdeca1 in Status: SUCCESS [ 788.271380] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-feaf18c3-295c-41df-89f1-309931cdeca1" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 788.271470] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-feaf18c3-295c-41df-89f1-309931cdeca1" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 788.271690] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-feaf18c3-295c-41df-89f1-309931cdeca1" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 788.271879] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 788.271996] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 788.272131] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 788.272324] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 788.272421] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 788.272515] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-feaf18c3-295c-41df-89f1-309931cdeca1" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 788.272618] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('feaf18c3-295c-41df-89f1-309931cdeca1',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 788.283604] env[65370]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 788.284540] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 237e1a89-daff-4fd5-b02a-97e1d536d9bd in Status: IN_PROGRESS for 2s [ 788.332334] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for e4c5be7e-6c74-44a0-bf7b-9581ec4636c2: rpc.has_security_group_logging(os_id): False [ 788.338208] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 6f93689f-ae79-496c-bd6b-5fcec0a3824f: rpc.has_security_group_logging(os_id): False [ 788.339411] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 23979820-ccb5-4fdf-8d1a-316ad4242d32: rpc.has_security_group_logging(os_id): False [ 788.340460] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 0cacf152-a4d4-4487-a370-aa2bae090120: rpc.has_security_group_logging(os_id): False [ 788.360912] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 408a8a38-c326-4f43-84a2-818a13f7e124: rpc.has_security_group_logging(os_id): False [ 788.363112] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for ed2131cc-559f-4cd6-b558-72473509c325: rpc.has_security_group_logging(os_id): False [ 788.366425] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for b8e66f81-0f32-48b8-b81f-542b74cbecd4: rpc.has_security_group_logging(os_id): False [ 788.376961] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 788.377147] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 788.377197] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 788.377551] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 788.379842] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 788.379985] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 788.380904] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 788.381014] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 788.405426] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 788.405713] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 788.406706] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 788.406877] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 788.407305] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 788.407393] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 788.413689] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 788.413887] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 788.428702] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 788.429112] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 788.429333] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 788.429447] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 788.429774] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 788.429912] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 788.430274] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 788.430441] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 788.430637] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 788.430869] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 788.430984] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 788.431288] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 788.431404] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 788.431497] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 788.431735] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 788.431835] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 788.431970] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e4c5be7e-6c74-44a0-bf7b-9581ec4636c2 is going to be updated. [ 788.433554] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 788.433798] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 788.462681] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 788.463116] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 788.463269] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 788.463430] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 788.463657] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 788.463726] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 788.463820] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 23979820-ccb5-4fdf-8d1a-316ad4242d32 is going to be updated. [ 788.465077] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 788.465313] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 788.489192] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 788.489548] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 788.489784] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 788.489784] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 788.489972] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 788.490076] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 788.490179] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: b8e66f81-0f32-48b8-b81f-542b74cbecd4 is going to be updated. [ 788.491490] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 788.491697] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 788.515013] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 788.515452] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 788.515704] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 788.515815] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 788.516072] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 788.516174] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 788.516363] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 6f93689f-ae79-496c-bd6b-5fcec0a3824f is going to be updated. [ 788.517583] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 788.517781] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 788.520344] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 788.520452] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 788.539387] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 788.539736] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 788.539893] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 788.540016] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 788.540216] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 788.540390] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 788.540505] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 788.540609] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 788.540673] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 788.540864] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 788.540958] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 788.541129] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 788.541219] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 788.541269] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 788.541432] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 788.541543] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 788.541584] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 0cacf152-a4d4-4487-a370-aa2bae090120 is going to be updated. [ 788.542661] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 788.542823] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 788.569792] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 788.570084] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 788.570214] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 788.570280] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 788.570588] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 788.570677] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 788.570907] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 788.570988] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 788.571055] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 788.571207] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 788.571280] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 788.571469] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 788.571548] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 788.571608] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 788.571744] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 788.571815] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 788.571906] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: ed2131cc-559f-4cd6-b558-72473509c325 is going to be updated. [ 788.573108] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 788.573281] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 788.573426] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 788.574418] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 788.574577] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 788.578549] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 788.578685] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 788.599395] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 788.599395] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 788.600753] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e4c5be7e-6c74-44a0-bf7b-9581ec4636c2 in Status: IN_PROGRESS for 2s [ 788.605593] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 788.605985] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 788.606131] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 788.606223] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 788.606469] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 788.606602] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 788.606725] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 408a8a38-c326-4f43-84a2-818a13f7e124 is going to be updated. [ 788.608110] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 788.608304] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 788.608449] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 788.609384] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 788.609559] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 788.609703] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 788.636687] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 788.636961] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 788.637058] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 788.637379] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 788.637548] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 788.654263] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b8e66f81-0f32-48b8-b81f-542b74cbecd4 in Status: IN_PROGRESS for 2s [ 788.658767] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 23979820-ccb5-4fdf-8d1a-316ad4242d32 in Status: IN_PROGRESS for 2s [ 788.711271] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 6f93689f-ae79-496c-bd6b-5fcec0a3824f in Status: IN_PROGRESS for 2s [ 788.754543] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 788.754824] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 788.754824] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 788.755096] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 788.755263] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 788.766034] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 788.766034] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 788.766034] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 788.766034] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 788.766034] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 788.775256] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock member-feaf18c3-295c-41df-89f1-309931cdeca1 taken with stack trace [, , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 788.775527] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-feaf18c3-295c-41df-89f1-309931cdeca1" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 788.775667] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-feaf18c3-295c-41df-89f1-309931cdeca1" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 788.775851] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-feaf18c3-295c-41df-89f1-309931cdeca1" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 788.776076] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 788.776220] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 788.776289] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 788.776485] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 788.776589] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 788.776707] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-feaf18c3-295c-41df-89f1-309931cdeca1" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 788.776858] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock member-feaf18c3-295c-41df-89f1-309931cdeca1 taken with stack trace [, , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 788.776954] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-feaf18c3-295c-41df-89f1-309931cdeca1" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 788.777041] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-feaf18c3-295c-41df-89f1-309931cdeca1" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 788.777250] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-feaf18c3-295c-41df-89f1-309931cdeca1" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 788.777345] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 788.777455] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 788.777517] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 788.777752] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 788.777858] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 788.777930] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-feaf18c3-295c-41df-89f1-309931cdeca1" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 788.778022] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('feaf18c3-295c-41df-89f1-309931cdeca1',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 788.849958] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 788.849958] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 788.849958] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 788.850248] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 788.850454] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 788.859801] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ed2131cc-559f-4cd6-b558-72473509c325 in Status: IN_PROGRESS for 2s [ 788.906887] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 0cacf152-a4d4-4487-a370-aa2bae090120 in Status: IN_PROGRESS for 2s [ 788.948474] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 408a8a38-c326-4f43-84a2-818a13f7e124 in Status: IN_PROGRESS for 2s [ 789.280463] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for feaf18c3-295c-41df-89f1-309931cdeca1: rpc.has_security_group_logging(os_id): False [ 789.304220] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 789.304220] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 789.304476] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 789.304632] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 789.335417] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 789.335417] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 789.335417] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 789.335417] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 789.335417] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 789.335417] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 789.335833] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 789.335917] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 789.336013] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 789.336282] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 789.336385] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 789.336789] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 789.336936] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 789.337035] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 789.337212] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 789.337291] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 789.337419] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: feaf18c3-295c-41df-89f1-309931cdeca1 is going to be updated. [ 789.419319] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 789.419545] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 789.419592] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 789.419864] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 789.420089] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 789.434705] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 420136f3-91df-4669-b5e3-cee436aeacb9 in Status: SUCCESS [ 789.434705] env[65370]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 420136f3-91df-4669-b5e3-cee436aeacb9 deletion is rescheduled due to dependency. [ 789.434967] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-420136f3-91df-4669-b5e3-cee436aeacb9" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 789.440607] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: feaf18c3-295c-41df-89f1-309931cdeca1 in Status: IN_PROGRESS for 2s [ 789.530997] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8d9c7efa-60b6-44af-830b-f32145b1b403 in Status: SUCCESS [ 789.532408] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8d9c7efa-60b6-44af-830b-f32145b1b403" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 789.532408] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8d9c7efa-60b6-44af-830b-f32145b1b403" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 789.532408] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8d9c7efa-60b6-44af-830b-f32145b1b403" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 789.532408] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 789.532408] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 789.532408] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 789.532807] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 789.532807] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 789.532807] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8d9c7efa-60b6-44af-830b-f32145b1b403" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 789.532807] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('8d9c7efa-60b6-44af-830b-f32145b1b403',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 789.545707] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 78c0a4a2-12c9-4a82-bedc-df813ca8b608 in Status: SUCCESS [ 789.546055] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-78c0a4a2-12c9-4a82-bedc-df813ca8b608" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 789.546259] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-78c0a4a2-12c9-4a82-bedc-df813ca8b608" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 789.546499] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-78c0a4a2-12c9-4a82-bedc-df813ca8b608" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 789.546699] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 789.546876] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 789.546876] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 789.547057] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 789.547153] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 789.547213] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-78c0a4a2-12c9-4a82-bedc-df813ca8b608" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 789.547270] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('78c0a4a2-12c9-4a82-bedc-df813ca8b608',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 790.034906] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock member-8d9c7efa-60b6-44af-830b-f32145b1b403 taken with stack trace [, , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 790.035089] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8d9c7efa-60b6-44af-830b-f32145b1b403" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 790.035167] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8d9c7efa-60b6-44af-830b-f32145b1b403" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 790.035363] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8d9c7efa-60b6-44af-830b-f32145b1b403" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 790.035566] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 790.035872] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 790.035990] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 790.036214] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 790.036305] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 790.036396] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8d9c7efa-60b6-44af-830b-f32145b1b403" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 790.036557] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock member-8d9c7efa-60b6-44af-830b-f32145b1b403 taken with stack trace [, , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 790.036657] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8d9c7efa-60b6-44af-830b-f32145b1b403" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 790.036719] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8d9c7efa-60b6-44af-830b-f32145b1b403" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 790.036917] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8d9c7efa-60b6-44af-830b-f32145b1b403" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 790.037171] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 790.037226] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 790.037262] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 790.037401] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 790.037474] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 790.037565] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8d9c7efa-60b6-44af-830b-f32145b1b403" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 790.037667] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('8d9c7efa-60b6-44af-830b-f32145b1b403',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 790.050152] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('78c0a4a2-12c9-4a82-bedc-df813ca8b608',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 790.301146] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 237e1a89-daff-4fd5-b02a-97e1d536d9bd in Status: SUCCESS [ 790.301645] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-237e1a89-daff-4fd5-b02a-97e1d536d9bd" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 790.543754] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 8d9c7efa-60b6-44af-830b-f32145b1b403: rpc.has_security_group_logging(os_id): False [ 790.553087] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 78c0a4a2-12c9-4a82-bedc-df813ca8b608: rpc.has_security_group_logging(os_id): False [ 790.578780] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 790.578968] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 790.579028] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 790.579280] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 790.579370] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 790.579622] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 790.580163] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 790.580163] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 790.580163] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 790.580163] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 790.580163] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 78c0a4a2-12c9-4a82-bedc-df813ca8b608 is going to be created. [ 790.585047] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 790.585199] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 790.585284] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 790.585580] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 790.615661] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 790.616107] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 790.616312] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 790.616461] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 790.617420] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 790.617602] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 790.617916] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 790.618114] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 790.618263] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 790.618489] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 790.618626] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 790.618887] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 790.619050] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 790.619146] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 790.619328] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 790.619413] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 790.619530] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 8d9c7efa-60b6-44af-830b-f32145b1b403 is going to be updated. [ 790.621547] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e4c5be7e-6c74-44a0-bf7b-9581ec4636c2 in Status: SUCCESS [ 790.621819] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e4c5be7e-6c74-44a0-bf7b-9581ec4636c2" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 790.654478] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 790.655177] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 790.655177] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 790.655177] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 790.655396] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 790.689933] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 78c0a4a2-12c9-4a82-bedc-df813ca8b608 in Status: IN_PROGRESS for 2s [ 790.698042] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 23979820-ccb5-4fdf-8d1a-316ad4242d32 in Status: SUCCESS [ 790.698042] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-23979820-ccb5-4fdf-8d1a-316ad4242d32" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 790.698042] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b8e66f81-0f32-48b8-b81f-542b74cbecd4 in Status: SUCCESS [ 790.699075] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-b8e66f81-0f32-48b8-b81f-542b74cbecd4" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 790.756148] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 6f93689f-ae79-496c-bd6b-5fcec0a3824f in Status: SUCCESS [ 790.757224] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-6f93689f-ae79-496c-bd6b-5fcec0a3824f" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 790.758414] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 790.758625] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 790.758625] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 790.758837] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 790.759009] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 790.846261] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 8d9c7efa-60b6-44af-830b-f32145b1b403 in Status: IN_PROGRESS for 2s [ 790.899405] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ed2131cc-559f-4cd6-b558-72473509c325 in Status: SUCCESS [ 790.899684] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-ed2131cc-559f-4cd6-b558-72473509c325" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 790.963035] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 0cacf152-a4d4-4487-a370-aa2bae090120 in Status: SUCCESS [ 790.963269] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-0cacf152-a4d4-4487-a370-aa2bae090120" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 790.965190] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 408a8a38-c326-4f43-84a2-818a13f7e124 in Status: SUCCESS [ 790.966391] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-408a8a38-c326-4f43-84a2-818a13f7e124" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 791.461803] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: feaf18c3-295c-41df-89f1-309931cdeca1 in Status: SUCCESS [ 791.461803] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-feaf18c3-295c-41df-89f1-309931cdeca1" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 791.461803] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-feaf18c3-295c-41df-89f1-309931cdeca1" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 791.461803] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-feaf18c3-295c-41df-89f1-309931cdeca1" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 791.461803] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('feaf18c3-295c-41df-89f1-309931cdeca1',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 791.734451] env[65370]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 791.735121] env[65370]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=3 [ 791.824402] env[65370]: INFO networking_nsxv3.common.synchronization [req-54569ec0-20cf-4f89-ae1c-03abc302ba57 req-8a95f35b-ed3e-403e-9f3a-823980ec754e tempest-ServersWithSpecificFlavorTestJSON-1546929489 tempest-ServersWithSpecificFlavorTestJSON-1546929489-project-member] Enqueued Resource ID: b8e66f81-0f32-48b8-b81f-542b74cbecd4 with Priority: HIGHEST for action security_group_members [ 791.824968] env[65370]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b8e66f81-0f32-48b8-b81f-542b74cbecd4 with Priority: HIGHEST for action security_group_members [ 791.825314] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock member-b8e66f81-0f32-48b8-b81f-542b74cbecd4 taken with stack trace [, , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 791.825455] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b8e66f81-0f32-48b8-b81f-542b74cbecd4" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 791.825498] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b8e66f81-0f32-48b8-b81f-542b74cbecd4" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 791.825723] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b8e66f81-0f32-48b8-b81f-542b74cbecd4" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 791.825879] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 791.825979] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 791.826061] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 791.826271] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 791.826317] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 791.826409] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b8e66f81-0f32-48b8-b81f-542b74cbecd4',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 791.964931] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock member-feaf18c3-295c-41df-89f1-309931cdeca1 taken with stack trace [, , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 791.964931] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-feaf18c3-295c-41df-89f1-309931cdeca1" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 791.964931] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-feaf18c3-295c-41df-89f1-309931cdeca1" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 791.964931] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-feaf18c3-295c-41df-89f1-309931cdeca1" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 791.965283] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 791.965382] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 791.965503] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 791.965764] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 791.965912] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 791.966074] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-feaf18c3-295c-41df-89f1-309931cdeca1" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 791.966236] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('feaf18c3-295c-41df-89f1-309931cdeca1',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 792.330574] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 792.331121] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 792.331121] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 792.331121] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 792.331121] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 792.331327] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 792.332023] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 792.332023] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 792.332023] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 792.332023] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 792.332023] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b8e66f81-0f32-48b8-b81f-542b74cbecd4 is going to be updated. [ 792.366354] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 792.366535] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 792.367560] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 792.367560] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 792.367560] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 792.378446] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b8e66f81-0f32-48b8-b81f-542b74cbecd4 in Status: IN_PROGRESS for 2s [ 792.470418] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock member-feaf18c3-295c-41df-89f1-309931cdeca1 taken with stack trace [, , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 792.470418] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-feaf18c3-295c-41df-89f1-309931cdeca1" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 792.470418] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-feaf18c3-295c-41df-89f1-309931cdeca1" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 792.470418] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-feaf18c3-295c-41df-89f1-309931cdeca1" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 792.470860] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 792.470860] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 792.470860] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 792.471081] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 792.471128] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 792.471215] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-feaf18c3-295c-41df-89f1-309931cdeca1" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 792.471403] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock member-feaf18c3-295c-41df-89f1-309931cdeca1 taken with stack trace [, , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 792.471540] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-feaf18c3-295c-41df-89f1-309931cdeca1" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 792.471596] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-feaf18c3-295c-41df-89f1-309931cdeca1" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 792.471777] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-feaf18c3-295c-41df-89f1-309931cdeca1" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 792.471875] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 792.471962] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 792.472038] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 792.472214] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 792.472312] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 792.472402] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-feaf18c3-295c-41df-89f1-309931cdeca1" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 792.472488] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('feaf18c3-295c-41df-89f1-309931cdeca1',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 792.711663] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 78c0a4a2-12c9-4a82-bedc-df813ca8b608 in Status: SUCCESS [ 792.711947] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-78c0a4a2-12c9-4a82-bedc-df813ca8b608" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 792.869834] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 8d9c7efa-60b6-44af-830b-f32145b1b403 in Status: SUCCESS [ 792.869834] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-8d9c7efa-60b6-44af-830b-f32145b1b403" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 792.979079] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for feaf18c3-295c-41df-89f1-309931cdeca1: rpc.has_security_group_logging(os_id): False [ 793.006914] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 793.006914] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 793.006914] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 793.007153] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 793.007153] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 793.007389] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 793.007528] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 793.007657] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 793.007794] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 793.007896] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 793.008165] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 793.008266] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 793.008331] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 793.008495] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 793.008577] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 793.008787] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 793.009197] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 793.009197] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 793.009197] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 793.009197] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 793.009458] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: feaf18c3-295c-41df-89f1-309931cdeca1 is going to be updated. [ 793.124127] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 793.124332] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 793.124428] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 793.124692] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 793.124831] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 793.150619] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: feaf18c3-295c-41df-89f1-309931cdeca1 in Status: IN_PROGRESS for 2s [ 793.328411] env[65370]: INFO networking_nsxv3.common.synchronization [req-abf7fb1f-2e16-4712-8757-4b51f0c8974d req-5b977361-bcfe-4c7a-aa9c-9d3b592069ac tempest-ImagesTestJSON-246049254 tempest-ImagesTestJSON-246049254-project-member] Enqueued Resource ID: 67f4a0c1-3a3c-4ed8-9358-3a9645aba154 with Priority: HIGHEST for action security_group_members [ 793.328411] env[65370]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 67f4a0c1-3a3c-4ed8-9358-3a9645aba154 with Priority: HIGHEST for action security_group_members [ 793.330367] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock member-67f4a0c1-3a3c-4ed8-9358-3a9645aba154 taken with stack trace [, , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 793.330367] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-67f4a0c1-3a3c-4ed8-9358-3a9645aba154" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 793.330367] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-67f4a0c1-3a3c-4ed8-9358-3a9645aba154" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 793.330991] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-67f4a0c1-3a3c-4ed8-9358-3a9645aba154" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 793.330991] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 793.330991] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 793.331154] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 793.331382] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 793.331604] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 793.331665] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('67f4a0c1-3a3c-4ed8-9358-3a9645aba154',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 793.523528] env[65370]: INFO networking_nsxv3.common.synchronization [None req-371dc083-dabe-42b8-b923-0aacb3ac9246 None None] Enqueued Resource ID: 3be2c076-de61-4365-a4ca-dcff61df2925 with Priority: HIGHEST for action port [ 793.524135] env[65370]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3be2c076-de61-4365-a4ca-dcff61df2925 with Priority: HIGHEST for action port [ 793.524469] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock port-3be2c076-de61-4365-a4ca-dcff61df2925 taken with stack trace [, , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 793.524597] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-3be2c076-de61-4365-a4ca-dcff61df2925" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 793.524659] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-3be2c076-de61-4365-a4ca-dcff61df2925" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 793.524913] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-3be2c076-de61-4365-a4ca-dcff61df2925" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 793.524991] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3be2c076-de61-4365-a4ca-dcff61df2925',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 793.801535] env[65370]: DEBUG networking_nsxv3.common.locking [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Lock network-955 taken with stack trace [, , , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 793.801848] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquiring lock "network-955" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 793.801923] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquired lock "network-955" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 793.802200] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquired external semaphore "network-955" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 793.802471] env[65370]: DEBUG networking_nsxv3.common.locking [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 793.802624] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquiring lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 793.803400] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquired lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 793.803400] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquired external semaphore "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 793.803400] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Releasing lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 793.803400] env[65370]: DEBUG dogpile.cache.region [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] No value present for key: 'zone-id' {{(pid=65370) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 793.804047] env[65370]: DEBUG dogpile.lock [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] NeedRegenerationException {{(pid=65370) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 793.804208] env[65370]: DEBUG dogpile.lock [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] no value, waiting for create lock {{(pid=65370) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 793.805273] env[65370]: DEBUG dogpile.lock [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] value creation lock acquired {{(pid=65370) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 793.805273] env[65370]: DEBUG dogpile.cache.region [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] No value present for key: 'zone-id' {{(pid=65370) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 793.805273] env[65370]: DEBUG dogpile.lock [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Calling creation function for not-yet-present value {{(pid=65370) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 793.805273] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 793.835021] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 793.836038] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 793.836038] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 793.836038] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 793.858699] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 793.858699] env[65370]: DEBUG dogpile.cache.region [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Cache value generated in 0.052 seconds for key(s): 'zone-id' {{(pid=65370) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 793.858699] env[65370]: DEBUG dogpile.lock [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Released creation lock {{(pid=65370) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 793.858699] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Releasing lock "network-955" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 793.858699] env[65370]: DEBUG networking_nsxv3.common.locking [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Lock port-ec5becba-5e26-49e5-b1ed-6f91c1c4aff2 taken with stack trace [, , , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 793.858699] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquiring lock "port-ec5becba-5e26-49e5-b1ed-6f91c1c4aff2" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 793.858699] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquired lock "port-ec5becba-5e26-49e5-b1ed-6f91c1c4aff2" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 793.858699] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquired external semaphore "port-ec5becba-5e26-49e5-b1ed-6f91c1c4aff2" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 793.859261] env[65370]: DEBUG networking_nsxv3.api.rpc [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ec5becba-5e26-49e5-b1ed-6f91c1c4aff2',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 793.888866] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 793.888866] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 793.888866] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 793.888866] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 793.888866] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 793.888866] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 793.888866] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 67f4a0c1-3a3c-4ed8-9358-3a9645aba154 is going to be updated. [ 793.929374] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 793.929592] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 793.929592] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 793.930110] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 793.930110] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 793.943960] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 67f4a0c1-3a3c-4ed8-9358-3a9645aba154 in Status: IN_PROGRESS for 2s [ 794.031097] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 3be2c076-de61-4365-a4ca-dcff61df2925 [ 794.031097] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 794.031097] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 794.031097] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 794.031097] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 794.031438] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 794.031637] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:3be2c076-de61-4365-a4ca-dcff61df2925 already deleted. [ 794.031857] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-3be2c076-de61-4365-a4ca-dcff61df2925" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 794.363342] env[65370]: DEBUG networking_nsxv3.common.locking [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 794.364059] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquiring lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 794.364059] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquired lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 794.364199] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquired external semaphore "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 794.364422] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Releasing lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 794.364669] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Segment Port ec5becba-5e26-49e5-b1ed-6f91c1c4aff2 not found, creating... [ 794.365140] env[65370]: DEBUG networking_nsxv3.common.locking [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 794.366214] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquiring lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 794.366214] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquired lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 794.366214] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquired external semaphore "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 794.366214] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Releasing lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 794.366214] env[65370]: DEBUG networking_nsxv3.common.locking [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 794.366534] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquiring lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 794.366534] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquired lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 794.366710] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquired external semaphore "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 794.366865] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Releasing lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 794.367013] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Resource: SegmentPort with ID: ec5becba-5e26-49e5-b1ed-6f91c1c4aff2 is going to be created. [ 794.389462] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b8e66f81-0f32-48b8-b81f-542b74cbecd4 in Status: SUCCESS [ 794.389462] env[65370]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b8e66f81-0f32-48b8-b81f-542b74cbecd4 deletion is rescheduled due to dependency. [ 794.389462] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b8e66f81-0f32-48b8-b81f-542b74cbecd4" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 794.393105] env[65370]: DEBUG networking_nsxv3.common.locking [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 794.393324] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquiring lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 794.393552] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquired lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 794.393791] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquired external semaphore "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 794.394026] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Releasing lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 794.394276] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Releasing lock "port-ec5becba-5e26-49e5-b1ed-6f91c1c4aff2" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 794.770482] env[65370]: INFO networking_nsxv3.common.synchronization [None req-0b2ff8c8-6715-447d-89f2-b34720db7f38 tempest-ServerRescueNegativeTestJSON-807527939 tempest-ServerRescueNegativeTestJSON-807527939-project-member] Enqueued Resource ID: 5c5eea1d-0338-4750-8d40-b5e68d251d49 with Priority: HIGHEST for action security_group_rules [ 794.770898] env[65370]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5c5eea1d-0338-4750-8d40-b5e68d251d49 with Priority: HIGHEST for action security_group_rules [ 794.771223] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock rules-5c5eea1d-0338-4750-8d40-b5e68d251d49 taken with stack trace [, , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 794.771351] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-5c5eea1d-0338-4750-8d40-b5e68d251d49" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 794.771433] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-5c5eea1d-0338-4750-8d40-b5e68d251d49" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 794.771674] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-5c5eea1d-0338-4750-8d40-b5e68d251d49" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 794.771783] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('5c5eea1d-0338-4750-8d40-b5e68d251d49',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 795.115038] env[65370]: INFO networking_nsxv3.common.synchronization [None req-7dc0485b-a5ae-4706-8f95-3e585b152cf3 tempest-ServerRescueNegativeTestJSON-807527939 tempest-ServerRescueNegativeTestJSON-807527939-project-member] Enqueued Resource ID: 5c5eea1d-0338-4750-8d40-b5e68d251d49 with Priority: HIGHEST for action security_group_rules [ 795.115542] env[65370]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5c5eea1d-0338-4750-8d40-b5e68d251d49 with Priority: HIGHEST for action security_group_rules [ 795.115907] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock rules-5c5eea1d-0338-4750-8d40-b5e68d251d49 taken with stack trace [, , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 795.116106] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-5c5eea1d-0338-4750-8d40-b5e68d251d49" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 795.167238] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: feaf18c3-295c-41df-89f1-309931cdeca1 in Status: SUCCESS [ 795.167466] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-feaf18c3-295c-41df-89f1-309931cdeca1" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 795.267195] env[65370]: INFO networking_nsxv3.common.synchronization [req-abf7fb1f-2e16-4712-8757-4b51f0c8974d req-286c3f0b-0927-4708-ad1f-563a72c3beef service nova] Enqueued Resource ID: 67f4a0c1-3a3c-4ed8-9358-3a9645aba154 with Priority: HIGHEST for action security_group_rules [ 795.267386] env[65370]: INFO networking_nsxv3.common.synchronization [req-abf7fb1f-2e16-4712-8757-4b51f0c8974d req-286c3f0b-0927-4708-ad1f-563a72c3beef service nova] Enqueued Resource ID: 67f4a0c1-3a3c-4ed8-9358-3a9645aba154 with Priority: HIGHEST for action security_group_members [ 795.267525] env[65370]: INFO networking_nsxv3.common.synchronization [req-abf7fb1f-2e16-4712-8757-4b51f0c8974d req-286c3f0b-0927-4708-ad1f-563a72c3beef service nova] Enqueued Resource ID: ec5becba-5e26-49e5-b1ed-6f91c1c4aff2 with Priority: HIGHEST for action port [ 795.268219] env[65370]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 67f4a0c1-3a3c-4ed8-9358-3a9645aba154 with Priority: HIGHEST for action security_group_rules [ 795.268423] env[65370]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 67f4a0c1-3a3c-4ed8-9358-3a9645aba154 with Priority: HIGHEST for action security_group_members [ 795.268746] env[65370]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ec5becba-5e26-49e5-b1ed-6f91c1c4aff2 with Priority: HIGHEST for action port [ 795.269914] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock rules-67f4a0c1-3a3c-4ed8-9358-3a9645aba154 taken with stack trace [, , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 795.270194] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-67f4a0c1-3a3c-4ed8-9358-3a9645aba154" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 795.270381] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-67f4a0c1-3a3c-4ed8-9358-3a9645aba154" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 795.270753] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-67f4a0c1-3a3c-4ed8-9358-3a9645aba154" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 795.270979] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('67f4a0c1-3a3c-4ed8-9358-3a9645aba154',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 795.272353] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock member-67f4a0c1-3a3c-4ed8-9358-3a9645aba154 taken with stack trace [, , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 795.272613] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-67f4a0c1-3a3c-4ed8-9358-3a9645aba154" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 795.273100] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock port-ec5becba-5e26-49e5-b1ed-6f91c1c4aff2 taken with stack trace [, , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 795.273351] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-ec5becba-5e26-49e5-b1ed-6f91c1c4aff2" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 795.274297] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-ec5becba-5e26-49e5-b1ed-6f91c1c4aff2" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 795.274297] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-ec5becba-5e26-49e5-b1ed-6f91c1c4aff2" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 795.274297] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ec5becba-5e26-49e5-b1ed-6f91c1c4aff2',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 795.297944] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 795.298052] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 795.298099] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 795.298291] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 795.298379] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 795.299889] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 5c5eea1d-0338-4750-8d40-b5e68d251d49 already deleted. [ 795.299889] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-5c5eea1d-0338-4750-8d40-b5e68d251d49" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 795.299889] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-5c5eea1d-0338-4750-8d40-b5e68d251d49" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 795.299889] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-5c5eea1d-0338-4750-8d40-b5e68d251d49" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 795.299889] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('5c5eea1d-0338-4750-8d40-b5e68d251d49',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 795.343052] env[65370]: INFO networking_nsxv3.common.synchronization [req-3ffd1668-9f60-41d3-b686-12a5b4b5c690 req-153cbc1d-5e48-499f-bce8-357227074cb5 tempest-SecurityGroupsTestJSON-1618218766 tempest-SecurityGroupsTestJSON-1618218766-project-member] Enqueued Resource ID: 11de4e2c-e962-4fc6-af11-81e30acc66a6 with Priority: HIGHEST for action security_group_members [ 795.343247] env[65370]: INFO networking_nsxv3.common.synchronization [req-3ffd1668-9f60-41d3-b686-12a5b4b5c690 req-153cbc1d-5e48-499f-bce8-357227074cb5 tempest-SecurityGroupsTestJSON-1618218766 tempest-SecurityGroupsTestJSON-1618218766-project-member] Enqueued Resource ID: 78c0a4a2-12c9-4a82-bedc-df813ca8b608 with Priority: HIGHEST for action security_group_members [ 795.343485] env[65370]: INFO networking_nsxv3.common.synchronization [req-3ffd1668-9f60-41d3-b686-12a5b4b5c690 req-153cbc1d-5e48-499f-bce8-357227074cb5 tempest-SecurityGroupsTestJSON-1618218766 tempest-SecurityGroupsTestJSON-1618218766-project-member] Enqueued Resource ID: 8d9c7efa-60b6-44af-830b-f32145b1b403 with Priority: HIGHEST for action security_group_members [ 795.344285] env[65370]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 11de4e2c-e962-4fc6-af11-81e30acc66a6 with Priority: HIGHEST for action security_group_members [ 795.344675] env[65370]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 78c0a4a2-12c9-4a82-bedc-df813ca8b608 with Priority: HIGHEST for action security_group_members [ 795.344786] env[65370]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8d9c7efa-60b6-44af-830b-f32145b1b403 with Priority: HIGHEST for action security_group_members [ 795.345143] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock member-11de4e2c-e962-4fc6-af11-81e30acc66a6 taken with stack trace [, , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 795.345265] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-11de4e2c-e962-4fc6-af11-81e30acc66a6" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 795.345328] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-11de4e2c-e962-4fc6-af11-81e30acc66a6" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 795.345657] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-11de4e2c-e962-4fc6-af11-81e30acc66a6" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 795.345818] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 795.345877] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 795.345963] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 795.346127] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 795.346210] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 795.348175] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('11de4e2c-e962-4fc6-af11-81e30acc66a6',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 795.348655] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock member-78c0a4a2-12c9-4a82-bedc-df813ca8b608 taken with stack trace [, , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 795.348788] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-78c0a4a2-12c9-4a82-bedc-df813ca8b608" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 795.348830] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-78c0a4a2-12c9-4a82-bedc-df813ca8b608" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 795.350704] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-78c0a4a2-12c9-4a82-bedc-df813ca8b608" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 795.350878] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 795.350987] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 795.351071] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 795.351225] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 795.351308] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 795.351430] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('78c0a4a2-12c9-4a82-bedc-df813ca8b608',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 795.353764] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock member-8d9c7efa-60b6-44af-830b-f32145b1b403 taken with stack trace [, , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 795.353764] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8d9c7efa-60b6-44af-830b-f32145b1b403" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 795.353764] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8d9c7efa-60b6-44af-830b-f32145b1b403" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 795.353764] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8d9c7efa-60b6-44af-830b-f32145b1b403" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 795.353764] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 795.353764] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 795.353764] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 795.353764] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 795.353764] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 795.354176] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('8d9c7efa-60b6-44af-830b-f32145b1b403',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 795.397176] env[65370]: INFO networking_nsxv3.common.synchronization [req-3ffd1668-9f60-41d3-b686-12a5b4b5c690 req-153cbc1d-5e48-499f-bce8-357227074cb5 tempest-SecurityGroupsTestJSON-1618218766 tempest-SecurityGroupsTestJSON-1618218766-project-member] Enqueued Resource ID: 11de4e2c-e962-4fc6-af11-81e30acc66a6 with Priority: HIGHEST for action security_group_rules [ 795.397596] env[65370]: INFO networking_nsxv3.common.synchronization [req-3ffd1668-9f60-41d3-b686-12a5b4b5c690 req-153cbc1d-5e48-499f-bce8-357227074cb5 tempest-SecurityGroupsTestJSON-1618218766 tempest-SecurityGroupsTestJSON-1618218766-project-member] Enqueued Resource ID: 11de4e2c-e962-4fc6-af11-81e30acc66a6 with Priority: HIGHEST for action security_group_members [ 795.397596] env[65370]: INFO networking_nsxv3.common.synchronization [req-3ffd1668-9f60-41d3-b686-12a5b4b5c690 req-153cbc1d-5e48-499f-bce8-357227074cb5 tempest-SecurityGroupsTestJSON-1618218766 tempest-SecurityGroupsTestJSON-1618218766-project-member] Enqueued Resource ID: 78c0a4a2-12c9-4a82-bedc-df813ca8b608 with Priority: HIGHEST for action security_group_rules [ 795.397707] env[65370]: INFO networking_nsxv3.common.synchronization [req-3ffd1668-9f60-41d3-b686-12a5b4b5c690 req-153cbc1d-5e48-499f-bce8-357227074cb5 tempest-SecurityGroupsTestJSON-1618218766 tempest-SecurityGroupsTestJSON-1618218766-project-member] Enqueued Resource ID: 78c0a4a2-12c9-4a82-bedc-df813ca8b608 with Priority: HIGHEST for action security_group_members [ 795.397744] env[65370]: INFO networking_nsxv3.common.synchronization [req-3ffd1668-9f60-41d3-b686-12a5b4b5c690 req-153cbc1d-5e48-499f-bce8-357227074cb5 tempest-SecurityGroupsTestJSON-1618218766 tempest-SecurityGroupsTestJSON-1618218766-project-member] Enqueued Resource ID: 8d9c7efa-60b6-44af-830b-f32145b1b403 with Priority: HIGHEST for action security_group_rules [ 795.397863] env[65370]: INFO networking_nsxv3.common.synchronization [req-3ffd1668-9f60-41d3-b686-12a5b4b5c690 req-153cbc1d-5e48-499f-bce8-357227074cb5 tempest-SecurityGroupsTestJSON-1618218766 tempest-SecurityGroupsTestJSON-1618218766-project-member] Enqueued Resource ID: 8d9c7efa-60b6-44af-830b-f32145b1b403 with Priority: HIGHEST for action security_group_members [ 795.397990] env[65370]: INFO networking_nsxv3.common.synchronization [req-3ffd1668-9f60-41d3-b686-12a5b4b5c690 req-153cbc1d-5e48-499f-bce8-357227074cb5 tempest-SecurityGroupsTestJSON-1618218766 tempest-SecurityGroupsTestJSON-1618218766-project-member] Enqueued Resource ID: f50b5939-e040-4b41-bb53-4e3dff89fdb6 with Priority: HIGHEST for action port [ 795.398886] env[65370]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 11de4e2c-e962-4fc6-af11-81e30acc66a6 with Priority: HIGHEST for action security_group_rules [ 795.398886] env[65370]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 78c0a4a2-12c9-4a82-bedc-df813ca8b608 with Priority: HIGHEST for action security_group_rules [ 795.399016] env[65370]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8d9c7efa-60b6-44af-830b-f32145b1b403 with Priority: HIGHEST for action security_group_members [ 795.399131] env[65370]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f50b5939-e040-4b41-bb53-4e3dff89fdb6 with Priority: HIGHEST for action port [ 795.399237] env[65370]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8d9c7efa-60b6-44af-830b-f32145b1b403 with Priority: HIGHEST for action security_group_rules [ 795.399325] env[65370]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 11de4e2c-e962-4fc6-af11-81e30acc66a6 with Priority: HIGHEST for action security_group_members [ 795.399407] env[65370]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 78c0a4a2-12c9-4a82-bedc-df813ca8b608 with Priority: HIGHEST for action security_group_members [ 795.399693] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock rules-11de4e2c-e962-4fc6-af11-81e30acc66a6 taken with stack trace [, , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 795.399819] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-11de4e2c-e962-4fc6-af11-81e30acc66a6" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 795.399885] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-11de4e2c-e962-4fc6-af11-81e30acc66a6" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 795.400190] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-11de4e2c-e962-4fc6-af11-81e30acc66a6" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 795.400228] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('11de4e2c-e962-4fc6-af11-81e30acc66a6',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 795.401459] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock rules-78c0a4a2-12c9-4a82-bedc-df813ca8b608 taken with stack trace [, , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 795.401459] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-78c0a4a2-12c9-4a82-bedc-df813ca8b608" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 795.401459] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-78c0a4a2-12c9-4a82-bedc-df813ca8b608" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 795.401702] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-78c0a4a2-12c9-4a82-bedc-df813ca8b608" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 795.401702] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('78c0a4a2-12c9-4a82-bedc-df813ca8b608',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 795.402358] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock member-8d9c7efa-60b6-44af-830b-f32145b1b403 taken with stack trace [, , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 795.402441] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8d9c7efa-60b6-44af-830b-f32145b1b403" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 795.402657] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock port-f50b5939-e040-4b41-bb53-4e3dff89fdb6 taken with stack trace [, , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 795.403046] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-f50b5939-e040-4b41-bb53-4e3dff89fdb6" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 795.403150] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-f50b5939-e040-4b41-bb53-4e3dff89fdb6" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 795.403295] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-f50b5939-e040-4b41-bb53-4e3dff89fdb6" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 795.403369] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f50b5939-e040-4b41-bb53-4e3dff89fdb6',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 795.404159] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock rules-8d9c7efa-60b6-44af-830b-f32145b1b403 taken with stack trace [, , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 795.404275] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-8d9c7efa-60b6-44af-830b-f32145b1b403" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 795.404339] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-8d9c7efa-60b6-44af-830b-f32145b1b403" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 795.404489] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-8d9c7efa-60b6-44af-830b-f32145b1b403" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 795.404639] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('8d9c7efa-60b6-44af-830b-f32145b1b403',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 795.405633] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock member-11de4e2c-e962-4fc6-af11-81e30acc66a6 taken with stack trace [, , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 795.405701] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-11de4e2c-e962-4fc6-af11-81e30acc66a6" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 795.405885] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock member-78c0a4a2-12c9-4a82-bedc-df813ca8b608 taken with stack trace [, , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 795.405970] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-78c0a4a2-12c9-4a82-bedc-df813ca8b608" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 795.778357] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock member-67f4a0c1-3a3c-4ed8-9358-3a9645aba154 taken with stack trace [, , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 795.778357] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-67f4a0c1-3a3c-4ed8-9358-3a9645aba154" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 795.779297] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port ec5becba-5e26-49e5-b1ed-6f91c1c4aff2 with status ACTIVE [ 795.779331] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 795.779480] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 795.779540] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 795.779779] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 795.779865] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 795.780061] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 795.780161] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 795.780249] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 795.780370] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 795.780442] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 795.780633] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 795.780738] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 795.780738] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 795.780738] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 795.780738] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 795.781169] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: ec5becba-5e26-49e5-b1ed-6f91c1c4aff2 is going to be updated. [ 795.806918] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 795.806918] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 795.806918] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 795.806918] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 795.806918] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 795.806918] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-ec5becba-5e26-49e5-b1ed-6f91c1c4aff2" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 795.828815] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 795.828815] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 795.828815] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 795.828815] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 795.828815] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 795.828815] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 5c5eea1d-0338-4750-8d40-b5e68d251d49 already deleted. [ 795.828815] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-5c5eea1d-0338-4750-8d40-b5e68d251d49" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 795.855399] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('78c0a4a2-12c9-4a82-bedc-df813ca8b608',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 795.856533] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('11de4e2c-e962-4fc6-af11-81e30acc66a6',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 795.858135] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('8d9c7efa-60b6-44af-830b-f32145b1b403',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 795.906851] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock member-11de4e2c-e962-4fc6-af11-81e30acc66a6 taken with stack trace [, , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 795.907804] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-11de4e2c-e962-4fc6-af11-81e30acc66a6" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 795.907804] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock member-8d9c7efa-60b6-44af-830b-f32145b1b403 taken with stack trace [, , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 795.907804] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8d9c7efa-60b6-44af-830b-f32145b1b403" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 795.907804] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock member-78c0a4a2-12c9-4a82-bedc-df813ca8b608 taken with stack trace [, , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 795.907804] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-78c0a4a2-12c9-4a82-bedc-df813ca8b608" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 795.908141] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port f50b5939-e040-4b41-bb53-4e3dff89fdb6 with status ACTIVE [ 795.908141] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 795.908251] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 795.908307] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 795.908539] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 795.908643] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 795.908810] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 795.909060] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 795.909060] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 795.909175] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 795.909222] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 795.909411] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 795.909506] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 795.909567] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 795.909716] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 795.909829] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 795.909867] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: f50b5939-e040-4b41-bb53-4e3dff89fdb6 is going to be updated. [ 795.944236] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 795.944428] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 795.944428] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 795.945010] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 795.945010] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 795.945010] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-f50b5939-e040-4b41-bb53-4e3dff89fdb6" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 795.956210] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 67f4a0c1-3a3c-4ed8-9358-3a9645aba154 in Status: SUCCESS [ 795.956530] env[65370]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 67f4a0c1-3a3c-4ed8-9358-3a9645aba154 deletion is rescheduled due to dependency. [ 795.956530] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-67f4a0c1-3a3c-4ed8-9358-3a9645aba154" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 795.956650] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-67f4a0c1-3a3c-4ed8-9358-3a9645aba154" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 795.956815] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-67f4a0c1-3a3c-4ed8-9358-3a9645aba154" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 795.956999] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 795.957712] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 795.957712] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 795.957712] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 795.957712] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 795.957712] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('67f4a0c1-3a3c-4ed8-9358-3a9645aba154',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 796.140817] env[65370]: INFO networking_nsxv3.common.synchronization [None req-4289ea4a-b86c-4bdf-96bd-701b9a71edc3 tempest-AttachVolumeNegativeTest-719365731 tempest-AttachVolumeNegativeTest-719365731-project-member] Enqueued Resource ID: a64b2117-cdc3-4b72-a9f3-57dfa8198991 with Priority: HIGHEST for action security_group_rules [ 796.140817] env[65370]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a64b2117-cdc3-4b72-a9f3-57dfa8198991 with Priority: HIGHEST for action security_group_rules [ 796.141891] env[65370]: INFO networking_nsxv3.common.synchronization [None req-a2912250-aee2-4542-9f31-742c74fc585e None None] Enqueued Resource ID: 6aba0d04-a3cd-46d9-ab3b-8247878009eb with Priority: HIGHEST for action port [ 796.142291] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a64b2117-cdc3-4b72-a9f3-57dfa8198991 taken with stack trace [, , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 796.142454] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a64b2117-cdc3-4b72-a9f3-57dfa8198991" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 796.142541] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a64b2117-cdc3-4b72-a9f3-57dfa8198991" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 796.142915] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a64b2117-cdc3-4b72-a9f3-57dfa8198991" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 796.143000] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a64b2117-cdc3-4b72-a9f3-57dfa8198991',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 796.144146] env[65370]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6aba0d04-a3cd-46d9-ab3b-8247878009eb with Priority: HIGHEST for action port [ 796.145049] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock port-6aba0d04-a3cd-46d9-ab3b-8247878009eb taken with stack trace [, , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 796.147068] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-6aba0d04-a3cd-46d9-ab3b-8247878009eb" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 796.147171] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-6aba0d04-a3cd-46d9-ab3b-8247878009eb" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 796.147468] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-6aba0d04-a3cd-46d9-ab3b-8247878009eb" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 796.147517] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6aba0d04-a3cd-46d9-ab3b-8247878009eb',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 796.229174] env[65370]: INFO networking_nsxv3.common.synchronization [req-a10cc7e1-7468-48f6-a44c-ee9b7c256eef req-52d22139-5a9b-4dbb-99c1-2c9c62359025 tempest-ServersTestMultiNic-1884782823 tempest-ServersTestMultiNic-1884782823-project-member] Enqueued Resource ID: 7960de7e-23b5-46db-b2ee-c5bd971f27a6 with Priority: HIGHEST for action security_group_members [ 796.230838] env[65370]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7960de7e-23b5-46db-b2ee-c5bd971f27a6 with Priority: HIGHEST for action security_group_members [ 796.231763] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock member-7960de7e-23b5-46db-b2ee-c5bd971f27a6 taken with stack trace [, , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 796.232365] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7960de7e-23b5-46db-b2ee-c5bd971f27a6" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 796.232641] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7960de7e-23b5-46db-b2ee-c5bd971f27a6" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 796.233146] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7960de7e-23b5-46db-b2ee-c5bd971f27a6" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 796.233537] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 796.233890] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 796.234258] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 796.235153] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 796.235363] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 796.235685] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7960de7e-23b5-46db-b2ee-c5bd971f27a6',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 796.358636] env[65370]: INFO networking_nsxv3.common.synchronization [None req-cb90779c-8f31-4b66-ac9c-9952729bae17 tempest-AttachVolumeNegativeTest-719365731 tempest-AttachVolumeNegativeTest-719365731-project-member] Enqueued Resource ID: a64b2117-cdc3-4b72-a9f3-57dfa8198991 with Priority: HIGHEST for action security_group_rules [ 796.359036] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('78c0a4a2-12c9-4a82-bedc-df813ca8b608',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 796.363042] env[65370]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a64b2117-cdc3-4b72-a9f3-57dfa8198991 with Priority: HIGHEST for action security_group_rules [ 796.363747] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('11de4e2c-e962-4fc6-af11-81e30acc66a6',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 796.364816] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('8d9c7efa-60b6-44af-830b-f32145b1b403',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 796.366473] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a64b2117-cdc3-4b72-a9f3-57dfa8198991 taken with stack trace [, , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 796.366473] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a64b2117-cdc3-4b72-a9f3-57dfa8198991" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 796.460301] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('67f4a0c1-3a3c-4ed8-9358-3a9645aba154',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 796.607156] env[65370]: INFO networking_nsxv3.common.synchronization [req-a10cc7e1-7468-48f6-a44c-ee9b7c256eef req-0c83881c-d938-4973-98d0-575879ae5fd4 tempest-ServersTestMultiNic-1884782823 tempest-ServersTestMultiNic-1884782823-project-member] Enqueued Resource ID: 7960de7e-23b5-46db-b2ee-c5bd971f27a6 with Priority: HIGHEST for action security_group_members [ 796.607697] env[65370]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7960de7e-23b5-46db-b2ee-c5bd971f27a6 with Priority: HIGHEST for action security_group_members [ 796.608039] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock member-7960de7e-23b5-46db-b2ee-c5bd971f27a6 taken with stack trace [, , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 796.608188] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7960de7e-23b5-46db-b2ee-c5bd971f27a6" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 796.651073] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 6aba0d04-a3cd-46d9-ab3b-8247878009eb [ 796.652153] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 796.652153] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 796.652153] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 796.652153] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 796.652153] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 796.652153] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:6aba0d04-a3cd-46d9-ab3b-8247878009eb already deleted. [ 796.652153] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-6aba0d04-a3cd-46d9-ab3b-8247878009eb" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 796.666956] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 796.667158] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 796.667206] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 796.667424] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 796.667515] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 796.667614] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a64b2117-cdc3-4b72-a9f3-57dfa8198991 already deleted. [ 796.667699] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a64b2117-cdc3-4b72-a9f3-57dfa8198991" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 796.667868] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a64b2117-cdc3-4b72-a9f3-57dfa8198991" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 796.668054] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a64b2117-cdc3-4b72-a9f3-57dfa8198991" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 796.668141] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a64b2117-cdc3-4b72-a9f3-57dfa8198991',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 796.740008] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 796.740008] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 796.740008] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 796.742285] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 796.742485] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 796.742729] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 796.742855] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 796.743124] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 796.743494] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 796.744106] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 796.744493] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7960de7e-23b5-46db-b2ee-c5bd971f27a6 already deleted. [ 796.744627] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7960de7e-23b5-46db-b2ee-c5bd971f27a6" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 796.745169] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7960de7e-23b5-46db-b2ee-c5bd971f27a6" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 796.745737] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7960de7e-23b5-46db-b2ee-c5bd971f27a6" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 796.745963] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 796.746434] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 796.746701] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 796.746927] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 796.747012] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 796.747149] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7960de7e-23b5-46db-b2ee-c5bd971f27a6',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 796.864522] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 796.864882] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 796.864882] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 796.865092] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 796.865204] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 796.865316] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 78c0a4a2-12c9-4a82-bedc-df813ca8b608 is going to be updated. [ 796.867904] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 796.868019] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 796.868060] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 796.869465] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 796.869465] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 796.873022] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 11de4e2c-e962-4fc6-af11-81e30acc66a6 is going to be created. [ 796.873268] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 796.873459] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 796.873459] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 796.873986] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 796.873986] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 796.873986] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8d9c7efa-60b6-44af-830b-f32145b1b403 is going to be updated. [ 796.913283] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 796.913807] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 796.913807] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 796.913807] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 796.913963] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 796.917687] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 796.917896] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 796.917896] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 796.918278] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 796.918278] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 796.920191] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 796.920411] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 796.920411] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 796.920602] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 796.920743] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 796.935360] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8d9c7efa-60b6-44af-830b-f32145b1b403 in Status: IN_PROGRESS for 2s [ 796.935360] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 78c0a4a2-12c9-4a82-bedc-df813ca8b608 in Status: IN_PROGRESS for 2s [ 796.935360] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 11de4e2c-e962-4fc6-af11-81e30acc66a6 in Status: UNINITIALIZED for 2s [ 796.962828] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('67f4a0c1-3a3c-4ed8-9358-3a9645aba154',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 797.148956] env[65370]: INFO networking_nsxv3.common.synchronization [req-a10cc7e1-7468-48f6-a44c-ee9b7c256eef req-0bd2633e-0737-4259-90fc-84c5f38957f9 tempest-ServersTestMultiNic-1884782823 tempest-ServersTestMultiNic-1884782823-project-member] Enqueued Resource ID: 7960de7e-23b5-46db-b2ee-c5bd971f27a6 with Priority: HIGHEST for action security_group_members [ 797.149648] env[65370]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7960de7e-23b5-46db-b2ee-c5bd971f27a6 with Priority: HIGHEST for action security_group_members [ 797.149979] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock member-7960de7e-23b5-46db-b2ee-c5bd971f27a6 taken with stack trace [, , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 797.150290] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7960de7e-23b5-46db-b2ee-c5bd971f27a6" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 797.192530] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 797.192913] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 797.192913] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 797.193048] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 797.193086] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 797.193251] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a64b2117-cdc3-4b72-a9f3-57dfa8198991 already deleted. [ 797.193310] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a64b2117-cdc3-4b72-a9f3-57dfa8198991" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 797.195438] env[65370]: INFO networking_nsxv3.common.synchronization [req-eef7b081-b4e2-4e9f-aa1c-e18d7a636cc0 req-90528638-fd85-4f1e-b5aa-b99e925dc6a7 tempest-ListImageFiltersTestJSON-1988219331 tempest-ListImageFiltersTestJSON-1988219331-project-member] Enqueued Resource ID: e4c5be7e-6c74-44a0-bf7b-9581ec4636c2 with Priority: HIGHEST for action security_group_members [ 797.196081] env[65370]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e4c5be7e-6c74-44a0-bf7b-9581ec4636c2 with Priority: HIGHEST for action security_group_members [ 797.196399] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock member-e4c5be7e-6c74-44a0-bf7b-9581ec4636c2 taken with stack trace [, , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 797.196523] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e4c5be7e-6c74-44a0-bf7b-9581ec4636c2" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 797.196599] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e4c5be7e-6c74-44a0-bf7b-9581ec4636c2" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 797.196875] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e4c5be7e-6c74-44a0-bf7b-9581ec4636c2" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 797.196978] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 797.197101] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 797.197196] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 797.197373] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 797.197476] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 797.197572] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e4c5be7e-6c74-44a0-bf7b-9581ec4636c2',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 797.250029] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 797.250230] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 797.250302] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 797.250561] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 797.250619] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 797.251063] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 797.251232] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 797.251298] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 797.251480] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 797.251552] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 797.251709] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7960de7e-23b5-46db-b2ee-c5bd971f27a6 already deleted. [ 797.251757] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7960de7e-23b5-46db-b2ee-c5bd971f27a6" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 797.251887] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7960de7e-23b5-46db-b2ee-c5bd971f27a6" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 797.252179] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7960de7e-23b5-46db-b2ee-c5bd971f27a6" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 797.252348] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 797.252468] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 797.252544] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 797.252708] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 797.252784] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 797.252926] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7960de7e-23b5-46db-b2ee-c5bd971f27a6',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 797.466162] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 797.466306] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 797.466346] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 797.466577] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 797.466678] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 797.466784] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 67f4a0c1-3a3c-4ed8-9358-3a9645aba154 is going to be updated. [ 797.499947] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 797.500120] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 797.500192] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 797.500411] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 797.500561] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 797.510401] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 67f4a0c1-3a3c-4ed8-9358-3a9645aba154 in Status: IN_PROGRESS for 2s [ 797.548595] env[65370]: DEBUG networking_nsxv3.common.locking [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Lock network-997 taken with stack trace [, , , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 797.548769] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquiring lock "network-997" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 797.548971] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquired lock "network-997" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 797.550034] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquired external semaphore "network-997" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 797.550034] env[65370]: DEBUG networking_nsxv3.common.locking [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 797.550034] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquiring lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 797.550259] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquired lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 797.551013] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquired external semaphore "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 797.551215] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Releasing lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 797.551572] env[65370]: DEBUG dogpile.cache.region [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] No value present for key: 'zone-id' {{(pid=65370) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 797.551706] env[65370]: DEBUG dogpile.lock [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] NeedRegenerationException {{(pid=65370) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 797.551820] env[65370]: DEBUG dogpile.lock [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] no value, waiting for create lock {{(pid=65370) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 797.551942] env[65370]: DEBUG dogpile.lock [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] value creation lock acquired {{(pid=65370) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 797.552127] env[65370]: DEBUG dogpile.cache.region [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] No value present for key: 'zone-id' {{(pid=65370) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 797.552246] env[65370]: DEBUG dogpile.lock [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Calling creation function for not-yet-present value {{(pid=65370) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 797.552389] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 797.574420] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 797.574420] env[65370]: DEBUG dogpile.cache.region [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=65370) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 797.574615] env[65370]: DEBUG dogpile.lock [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Released creation lock {{(pid=65370) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 797.575205] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Releasing lock "network-997" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 797.575205] env[65370]: DEBUG networking_nsxv3.common.locking [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Lock port-4847702e-b047-4701-8d8a-709993cdd1ee taken with stack trace [, , , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 797.575420] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquiring lock "port-4847702e-b047-4701-8d8a-709993cdd1ee" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 797.575420] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquired lock "port-4847702e-b047-4701-8d8a-709993cdd1ee" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 797.576053] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquired external semaphore "port-4847702e-b047-4701-8d8a-709993cdd1ee" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 797.576053] env[65370]: DEBUG networking_nsxv3.api.rpc [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4847702e-b047-4701-8d8a-709993cdd1ee',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 797.699912] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('e4c5be7e-6c74-44a0-bf7b-9581ec4636c2',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 797.755285] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 797.755523] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 797.755827] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 797.756018] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 797.758889] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 797.758889] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 797.758889] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 797.758889] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 797.758889] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 797.758889] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 797.758889] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7960de7e-23b5-46db-b2ee-c5bd971f27a6 already deleted. [ 797.758889] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7960de7e-23b5-46db-b2ee-c5bd971f27a6" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 798.078913] env[65370]: DEBUG networking_nsxv3.common.locking [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.079190] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquiring lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.079277] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquired lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 798.079563] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquired external semaphore "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 798.079742] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Releasing lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 798.079913] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Segment Port 4847702e-b047-4701-8d8a-709993cdd1ee not found, creating... [ 798.080309] env[65370]: DEBUG networking_nsxv3.common.locking [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.080512] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquiring lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.080652] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquired lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 798.080900] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquired external semaphore "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 798.081076] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Releasing lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 798.081393] env[65370]: DEBUG networking_nsxv3.common.locking [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.081596] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquiring lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.081740] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquired lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 798.081991] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquired external semaphore "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 798.082190] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Releasing lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 798.082356] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Resource: SegmentPort with ID: 4847702e-b047-4701-8d8a-709993cdd1ee is going to be created. [ 798.104930] env[65370]: DEBUG networking_nsxv3.common.locking [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.105173] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquiring lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.105283] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquired lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 798.105627] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquired external semaphore "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 798.105924] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Releasing lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 798.106171] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Releasing lock "port-4847702e-b047-4701-8d8a-709993cdd1ee" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 798.203095] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('e4c5be7e-6c74-44a0-bf7b-9581ec4636c2',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 798.400986] env[65370]: INFO networking_nsxv3.common.synchronization [req-8b4f56fe-f11b-425b-9e45-187ce74cc17b req-ce8d0af1-3f3c-4f0c-932b-eea46925a313 tempest-InstanceActionsNegativeTestJSON-817155203 tempest-InstanceActionsNegativeTestJSON-817155203-project-member] Enqueued Resource ID: ed2131cc-559f-4cd6-b558-72473509c325 with Priority: HIGHEST for action security_group_members [ 798.401793] env[65370]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ed2131cc-559f-4cd6-b558-72473509c325 with Priority: HIGHEST for action security_group_members [ 798.402418] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock member-ed2131cc-559f-4cd6-b558-72473509c325 taken with stack trace [, , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.402418] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ed2131cc-559f-4cd6-b558-72473509c325" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.402418] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ed2131cc-559f-4cd6-b558-72473509c325" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 798.402418] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ed2131cc-559f-4cd6-b558-72473509c325" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 798.402651] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.402651] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.402735] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 798.402914] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 798.402953] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 798.403777] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ed2131cc-559f-4cd6-b558-72473509c325',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 798.709438] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.709438] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.709438] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 798.709438] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 798.709438] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 798.709438] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e4c5be7e-6c74-44a0-bf7b-9581ec4636c2 is going to be updated. [ 798.772086] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.772287] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.772287] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 798.772516] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 798.772825] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 798.785429] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e4c5be7e-6c74-44a0-bf7b-9581ec4636c2 in Status: IN_PROGRESS for 2s [ 798.864978] env[65370]: INFO networking_nsxv3.common.synchronization [req-a10cc7e1-7468-48f6-a44c-ee9b7c256eef req-8bcd57f0-fe63-4e31-81d0-ada75fccc934 service nova] Enqueued Resource ID: 7960de7e-23b5-46db-b2ee-c5bd971f27a6 with Priority: HIGHEST for action security_group_rules [ 798.865220] env[65370]: INFO networking_nsxv3.common.synchronization [req-a10cc7e1-7468-48f6-a44c-ee9b7c256eef req-8bcd57f0-fe63-4e31-81d0-ada75fccc934 service nova] Enqueued Resource ID: 7960de7e-23b5-46db-b2ee-c5bd971f27a6 with Priority: HIGHEST for action security_group_members [ 798.865378] env[65370]: INFO networking_nsxv3.common.synchronization [req-a10cc7e1-7468-48f6-a44c-ee9b7c256eef req-8bcd57f0-fe63-4e31-81d0-ada75fccc934 service nova] Enqueued Resource ID: 4847702e-b047-4701-8d8a-709993cdd1ee with Priority: HIGHEST for action port [ 798.868207] env[65370]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7960de7e-23b5-46db-b2ee-c5bd971f27a6 with Priority: HIGHEST for action security_group_rules [ 798.868364] env[65370]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7960de7e-23b5-46db-b2ee-c5bd971f27a6 with Priority: HIGHEST for action security_group_members [ 798.868464] env[65370]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4847702e-b047-4701-8d8a-709993cdd1ee with Priority: HIGHEST for action port [ 798.868814] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock rules-7960de7e-23b5-46db-b2ee-c5bd971f27a6 taken with stack trace [, , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.870481] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-7960de7e-23b5-46db-b2ee-c5bd971f27a6" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.870592] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-7960de7e-23b5-46db-b2ee-c5bd971f27a6" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 798.870821] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-7960de7e-23b5-46db-b2ee-c5bd971f27a6" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 798.870908] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('7960de7e-23b5-46db-b2ee-c5bd971f27a6',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 798.872451] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock member-7960de7e-23b5-46db-b2ee-c5bd971f27a6 taken with stack trace [, , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.872534] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7960de7e-23b5-46db-b2ee-c5bd971f27a6" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.872608] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7960de7e-23b5-46db-b2ee-c5bd971f27a6" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 798.872806] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7960de7e-23b5-46db-b2ee-c5bd971f27a6" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 798.872982] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.873099] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.873161] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 798.873315] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 798.873499] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 798.873637] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7960de7e-23b5-46db-b2ee-c5bd971f27a6',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 798.874585] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock port-4847702e-b047-4701-8d8a-709993cdd1ee taken with stack trace [, , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.875050] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-4847702e-b047-4701-8d8a-709993cdd1ee" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.875149] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-4847702e-b047-4701-8d8a-709993cdd1ee" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 798.876117] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-4847702e-b047-4701-8d8a-709993cdd1ee" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 798.876117] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4847702e-b047-4701-8d8a-709993cdd1ee',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 798.906623] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.907300] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.908162] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 798.908162] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 798.908317] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 798.908614] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.908748] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.908791] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 798.908980] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 798.909129] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 798.909323] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ed2131cc-559f-4cd6-b558-72473509c325 is going to be updated. [ 798.951946] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8d9c7efa-60b6-44af-830b-f32145b1b403 in Status: SUCCESS [ 798.952341] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8d9c7efa-60b6-44af-830b-f32145b1b403" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 798.953014] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8d9c7efa-60b6-44af-830b-f32145b1b403" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 798.953279] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8d9c7efa-60b6-44af-830b-f32145b1b403" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 798.953483] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.953761] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.953867] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 798.954081] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 798.954184] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 798.954301] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('8d9c7efa-60b6-44af-830b-f32145b1b403',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 798.957452] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 78c0a4a2-12c9-4a82-bedc-df813ca8b608 in Status: SUCCESS [ 798.957670] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-78c0a4a2-12c9-4a82-bedc-df813ca8b608" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 798.958545] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 11de4e2c-e962-4fc6-af11-81e30acc66a6 in Status: SUCCESS [ 798.958735] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-11de4e2c-e962-4fc6-af11-81e30acc66a6" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 798.958909] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-78c0a4a2-12c9-4a82-bedc-df813ca8b608" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 798.959129] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-78c0a4a2-12c9-4a82-bedc-df813ca8b608" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 798.959337] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.959455] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.959515] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 798.959746] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 798.959936] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 798.960081] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('78c0a4a2-12c9-4a82-bedc-df813ca8b608',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 798.961330] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-11de4e2c-e962-4fc6-af11-81e30acc66a6" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 798.961541] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-11de4e2c-e962-4fc6-af11-81e30acc66a6" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 798.961742] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.961876] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.961976] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 798.962127] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 798.962209] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 798.962327] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('11de4e2c-e962-4fc6-af11-81e30acc66a6',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 798.967326] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.967488] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.967564] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 798.967713] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 798.967892] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 798.978986] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ed2131cc-559f-4cd6-b558-72473509c325 in Status: IN_PROGRESS for 2s [ 799.377415] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock member-7960de7e-23b5-46db-b2ee-c5bd971f27a6 taken with stack trace [, , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 799.381023] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7960de7e-23b5-46db-b2ee-c5bd971f27a6" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 799.381023] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('7960de7e-23b5-46db-b2ee-c5bd971f27a6',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 799.381023] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 4847702e-b047-4701-8d8a-709993cdd1ee with status ACTIVE [ 799.381023] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 799.381023] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 799.381023] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 799.381023] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 799.381023] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 799.381023] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 799.381023] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 799.381023] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 799.382339] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 799.382562] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 799.382890] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 799.383152] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 799.383307] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 799.383678] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 799.383856] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 799.384059] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 4847702e-b047-4701-8d8a-709993cdd1ee is going to be updated. [ 799.410573] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 799.410573] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 799.410573] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 799.410573] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 799.410573] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 799.410573] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-4847702e-b047-4701-8d8a-709993cdd1ee" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 799.457136] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('8d9c7efa-60b6-44af-830b-f32145b1b403',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 799.465951] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('11de4e2c-e962-4fc6-af11-81e30acc66a6',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 799.471013] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('78c0a4a2-12c9-4a82-bedc-df813ca8b608',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 799.533974] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 67f4a0c1-3a3c-4ed8-9358-3a9645aba154 in Status: SUCCESS [ 799.534212] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-67f4a0c1-3a3c-4ed8-9358-3a9645aba154" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 799.534402] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-67f4a0c1-3a3c-4ed8-9358-3a9645aba154" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 799.534632] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-67f4a0c1-3a3c-4ed8-9358-3a9645aba154" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 799.534837] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 799.535113] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 799.535113] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 799.535281] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 799.535361] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 799.535410] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-67f4a0c1-3a3c-4ed8-9358-3a9645aba154" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 799.536046] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('67f4a0c1-3a3c-4ed8-9358-3a9645aba154',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 799.728959] env[65370]: DEBUG networking_nsxv3.common.locking [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Lock network-494 taken with stack trace [, , , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 799.728959] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquiring lock "network-494" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 799.729239] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquired lock "network-494" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 799.730362] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquired external semaphore "network-494" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 799.730362] env[65370]: DEBUG networking_nsxv3.common.locking [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 799.730362] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquiring lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 799.730362] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquired lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 799.730362] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquired external semaphore "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 799.730362] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Releasing lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 799.730788] env[65370]: DEBUG dogpile.cache.region [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] No value present for key: 'zone-id' {{(pid=65370) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 799.730788] env[65370]: DEBUG dogpile.lock [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] NeedRegenerationException {{(pid=65370) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 799.730788] env[65370]: DEBUG dogpile.lock [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] no value, waiting for create lock {{(pid=65370) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 799.730788] env[65370]: DEBUG dogpile.lock [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] value creation lock acquired {{(pid=65370) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 799.730913] env[65370]: DEBUG dogpile.cache.region [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] No value present for key: 'zone-id' {{(pid=65370) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 799.731983] env[65370]: DEBUG dogpile.lock [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Calling creation function for not-yet-present value {{(pid=65370) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 799.731983] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 799.815639] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 799.816188] env[65370]: DEBUG dogpile.cache.region [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Cache value generated in 0.085 seconds for key(s): 'zone-id' {{(pid=65370) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 799.816188] env[65370]: DEBUG dogpile.lock [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Released creation lock {{(pid=65370) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 799.816346] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Releasing lock "network-494" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 799.817562] env[65370]: DEBUG networking_nsxv3.common.locking [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Lock port-1817f21a-2ed5-4aea-81e4-cbd2dd2daa12 taken with stack trace [, , , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 799.817562] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquiring lock "port-1817f21a-2ed5-4aea-81e4-cbd2dd2daa12" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 799.817562] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquired lock "port-1817f21a-2ed5-4aea-81e4-cbd2dd2daa12" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 799.817562] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquired external semaphore "port-1817f21a-2ed5-4aea-81e4-cbd2dd2daa12" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 799.818124] env[65370]: DEBUG networking_nsxv3.api.rpc [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1817f21a-2ed5-4aea-81e4-cbd2dd2daa12',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 799.887397] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('7960de7e-23b5-46db-b2ee-c5bd971f27a6',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 799.959314] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('8d9c7efa-60b6-44af-830b-f32145b1b403',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 799.969226] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('11de4e2c-e962-4fc6-af11-81e30acc66a6',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 799.975681] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('78c0a4a2-12c9-4a82-bedc-df813ca8b608',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 800.038569] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock member-67f4a0c1-3a3c-4ed8-9358-3a9645aba154 taken with stack trace [, , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 800.038773] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-67f4a0c1-3a3c-4ed8-9358-3a9645aba154" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 800.038877] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-67f4a0c1-3a3c-4ed8-9358-3a9645aba154" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 800.039175] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-67f4a0c1-3a3c-4ed8-9358-3a9645aba154" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 800.039385] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 800.039516] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 800.039599] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 800.039801] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 800.039902] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 800.040082] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-67f4a0c1-3a3c-4ed8-9358-3a9645aba154" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 800.040237] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock member-67f4a0c1-3a3c-4ed8-9358-3a9645aba154 taken with stack trace [, , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 800.040359] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-67f4a0c1-3a3c-4ed8-9358-3a9645aba154" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 800.040438] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-67f4a0c1-3a3c-4ed8-9358-3a9645aba154" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 800.040606] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-67f4a0c1-3a3c-4ed8-9358-3a9645aba154" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 800.040810] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 800.041055] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 800.041055] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 800.045022] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 800.045022] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 800.045022] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-67f4a0c1-3a3c-4ed8-9358-3a9645aba154" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 800.045022] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('67f4a0c1-3a3c-4ed8-9358-3a9645aba154',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 800.321178] env[65370]: DEBUG networking_nsxv3.common.locking [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 800.321178] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquiring lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 800.321734] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquired lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 800.321734] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquired external semaphore "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 800.322020] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Releasing lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 800.322152] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Segment Port 1817f21a-2ed5-4aea-81e4-cbd2dd2daa12 not found, creating... [ 800.322674] env[65370]: DEBUG networking_nsxv3.common.locking [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 800.322784] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquiring lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 800.323573] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquired lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 800.324010] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquired external semaphore "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 800.324419] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Releasing lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 800.326960] env[65370]: DEBUG networking_nsxv3.common.locking [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 800.327264] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquiring lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 800.327459] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquired lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 800.327804] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquired external semaphore "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 800.328069] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Releasing lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 800.328300] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Resource: SegmentPort with ID: 1817f21a-2ed5-4aea-81e4-cbd2dd2daa12 is going to be created. [ 800.374783] env[65370]: DEBUG networking_nsxv3.common.locking [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 800.375012] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquiring lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 800.375103] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquired lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 800.375376] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquired external semaphore "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 800.375617] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Releasing lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 800.375856] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Releasing lock "port-1817f21a-2ed5-4aea-81e4-cbd2dd2daa12" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 800.390469] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 800.390469] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 800.390469] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 800.391035] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 800.391035] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 800.391035] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7960de7e-23b5-46db-b2ee-c5bd971f27a6 is going to be created. [ 800.462879] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 800.463377] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 800.463377] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 800.465272] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 800.465272] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 800.465272] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8d9c7efa-60b6-44af-830b-f32145b1b403 is going to be updated. [ 800.475868] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 800.475868] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 800.475868] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 800.475868] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 800.475868] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 800.475868] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 11de4e2c-e962-4fc6-af11-81e30acc66a6 is going to be updated. [ 800.479369] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 800.479369] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 800.479369] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 800.479369] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 800.479369] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 800.479369] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 78c0a4a2-12c9-4a82-bedc-df813ca8b608 is going to be updated. [ 800.533321] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 800.533321] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 800.533321] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 800.533321] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 800.533321] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 800.545911] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 67f4a0c1-3a3c-4ed8-9358-3a9645aba154: rpc.has_security_group_logging(os_id): False [ 800.587495] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7960de7e-23b5-46db-b2ee-c5bd971f27a6 in Status: UNINITIALIZED for 2s [ 800.601026] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 800.601182] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 800.601283] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 800.601507] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 800.601543] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 800.601777] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 800.601870] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 800.601935] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 800.602104] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 800.602246] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 800.602539] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 800.602673] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 800.602745] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 800.602996] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 800.603144] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 800.603403] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 800.603665] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 800.603770] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 800.603951] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 800.604063] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 800.604177] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 67f4a0c1-3a3c-4ed8-9358-3a9645aba154 is going to be updated. [ 800.606841] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 800.607062] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 800.607217] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 800.607505] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 800.607868] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 800.648606] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8d9c7efa-60b6-44af-830b-f32145b1b403 in Status: IN_PROGRESS for 2s [ 800.649723] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 800.649958] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 800.650063] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 800.650284] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 800.650441] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 800.658147] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 800.658980] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 800.658980] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 800.658980] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 800.658980] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 800.663065] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 78c0a4a2-12c9-4a82-bedc-df813ca8b608 in Status: IN_PROGRESS for 2s [ 800.673022] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 11de4e2c-e962-4fc6-af11-81e30acc66a6 in Status: IN_PROGRESS for 2s [ 800.884244] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e4c5be7e-6c74-44a0-bf7b-9581ec4636c2 in Status: SUCCESS [ 800.885192] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e4c5be7e-6c74-44a0-bf7b-9581ec4636c2" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 800.885506] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 800.885693] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 800.885769] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 800.885978] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 800.887229] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 800.937036] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 67f4a0c1-3a3c-4ed8-9358-3a9645aba154 in Status: IN_PROGRESS for 2s [ 800.996133] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ed2131cc-559f-4cd6-b558-72473509c325 in Status: SUCCESS [ 800.996377] env[65370]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ed2131cc-559f-4cd6-b558-72473509c325 deletion is rescheduled due to dependency. [ 800.996535] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ed2131cc-559f-4cd6-b558-72473509c325" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 801.049776] env[65370]: INFO networking_nsxv3.common.synchronization [req-a10cc7e1-7468-48f6-a44c-ee9b7c256eef req-09d4c763-0667-47aa-be6e-1301b075f6df service nova] Enqueued Resource ID: 7960de7e-23b5-46db-b2ee-c5bd971f27a6 with Priority: HIGHEST for action security_group_rules [ 801.050027] env[65370]: INFO networking_nsxv3.common.synchronization [req-a10cc7e1-7468-48f6-a44c-ee9b7c256eef req-09d4c763-0667-47aa-be6e-1301b075f6df service nova] Enqueued Resource ID: 7960de7e-23b5-46db-b2ee-c5bd971f27a6 with Priority: HIGHEST for action security_group_members [ 801.050229] env[65370]: INFO networking_nsxv3.common.synchronization [req-a10cc7e1-7468-48f6-a44c-ee9b7c256eef req-09d4c763-0667-47aa-be6e-1301b075f6df service nova] Enqueued Resource ID: 1817f21a-2ed5-4aea-81e4-cbd2dd2daa12 with Priority: HIGHEST for action port [ 801.052077] env[65370]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7960de7e-23b5-46db-b2ee-c5bd971f27a6 with Priority: HIGHEST for action security_group_rules [ 801.052077] env[65370]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7960de7e-23b5-46db-b2ee-c5bd971f27a6 with Priority: HIGHEST for action security_group_members [ 801.052077] env[65370]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1817f21a-2ed5-4aea-81e4-cbd2dd2daa12 with Priority: HIGHEST for action port [ 801.052077] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock rules-7960de7e-23b5-46db-b2ee-c5bd971f27a6 taken with stack trace [, , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 801.052077] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-7960de7e-23b5-46db-b2ee-c5bd971f27a6" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 801.052077] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock member-7960de7e-23b5-46db-b2ee-c5bd971f27a6 taken with stack trace [, , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 801.052473] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7960de7e-23b5-46db-b2ee-c5bd971f27a6" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 801.052473] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock port-1817f21a-2ed5-4aea-81e4-cbd2dd2daa12 taken with stack trace [, , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 801.052575] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-1817f21a-2ed5-4aea-81e4-cbd2dd2daa12" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 801.052575] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-1817f21a-2ed5-4aea-81e4-cbd2dd2daa12" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 801.052778] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-1817f21a-2ed5-4aea-81e4-cbd2dd2daa12" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 801.052850] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1817f21a-2ed5-4aea-81e4-cbd2dd2daa12',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 801.418797] env[65370]: INFO networking_nsxv3.common.synchronization [req-8339bc78-5169-4e4f-a287-0f9d8cf227fc req-64262035-c4fd-439c-869e-40d155a2f18f tempest-SecurityGroupsTestJSON-1618218766 tempest-SecurityGroupsTestJSON-1618218766-project-member] Enqueued Resource ID: 11de4e2c-e962-4fc6-af11-81e30acc66a6 with Priority: HIGHEST for action security_group_members [ 801.419953] env[65370]: INFO networking_nsxv3.common.synchronization [req-8339bc78-5169-4e4f-a287-0f9d8cf227fc req-64262035-c4fd-439c-869e-40d155a2f18f tempest-SecurityGroupsTestJSON-1618218766 tempest-SecurityGroupsTestJSON-1618218766-project-member] Enqueued Resource ID: 78c0a4a2-12c9-4a82-bedc-df813ca8b608 with Priority: HIGHEST for action security_group_members [ 801.419953] env[65370]: INFO networking_nsxv3.common.synchronization [req-8339bc78-5169-4e4f-a287-0f9d8cf227fc req-64262035-c4fd-439c-869e-40d155a2f18f tempest-SecurityGroupsTestJSON-1618218766 tempest-SecurityGroupsTestJSON-1618218766-project-member] Enqueued Resource ID: 8d9c7efa-60b6-44af-830b-f32145b1b403 with Priority: HIGHEST for action security_group_members [ 801.419953] env[65370]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 11de4e2c-e962-4fc6-af11-81e30acc66a6 with Priority: HIGHEST for action security_group_members [ 801.419953] env[65370]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 78c0a4a2-12c9-4a82-bedc-df813ca8b608 with Priority: HIGHEST for action security_group_members [ 801.419953] env[65370]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8d9c7efa-60b6-44af-830b-f32145b1b403 with Priority: HIGHEST for action security_group_members [ 801.420472] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock member-11de4e2c-e962-4fc6-af11-81e30acc66a6 taken with stack trace [, , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 801.420633] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-11de4e2c-e962-4fc6-af11-81e30acc66a6" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 801.420901] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock member-78c0a4a2-12c9-4a82-bedc-df813ca8b608 taken with stack trace [, , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 801.421071] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-78c0a4a2-12c9-4a82-bedc-df813ca8b608" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 801.421319] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock member-8d9c7efa-60b6-44af-830b-f32145b1b403 taken with stack trace [, , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 801.421450] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8d9c7efa-60b6-44af-830b-f32145b1b403" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 801.559572] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 1817f21a-2ed5-4aea-81e4-cbd2dd2daa12 with status ACTIVE [ 801.563097] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 801.563097] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 801.563097] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 801.563097] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 801.563097] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 801.563097] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 801.563097] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 801.563097] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 801.563097] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 801.563097] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 801.563097] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 801.563097] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 801.563097] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 801.563097] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 801.563097] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 801.563097] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 1817f21a-2ed5-4aea-81e4-cbd2dd2daa12 is going to be updated. [ 801.583708] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 801.584373] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 801.584373] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 801.584373] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 801.584373] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 801.584537] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-1817f21a-2ed5-4aea-81e4-cbd2dd2daa12" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 801.850888] env[65370]: DEBUG networking_nsxv3.common.locking [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Lock network-997 taken with stack trace [, , , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 801.851074] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquiring lock "network-997" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 801.851074] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquired lock "network-997" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 801.851346] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquired external semaphore "network-997" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 801.851603] env[65370]: DEBUG networking_nsxv3.common.locking [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 801.851976] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquiring lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 801.852250] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquired lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 801.852482] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquired external semaphore "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 801.852660] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Releasing lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 801.852923] env[65370]: DEBUG dogpile.cache.region [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] No value present for key: 'zone-id' {{(pid=65370) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 801.853049] env[65370]: DEBUG dogpile.lock [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] NeedRegenerationException {{(pid=65370) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 801.853155] env[65370]: DEBUG dogpile.lock [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] no value, waiting for create lock {{(pid=65370) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 801.853258] env[65370]: DEBUG dogpile.lock [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] value creation lock acquired {{(pid=65370) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 801.853359] env[65370]: DEBUG dogpile.cache.region [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] No value present for key: 'zone-id' {{(pid=65370) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 801.853458] env[65370]: DEBUG dogpile.lock [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Calling creation function for not-yet-present value {{(pid=65370) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 801.853585] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 801.873418] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 801.873955] env[65370]: DEBUG dogpile.cache.region [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=65370) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 801.873955] env[65370]: DEBUG dogpile.lock [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Released creation lock {{(pid=65370) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 801.874172] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Releasing lock "network-997" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 801.875423] env[65370]: DEBUG networking_nsxv3.common.locking [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Lock port-b4b53138-309f-41c3-943a-140ed865e73e taken with stack trace [, , , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 801.875423] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquiring lock "port-b4b53138-309f-41c3-943a-140ed865e73e" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 801.875423] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquired lock "port-b4b53138-309f-41c3-943a-140ed865e73e" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 801.875423] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquired external semaphore "port-b4b53138-309f-41c3-943a-140ed865e73e" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 801.875423] env[65370]: DEBUG networking_nsxv3.api.rpc [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b4b53138-309f-41c3-943a-140ed865e73e',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 801.999566] env[65370]: INFO networking_nsxv3.common.synchronization [req-fe36a64d-3ad5-4cbf-bca5-913bfb1aba2e req-a943bbdb-099b-4996-86fa-b1e04cdf4e95 tempest-ImagesOneServerNegativeTestJSON-1384686973 tempest-ImagesOneServerNegativeTestJSON-1384686973-project-member] Enqueued Resource ID: e2790d7c-6d0c-45bc-84d1-8cb00d26b9b0 with Priority: HIGHEST for action security_group_members [ 802.000206] env[65370]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e2790d7c-6d0c-45bc-84d1-8cb00d26b9b0 with Priority: HIGHEST for action security_group_members [ 802.000579] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock member-e2790d7c-6d0c-45bc-84d1-8cb00d26b9b0 taken with stack trace [, , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 802.001075] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e2790d7c-6d0c-45bc-84d1-8cb00d26b9b0" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 802.001168] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e2790d7c-6d0c-45bc-84d1-8cb00d26b9b0" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 802.001354] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e2790d7c-6d0c-45bc-84d1-8cb00d26b9b0" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 802.001511] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 802.001609] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 802.001657] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 802.001803] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 802.001885] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 802.002275] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e2790d7c-6d0c-45bc-84d1-8cb00d26b9b0',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 802.378079] env[65370]: DEBUG networking_nsxv3.common.locking [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 802.378968] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquiring lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 802.378968] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquired lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 802.379226] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquired external semaphore "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 802.379914] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Releasing lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 802.379914] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Segment Port b4b53138-309f-41c3-943a-140ed865e73e not found, creating... [ 802.380353] env[65370]: DEBUG networking_nsxv3.common.locking [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 802.380640] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquiring lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 802.380849] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquired lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 802.381754] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquired external semaphore "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 802.381754] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Releasing lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 802.382302] env[65370]: DEBUG networking_nsxv3.common.locking [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 802.382302] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquiring lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 802.382427] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquired lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 802.382823] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquired external semaphore "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 802.382994] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Releasing lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 802.383248] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Resource: SegmentPort with ID: b4b53138-309f-41c3-943a-140ed865e73e is going to be created. [ 802.407561] env[65370]: DEBUG networking_nsxv3.common.locking [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 802.407811] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquiring lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 802.407856] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquired lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 802.408134] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquired external semaphore "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 802.408431] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Releasing lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 802.408674] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Releasing lock "port-b4b53138-309f-41c3-943a-140ed865e73e" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 802.504306] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 802.504615] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 802.504615] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 802.504777] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 802.550879] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 802.550879] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 802.550879] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 802.550879] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 802.550879] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 802.550879] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 802.550879] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e2790d7c-6d0c-45bc-84d1-8cb00d26b9b0 is going to be updated. [ 802.601656] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7960de7e-23b5-46db-b2ee-c5bd971f27a6 in Status: SUCCESS [ 802.602435] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7960de7e-23b5-46db-b2ee-c5bd971f27a6" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 802.602435] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7960de7e-23b5-46db-b2ee-c5bd971f27a6" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 802.602435] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7960de7e-23b5-46db-b2ee-c5bd971f27a6" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 802.602627] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 802.602722] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 802.602783] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 802.602929] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 802.603016] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 802.603106] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7960de7e-23b5-46db-b2ee-c5bd971f27a6" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 802.603246] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('7960de7e-23b5-46db-b2ee-c5bd971f27a6',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 802.605125] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7960de7e-23b5-46db-b2ee-c5bd971f27a6" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 802.606973] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7960de7e-23b5-46db-b2ee-c5bd971f27a6" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 802.606973] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 802.606973] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 802.606973] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 802.606973] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 802.606973] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 802.606973] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7960de7e-23b5-46db-b2ee-c5bd971f27a6',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 802.609363] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 802.609515] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 802.610440] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 802.610667] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 802.610951] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 802.623173] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e2790d7c-6d0c-45bc-84d1-8cb00d26b9b0 in Status: IN_PROGRESS for 2s [ 802.662484] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8d9c7efa-60b6-44af-830b-f32145b1b403 in Status: SUCCESS [ 802.662708] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8d9c7efa-60b6-44af-830b-f32145b1b403" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 802.663059] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8d9c7efa-60b6-44af-830b-f32145b1b403" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 802.663189] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8d9c7efa-60b6-44af-830b-f32145b1b403" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 802.663961] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 802.663961] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 802.663961] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 802.663961] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 802.663961] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 802.664212] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8d9c7efa-60b6-44af-830b-f32145b1b403" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 802.664212] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('8d9c7efa-60b6-44af-830b-f32145b1b403',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 802.667047] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8d9c7efa-60b6-44af-830b-f32145b1b403" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 802.667047] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8d9c7efa-60b6-44af-830b-f32145b1b403" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 802.667047] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 802.667047] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 802.667047] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 802.667047] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 802.667047] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 802.667047] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('8d9c7efa-60b6-44af-830b-f32145b1b403',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 802.680773] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 78c0a4a2-12c9-4a82-bedc-df813ca8b608 in Status: SUCCESS [ 802.681076] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-78c0a4a2-12c9-4a82-bedc-df813ca8b608" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 802.681257] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-78c0a4a2-12c9-4a82-bedc-df813ca8b608" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 802.681487] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-78c0a4a2-12c9-4a82-bedc-df813ca8b608" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 802.681687] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 802.681809] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 802.681875] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 802.682069] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 802.682167] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 802.682265] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-78c0a4a2-12c9-4a82-bedc-df813ca8b608" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 802.682367] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('78c0a4a2-12c9-4a82-bedc-df813ca8b608',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 802.683547] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-78c0a4a2-12c9-4a82-bedc-df813ca8b608" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 802.683722] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-78c0a4a2-12c9-4a82-bedc-df813ca8b608" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 802.683906] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 802.684033] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 802.684190] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 802.684245] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 802.684309] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 802.684405] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('78c0a4a2-12c9-4a82-bedc-df813ca8b608',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 802.690828] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 11de4e2c-e962-4fc6-af11-81e30acc66a6 in Status: SUCCESS [ 802.691066] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-11de4e2c-e962-4fc6-af11-81e30acc66a6" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 802.691231] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-11de4e2c-e962-4fc6-af11-81e30acc66a6" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 802.691454] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-11de4e2c-e962-4fc6-af11-81e30acc66a6" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 802.691689] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 802.691885] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 802.691971] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 802.692157] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 802.692268] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 802.692389] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-11de4e2c-e962-4fc6-af11-81e30acc66a6" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 802.692528] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('11de4e2c-e962-4fc6-af11-81e30acc66a6',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 802.693654] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-11de4e2c-e962-4fc6-af11-81e30acc66a6" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 802.694560] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-11de4e2c-e962-4fc6-af11-81e30acc66a6" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 802.694560] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 802.694560] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 802.694560] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 802.694560] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 802.694560] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 802.694868] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('11de4e2c-e962-4fc6-af11-81e30acc66a6',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 802.953562] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 67f4a0c1-3a3c-4ed8-9358-3a9645aba154 in Status: SUCCESS [ 802.953758] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-67f4a0c1-3a3c-4ed8-9358-3a9645aba154" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 803.106507] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock member-7960de7e-23b5-46db-b2ee-c5bd971f27a6 taken with stack trace [, , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 803.107260] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7960de7e-23b5-46db-b2ee-c5bd971f27a6" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 803.108821] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('7960de7e-23b5-46db-b2ee-c5bd971f27a6',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 803.169565] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock member-8d9c7efa-60b6-44af-830b-f32145b1b403 taken with stack trace [, , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 803.169717] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8d9c7efa-60b6-44af-830b-f32145b1b403" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 803.169919] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('8d9c7efa-60b6-44af-830b-f32145b1b403',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 803.187295] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('78c0a4a2-12c9-4a82-bedc-df813ca8b608',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 803.189460] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 803.189617] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 803.189688] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 803.189905] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 803.190081] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 803.190181] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 803.190279] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 803.190339] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 803.190544] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 803.190633] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 803.190721] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 78c0a4a2-12c9-4a82-bedc-df813ca8b608 is going to be updated. [ 803.197521] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('11de4e2c-e962-4fc6-af11-81e30acc66a6',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 803.198534] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 803.198667] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 803.198730] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 803.198968] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 803.199057] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 803.199255] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 803.199358] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 803.199427] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 803.199552] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 803.199626] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 803.199758] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 11de4e2c-e962-4fc6-af11-81e30acc66a6 is going to be deleted. [ 803.229087] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 803.229087] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 803.229087] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 803.229087] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 803.229087] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 803.233881] env[65370]: INFO networking_nsxv3.common.synchronization [req-a10cc7e1-7468-48f6-a44c-ee9b7c256eef req-b72a67b7-5405-47f2-85a5-05acc4cf0e8b service nova] Enqueued Resource ID: 7960de7e-23b5-46db-b2ee-c5bd971f27a6 with Priority: HIGHEST for action security_group_rules [ 803.234120] env[65370]: INFO networking_nsxv3.common.synchronization [req-a10cc7e1-7468-48f6-a44c-ee9b7c256eef req-b72a67b7-5405-47f2-85a5-05acc4cf0e8b service nova] Enqueued Resource ID: 7960de7e-23b5-46db-b2ee-c5bd971f27a6 with Priority: HIGHEST for action security_group_members [ 803.234997] env[65370]: INFO networking_nsxv3.common.synchronization [req-a10cc7e1-7468-48f6-a44c-ee9b7c256eef req-b72a67b7-5405-47f2-85a5-05acc4cf0e8b service nova] Enqueued Resource ID: b4b53138-309f-41c3-943a-140ed865e73e with Priority: HIGHEST for action port [ 803.234997] env[65370]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7960de7e-23b5-46db-b2ee-c5bd971f27a6 with Priority: HIGHEST for action security_group_rules [ 803.235136] env[65370]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7960de7e-23b5-46db-b2ee-c5bd971f27a6 with Priority: HIGHEST for action security_group_members [ 803.235227] env[65370]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b4b53138-309f-41c3-943a-140ed865e73e with Priority: HIGHEST for action port [ 803.235503] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock rules-7960de7e-23b5-46db-b2ee-c5bd971f27a6 taken with stack trace [, , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 803.235642] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-7960de7e-23b5-46db-b2ee-c5bd971f27a6" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 803.235926] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock member-7960de7e-23b5-46db-b2ee-c5bd971f27a6 taken with stack trace [, , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 803.235983] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7960de7e-23b5-46db-b2ee-c5bd971f27a6" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 803.236332] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock port-b4b53138-309f-41c3-943a-140ed865e73e taken with stack trace [, , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 803.236478] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b4b53138-309f-41c3-943a-140ed865e73e" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 803.237329] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b4b53138-309f-41c3-943a-140ed865e73e" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 803.237329] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b4b53138-309f-41c3-943a-140ed865e73e" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 803.237329] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b4b53138-309f-41c3-943a-140ed865e73e',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 803.242330] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 78c0a4a2-12c9-4a82-bedc-df813ca8b608 in Status: IN_PROGRESS for 2s [ 803.243822] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 803.243992] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 803.244162] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 803.244294] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 803.244371] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 803.244448] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-11de4e2c-e962-4fc6-af11-81e30acc66a6" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 803.612092] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('7960de7e-23b5-46db-b2ee-c5bd971f27a6',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 803.658704] env[65370]: INFO networking_nsxv3.common.synchronization [req-3ca16be4-4d17-4012-a389-a6ea89f6b367 req-e3cf2f4f-d3dc-4992-ab74-0788068b06af tempest-ServersTestJSON-152322471 tempest-ServersTestJSON-152322471-project-member] Enqueued Resource ID: 21a3b55c-64ce-4782-808a-31350166c184 with Priority: HIGHEST for action security_group_members [ 803.659285] env[65370]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 21a3b55c-64ce-4782-808a-31350166c184 with Priority: HIGHEST for action security_group_members [ 803.663352] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock member-21a3b55c-64ce-4782-808a-31350166c184 taken with stack trace [, , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 803.663544] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-21a3b55c-64ce-4782-808a-31350166c184" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 803.663639] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-21a3b55c-64ce-4782-808a-31350166c184" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 803.663899] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-21a3b55c-64ce-4782-808a-31350166c184" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 803.664080] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 803.664182] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 803.664245] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 803.664397] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 803.664480] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 803.664575] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('21a3b55c-64ce-4782-808a-31350166c184',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 803.673054] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('8d9c7efa-60b6-44af-830b-f32145b1b403',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 803.693159] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 78c0a4a2-12c9-4a82-bedc-df813ca8b608: rpc.has_security_group_logging(os_id): False [ 803.701814] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 11de4e2c-e962-4fc6-af11-81e30acc66a6: rpc.has_security_group_logging(os_id): False [ 803.721711] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 803.721991] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 803.722969] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 803.723311] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 803.723447] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 803.723828] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 803.723984] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 803.724878] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 803.725242] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 803.725438] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 803.725653] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 78c0a4a2-12c9-4a82-bedc-df813ca8b608 is going to be updated. [ 803.728864] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 803.729123] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 803.729258] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 803.730040] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 803.730040] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 803.730040] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 803.730193] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 803.730303] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 803.730647] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 803.730761] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 803.732535] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 11de4e2c-e962-4fc6-af11-81e30acc66a6 is going to be created. [ 803.741562] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port b4b53138-309f-41c3-943a-140ed865e73e with status ACTIVE [ 803.741562] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 803.741562] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 803.741562] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 803.741562] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 803.741562] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 803.741562] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 803.741562] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 803.741912] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 803.741912] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 803.741912] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 803.742434] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 803.742755] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 803.742839] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 803.743033] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 803.743114] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 803.743213] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: b4b53138-309f-41c3-943a-140ed865e73e is going to be updated. [ 803.781698] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 803.781927] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 803.782014] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 803.782257] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 803.782401] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 803.782580] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b4b53138-309f-41c3-943a-140ed865e73e" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 803.783951] env[65370]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [-] Warning Code=404 Message=b'{\n "httpStatus" : "NOT_FOUND",\n "error_code" : 500232,\n "module_name" : "Policy",\n "error_message" : "Following dependent objects, used in path=[/infra/domains/default/security-policies/11de4e2c-e962-4fc6-af11-81e30acc66a6], does not exist path=[/infra/domains/default/groups/11de4e2c-e962-4fc6-af11-81e30acc66a6]."\n}' [ 803.783951] env[65370]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 11de4e2c-e962-4fc6-af11-81e30acc66a6 failed to be updated, retrying after metadata refresh: requests.exceptions.HTTPError: 404 Client Error: Not Found for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/policy/api/v1/infra/domains/default/security-policies/11de4e2c-e962-4fc6-af11-81e30acc66a6 [ 803.783951] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules). [ 803.838025] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 803.838025] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 803.838025] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 803.838285] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 803.838375] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 803.862369] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 803.862369] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 803.862369] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 803.862369] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 803.862369] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 803.862369] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 803.862369] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 803.862663] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 803.862663] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 803.862718] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 803.862918] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 803.863281] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 803.863281] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 803.863352] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 803.863417] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 803.863504] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 11de4e2c-e962-4fc6-af11-81e30acc66a6 is going to be created. [ 803.868271] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 78c0a4a2-12c9-4a82-bedc-df813ca8b608 in Status: IN_PROGRESS for 2s [ 803.907981] env[65370]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [-] Warning Code=404 Message=b'{\n "httpStatus" : "NOT_FOUND",\n "error_code" : 500232,\n "module_name" : "Policy",\n "error_message" : "Following dependent objects, used in path=[/infra/domains/default/security-policies/11de4e2c-e962-4fc6-af11-81e30acc66a6], does not exist path=[/infra/domains/default/groups/11de4e2c-e962-4fc6-af11-81e30acc66a6]."\n}': requests.exceptions.HTTPError: 404 Client Error: Not Found for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/policy/api/v1/infra/domains/default/security-policies/11de4e2c-e962-4fc6-af11-81e30acc66a6 [ 803.907981] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-11de4e2c-e962-4fc6-af11-81e30acc66a6" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 803.907981] env[65370]: Traceback (most recent call last): [ 803.907981] env[65370]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py", line 36, in wrapper [ 803.907981] env[65370]: return func(*args, **kwargs) [ 803.907981] env[65370]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py", line 786, in _realize [ 803.907981] env[65370]: res.raise_for_status() [ 803.907981] env[65370]: File "/opt/stack/data/venv/lib/python3.10/site-packages/requests/models.py", line 1026, in raise_for_status [ 803.907981] env[65370]: raise HTTPError(http_error_msg, response=self) [ 803.907981] env[65370]: requests.exceptions.HTTPError: 404 Client Error: Not Found for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/policy/api/v1/infra/domains/default/security-policies/11de4e2c-e962-4fc6-af11-81e30acc66a6 [ 803.907981] env[65370]: During handling of the above exception, another exception occurred: [ 803.907981] env[65370]: Traceback (most recent call last): [ 803.907981] env[65370]: File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/hubs/poll.py", line 111, in wait [ 803.907981] env[65370]: listener.cb(fileno) [ 803.907981] env[65370]: File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py", line 272, in main [ 803.907981] env[65370]: result = function(*args, **kwargs) [ 803.907981] env[65370]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py", line 210, in security_group_rules [ 803.907981] env[65370]: self.nsx_provider.sg_rules_realize(os_sg, logged=logged) [ 803.907981] env[65370]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py", line 1012, in sg_rules_realize [ 803.907981] env[65370]: return self._realize(Provider.SG_RULES, delete, self.payload.sg_rules_container, os_sg, provider_sg) [ 803.907981] env[65370]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py", line 45, in wrapper [ 803.907981] env[65370]: return func(self, resource_type, delete, self.payload.sg_rules_container, os_obj, provider_sg) [ 803.907981] env[65370]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py", line 786, in _realize [ 803.907981] env[65370]: res.raise_for_status() [ 803.907981] env[65370]: File "/opt/stack/data/venv/lib/python3.10/site-packages/requests/models.py", line 1026, in raise_for_status [ 803.907981] env[65370]: raise HTTPError(http_error_msg, response=self) [ 803.907981] env[65370]: requests.exceptions.HTTPError: 404 Client Error: Not Found for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/policy/api/v1/infra/domains/default/security-policies/11de4e2c-e962-4fc6-af11-81e30acc66a6 [ 803.907981] env[65370]: Removing descriptor: 66 [ 804.114207] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 804.114392] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 804.114708] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 804.114708] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 804.114823] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 804.115919] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7960de7e-23b5-46db-b2ee-c5bd971f27a6 is going to be updated. [ 804.128021] env[65370]: DEBUG networking_nsxv3.common.locking [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Lock network-531 taken with stack trace [, , , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 804.128021] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquiring lock "network-531" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 804.128021] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquired lock "network-531" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 804.128384] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquired external semaphore "network-531" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 804.131662] env[65370]: DEBUG networking_nsxv3.common.locking [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 804.131662] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquiring lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 804.131662] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquired lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 804.131662] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquired external semaphore "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 804.131662] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Releasing lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 804.131662] env[65370]: DEBUG dogpile.cache.region [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] No value present for key: 'zone-id' {{(pid=65370) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 804.131662] env[65370]: DEBUG dogpile.lock [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] NeedRegenerationException {{(pid=65370) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 804.131662] env[65370]: DEBUG dogpile.lock [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] no value, waiting for create lock {{(pid=65370) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 804.131662] env[65370]: DEBUG dogpile.lock [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] value creation lock acquired {{(pid=65370) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 804.131662] env[65370]: DEBUG dogpile.cache.region [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] No value present for key: 'zone-id' {{(pid=65370) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 804.131662] env[65370]: DEBUG dogpile.lock [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Calling creation function for not-yet-present value {{(pid=65370) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 804.131662] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 804.153137] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 804.153319] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 804.153387] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 804.153855] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 804.154117] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 804.160434] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 804.160769] env[65370]: DEBUG dogpile.cache.region [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Cache value generated in 0.030 seconds for key(s): 'zone-id' {{(pid=65370) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 804.160973] env[65370]: DEBUG dogpile.lock [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Released creation lock {{(pid=65370) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 804.161072] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Releasing lock "network-531" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 804.161448] env[65370]: DEBUG networking_nsxv3.common.locking [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Lock port-7b80a54f-7fd7-45ca-9b1d-cbab1257aac2 taken with stack trace [, , , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 804.161675] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquiring lock "port-7b80a54f-7fd7-45ca-9b1d-cbab1257aac2" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 804.161885] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquired lock "port-7b80a54f-7fd7-45ca-9b1d-cbab1257aac2" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 804.165984] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquired external semaphore "port-7b80a54f-7fd7-45ca-9b1d-cbab1257aac2" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 804.165984] env[65370]: DEBUG networking_nsxv3.api.rpc [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7b80a54f-7fd7-45ca-9b1d-cbab1257aac2',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 804.167463] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7960de7e-23b5-46db-b2ee-c5bd971f27a6 in Status: IN_PROGRESS for 2s [ 804.168162] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 804.168162] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 804.168162] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 804.168364] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 804.168364] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 804.168478] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 804.168704] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 804.168704] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 804.168905] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 804.168988] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 804.169098] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 21a3b55c-64ce-4782-808a-31350166c184 already deleted. [ 804.169220] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-21a3b55c-64ce-4782-808a-31350166c184" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 804.177774] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 804.177965] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 804.177965] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 804.178491] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 804.178491] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 804.178491] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8d9c7efa-60b6-44af-830b-f32145b1b403 is going to be updated. [ 804.212343] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 804.212457] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 804.212539] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 804.212740] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 804.212883] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 804.223191] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8d9c7efa-60b6-44af-830b-f32145b1b403 in Status: IN_PROGRESS for 2s [ 804.636284] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e2790d7c-6d0c-45bc-84d1-8cb00d26b9b0 in Status: SUCCESS [ 804.636655] env[65370]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e2790d7c-6d0c-45bc-84d1-8cb00d26b9b0 deletion is rescheduled due to dependency. [ 804.636655] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e2790d7c-6d0c-45bc-84d1-8cb00d26b9b0" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 804.665229] env[65370]: DEBUG networking_nsxv3.common.locking [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 804.665573] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquiring lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 804.665829] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquired lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 804.666255] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquired external semaphore "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 804.666484] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Releasing lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 804.666721] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Segment Port 7b80a54f-7fd7-45ca-9b1d-cbab1257aac2 not found, creating... [ 804.667163] env[65370]: DEBUG networking_nsxv3.common.locking [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 804.667422] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquiring lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 804.667569] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquired lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 804.667864] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquired external semaphore "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 804.668085] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Releasing lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 804.668474] env[65370]: DEBUG networking_nsxv3.common.locking [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 804.668654] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquiring lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 804.668772] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquired lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 804.669015] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquired external semaphore "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 804.669165] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Releasing lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 804.669291] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Resource: SegmentPort with ID: 7b80a54f-7fd7-45ca-9b1d-cbab1257aac2 is going to be created. [ 804.707748] env[65370]: DEBUG networking_nsxv3.common.locking [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 804.707981] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquiring lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 804.708115] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquired lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 804.708385] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquired external semaphore "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 804.708615] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Releasing lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 804.708834] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Releasing lock "port-7b80a54f-7fd7-45ca-9b1d-cbab1257aac2" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 805.254072] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 78c0a4a2-12c9-4a82-bedc-df813ca8b608 in Status: SUCCESS [ 805.254072] env[65370]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 78c0a4a2-12c9-4a82-bedc-df813ca8b608 deletion is rescheduled due to dependency. [ 805.254072] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-78c0a4a2-12c9-4a82-bedc-df813ca8b608" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 805.391576] env[65370]: INFO networking_nsxv3.common.synchronization [req-3ca16be4-4d17-4012-a389-a6ea89f6b367 req-1c5b8a0d-1738-43d3-81c1-2c56be517b81 service nova] Enqueued Resource ID: 21a3b55c-64ce-4782-808a-31350166c184 with Priority: HIGHEST for action security_group_rules [ 805.391761] env[65370]: INFO networking_nsxv3.common.synchronization [req-3ca16be4-4d17-4012-a389-a6ea89f6b367 req-1c5b8a0d-1738-43d3-81c1-2c56be517b81 service nova] Enqueued Resource ID: 21a3b55c-64ce-4782-808a-31350166c184 with Priority: HIGHEST for action security_group_members [ 805.391897] env[65370]: INFO networking_nsxv3.common.synchronization [req-3ca16be4-4d17-4012-a389-a6ea89f6b367 req-1c5b8a0d-1738-43d3-81c1-2c56be517b81 service nova] Enqueued Resource ID: 7b80a54f-7fd7-45ca-9b1d-cbab1257aac2 with Priority: HIGHEST for action port [ 805.392601] env[65370]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 21a3b55c-64ce-4782-808a-31350166c184 with Priority: HIGHEST for action security_group_rules [ 805.392601] env[65370]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 21a3b55c-64ce-4782-808a-31350166c184 with Priority: HIGHEST for action security_group_members [ 805.392792] env[65370]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7b80a54f-7fd7-45ca-9b1d-cbab1257aac2 with Priority: HIGHEST for action port [ 805.392926] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock rules-21a3b55c-64ce-4782-808a-31350166c184 taken with stack trace [, , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 805.393070] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-21a3b55c-64ce-4782-808a-31350166c184" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 805.393135] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-21a3b55c-64ce-4782-808a-31350166c184" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 805.393319] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-21a3b55c-64ce-4782-808a-31350166c184" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 805.393393] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('21a3b55c-64ce-4782-808a-31350166c184',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 805.394421] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock member-21a3b55c-64ce-4782-808a-31350166c184 taken with stack trace [, , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 805.394819] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-21a3b55c-64ce-4782-808a-31350166c184" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 805.394819] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-21a3b55c-64ce-4782-808a-31350166c184" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 805.394819] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-21a3b55c-64ce-4782-808a-31350166c184" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 805.395299] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 805.395299] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 805.395299] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 805.395299] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 805.395299] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 805.395299] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('21a3b55c-64ce-4782-808a-31350166c184',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 805.396348] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock port-7b80a54f-7fd7-45ca-9b1d-cbab1257aac2 taken with stack trace [, , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 805.396478] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-7b80a54f-7fd7-45ca-9b1d-cbab1257aac2" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 805.396550] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-7b80a54f-7fd7-45ca-9b1d-cbab1257aac2" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 805.396643] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-7b80a54f-7fd7-45ca-9b1d-cbab1257aac2" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 805.396731] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7b80a54f-7fd7-45ca-9b1d-cbab1257aac2',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 805.893688] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 78c0a4a2-12c9-4a82-bedc-df813ca8b608 in Status: SUCCESS [ 805.894190] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-78c0a4a2-12c9-4a82-bedc-df813ca8b608" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 805.898674] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock member-21a3b55c-64ce-4782-808a-31350166c184 taken with stack trace [, , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 805.898786] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-21a3b55c-64ce-4782-808a-31350166c184" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 805.900055] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 7b80a54f-7fd7-45ca-9b1d-cbab1257aac2 with status ACTIVE [ 805.900251] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 805.900370] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 805.900433] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 805.900649] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 805.900735] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 805.900910] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 805.901020] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 805.901097] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 805.901236] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 805.901320] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 805.901477] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 805.901567] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 805.901621] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 805.901764] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 805.901829] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 805.901995] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 7b80a54f-7fd7-45ca-9b1d-cbab1257aac2 is going to be updated. [ 805.903159] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('21a3b55c-64ce-4782-808a-31350166c184',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 805.928022] env[65370]: INFO networking_nsxv3.common.synchronization [req-1b27d5bf-012d-4667-a049-6570f68119d0 req-c8e0a580-fd05-4ec4-ac56-2a2c438791aa tempest-ServersTestManualDisk-1265226149 tempest-ServersTestManualDisk-1265226149-project-member] Enqueued Resource ID: 23979820-ccb5-4fdf-8d1a-316ad4242d32 with Priority: HIGHEST for action security_group_members [ 805.929136] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 805.929596] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 805.929596] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 805.929596] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 805.929772] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 805.929825] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-7b80a54f-7fd7-45ca-9b1d-cbab1257aac2" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 805.930390] env[65370]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 23979820-ccb5-4fdf-8d1a-316ad4242d32 with Priority: HIGHEST for action security_group_members [ 805.930729] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock member-23979820-ccb5-4fdf-8d1a-316ad4242d32 taken with stack trace [, , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 805.930833] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-23979820-ccb5-4fdf-8d1a-316ad4242d32" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 805.930887] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-23979820-ccb5-4fdf-8d1a-316ad4242d32" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 805.931824] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-23979820-ccb5-4fdf-8d1a-316ad4242d32" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 805.931824] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 805.931824] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 805.931824] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 805.931824] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 805.931824] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 805.931824] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('23979820-ccb5-4fdf-8d1a-316ad4242d32',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 806.179646] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7960de7e-23b5-46db-b2ee-c5bd971f27a6 in Status: SUCCESS [ 806.179888] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7960de7e-23b5-46db-b2ee-c5bd971f27a6" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 806.180122] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7960de7e-23b5-46db-b2ee-c5bd971f27a6" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 806.180335] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7960de7e-23b5-46db-b2ee-c5bd971f27a6" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 806.180553] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 806.180750] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 806.180750] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 806.181962] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 806.181962] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 806.181962] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7960de7e-23b5-46db-b2ee-c5bd971f27a6" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 806.181962] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock member-7960de7e-23b5-46db-b2ee-c5bd971f27a6 taken with stack trace [, , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 806.181962] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7960de7e-23b5-46db-b2ee-c5bd971f27a6" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 806.181962] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7960de7e-23b5-46db-b2ee-c5bd971f27a6" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 806.181962] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7960de7e-23b5-46db-b2ee-c5bd971f27a6" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 806.181962] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 806.182889] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 806.182956] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 806.183156] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 806.183259] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 806.183352] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7960de7e-23b5-46db-b2ee-c5bd971f27a6" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 806.183459] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('7960de7e-23b5-46db-b2ee-c5bd971f27a6',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 806.185210] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7960de7e-23b5-46db-b2ee-c5bd971f27a6" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 806.185386] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7960de7e-23b5-46db-b2ee-c5bd971f27a6" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 806.185549] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 806.185733] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 806.185804] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 806.185960] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 806.186058] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 806.186153] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7960de7e-23b5-46db-b2ee-c5bd971f27a6',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 806.237053] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8d9c7efa-60b6-44af-830b-f32145b1b403 in Status: SUCCESS [ 806.237053] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8d9c7efa-60b6-44af-830b-f32145b1b403" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 806.237053] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8d9c7efa-60b6-44af-830b-f32145b1b403" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 806.237389] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8d9c7efa-60b6-44af-830b-f32145b1b403" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 806.237494] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 806.237640] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 806.237726] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 806.239410] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 806.239410] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 806.239410] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8d9c7efa-60b6-44af-830b-f32145b1b403" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 806.239410] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock member-8d9c7efa-60b6-44af-830b-f32145b1b403 taken with stack trace [, , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 806.239410] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8d9c7efa-60b6-44af-830b-f32145b1b403" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 806.239410] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8d9c7efa-60b6-44af-830b-f32145b1b403" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 806.239410] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8d9c7efa-60b6-44af-830b-f32145b1b403" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 806.239410] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 806.239410] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 806.239410] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 806.239410] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 806.239971] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 806.239971] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8d9c7efa-60b6-44af-830b-f32145b1b403" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 806.239971] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('8d9c7efa-60b6-44af-830b-f32145b1b403',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 806.406589] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('21a3b55c-64ce-4782-808a-31350166c184',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 806.434152] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 806.434313] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 806.434445] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 806.434871] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 806.460383] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 806.460640] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 806.460757] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 806.460877] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 806.461030] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 806.461112] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 806.461203] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 23979820-ccb5-4fdf-8d1a-316ad4242d32 is going to be updated. [ 806.491279] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 806.491421] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 806.492024] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 806.492024] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 806.492024] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 806.502132] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 23979820-ccb5-4fdf-8d1a-316ad4242d32 in Status: IN_PROGRESS for 2s [ 806.689221] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 7960de7e-23b5-46db-b2ee-c5bd971f27a6: rpc.has_security_group_logging(os_id): False [ 806.691958] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('7960de7e-23b5-46db-b2ee-c5bd971f27a6',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 806.723751] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 806.723914] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 806.723955] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 806.725103] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 806.725103] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 806.725103] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 806.725103] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 806.725103] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 806.725103] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 806.725103] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 806.725103] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 806.725432] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 806.725432] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 806.725432] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 806.725432] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 806.725596] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 806.725723] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 806.725796] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 806.725936] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 806.726031] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 806.726122] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 7960de7e-23b5-46db-b2ee-c5bd971f27a6 is going to be created. [ 806.746856] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 8d9c7efa-60b6-44af-830b-f32145b1b403: rpc.has_security_group_logging(os_id): False [ 806.779949] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 806.779949] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 806.779949] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 806.779949] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 806.813663] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 806.813904] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 806.814011] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 806.814011] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 806.814228] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 806.814313] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 806.815311] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 806.815311] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 806.815311] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 806.815311] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 806.815311] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 806.815311] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 806.815311] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 806.815311] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 806.817946] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 806.817946] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 806.817946] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 8d9c7efa-60b6-44af-830b-f32145b1b403 is going to be updated. [ 806.857861] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 806.858090] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 806.858090] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 806.858313] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 806.858511] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 806.872228] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7960de7e-23b5-46db-b2ee-c5bd971f27a6 in Status: IN_PROGRESS for 2s [ 806.897509] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 806.897509] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 806.897509] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 806.897509] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 806.897509] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 806.910180] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 806.910180] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 806.910180] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 806.910180] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 806.910180] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 806.910180] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 21a3b55c-64ce-4782-808a-31350166c184 is going to be created. [ 806.935449] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 8d9c7efa-60b6-44af-830b-f32145b1b403 in Status: IN_PROGRESS for 2s [ 806.964291] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 806.964291] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 806.964291] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 806.964291] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 806.964291] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 806.981986] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 21a3b55c-64ce-4782-808a-31350166c184 in Status: UNINITIALIZED for 2s [ 807.194450] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('7960de7e-23b5-46db-b2ee-c5bd971f27a6',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 807.697318] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 807.697872] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 807.698009] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 807.698708] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 807.699533] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 807.699533] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7960de7e-23b5-46db-b2ee-c5bd971f27a6 is going to be updated. [ 807.741431] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 807.741586] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 807.741664] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 807.741914] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 807.742036] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 807.767567] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7960de7e-23b5-46db-b2ee-c5bd971f27a6 in Status: IN_PROGRESS for 2s [ 808.516321] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 23979820-ccb5-4fdf-8d1a-316ad4242d32 in Status: SUCCESS [ 808.516766] env[65370]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 23979820-ccb5-4fdf-8d1a-316ad4242d32 deletion is rescheduled due to dependency. [ 808.516766] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-23979820-ccb5-4fdf-8d1a-316ad4242d32" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 808.889812] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7960de7e-23b5-46db-b2ee-c5bd971f27a6 in Status: SUCCESS [ 808.891264] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-7960de7e-23b5-46db-b2ee-c5bd971f27a6" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 808.891264] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-7960de7e-23b5-46db-b2ee-c5bd971f27a6" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 808.891264] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-7960de7e-23b5-46db-b2ee-c5bd971f27a6" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 808.891264] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('7960de7e-23b5-46db-b2ee-c5bd971f27a6',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 808.962199] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 8d9c7efa-60b6-44af-830b-f32145b1b403 in Status: SUCCESS [ 808.962443] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-8d9c7efa-60b6-44af-830b-f32145b1b403" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 808.993766] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 21a3b55c-64ce-4782-808a-31350166c184 in Status: SUCCESS [ 808.993997] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-21a3b55c-64ce-4782-808a-31350166c184" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 808.994177] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-21a3b55c-64ce-4782-808a-31350166c184" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 808.994403] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-21a3b55c-64ce-4782-808a-31350166c184" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 808.994597] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 808.994716] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 808.994781] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 808.994929] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 808.995019] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 808.995112] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-21a3b55c-64ce-4782-808a-31350166c184" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 808.995205] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('21a3b55c-64ce-4782-808a-31350166c184',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 809.315015] env[65370]: INFO networking_nsxv3.common.synchronization [req-bb3dfbff-54fb-447a-9f86-31548bd37bcc req-e75c5cad-85b0-47f7-8bfe-96bdf87c4351 tempest-ListServersNegativeTestJSON-1430921204 tempest-ListServersNegativeTestJSON-1430921204-project-member] Enqueued Resource ID: 0cacf152-a4d4-4487-a370-aa2bae090120 with Priority: HIGHEST for action security_group_members [ 809.315571] env[65370]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0cacf152-a4d4-4487-a370-aa2bae090120 with Priority: HIGHEST for action security_group_members [ 809.316062] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock member-0cacf152-a4d4-4487-a370-aa2bae090120 taken with stack trace [, , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 809.316062] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0cacf152-a4d4-4487-a370-aa2bae090120" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 809.316178] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0cacf152-a4d4-4487-a370-aa2bae090120" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 809.316313] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0cacf152-a4d4-4487-a370-aa2bae090120" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 809.316491] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 809.316593] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 809.316670] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 809.316816] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 809.316908] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 809.317017] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0cacf152-a4d4-4487-a370-aa2bae090120',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 809.395408] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock member-7960de7e-23b5-46db-b2ee-c5bd971f27a6 taken with stack trace [, , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 809.395582] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7960de7e-23b5-46db-b2ee-c5bd971f27a6" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 809.499122] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('21a3b55c-64ce-4782-808a-31350166c184',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 809.633687] env[65370]: INFO networking_nsxv3.common.synchronization [req-69344e2e-c689-4fe7-88b6-9abe3711e433 req-ce06f8e7-9757-475b-bb62-fb4c0668f0d1 tempest-ListServersNegativeTestJSON-1430921204 tempest-ListServersNegativeTestJSON-1430921204-project-member] Enqueued Resource ID: 0cacf152-a4d4-4487-a370-aa2bae090120 with Priority: HIGHEST for action security_group_members [ 809.634253] env[65370]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0cacf152-a4d4-4487-a370-aa2bae090120 with Priority: HIGHEST for action security_group_members [ 809.634583] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock member-0cacf152-a4d4-4487-a370-aa2bae090120 taken with stack trace [, , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 809.634689] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0cacf152-a4d4-4487-a370-aa2bae090120" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 809.782909] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7960de7e-23b5-46db-b2ee-c5bd971f27a6 in Status: SUCCESS [ 809.782909] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7960de7e-23b5-46db-b2ee-c5bd971f27a6" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 809.782909] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7960de7e-23b5-46db-b2ee-c5bd971f27a6" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 809.782909] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7960de7e-23b5-46db-b2ee-c5bd971f27a6" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 809.782909] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 809.782909] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 809.782909] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 809.782909] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 809.782909] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 809.782909] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7960de7e-23b5-46db-b2ee-c5bd971f27a6" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 809.782909] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('7960de7e-23b5-46db-b2ee-c5bd971f27a6',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 809.819153] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('0cacf152-a4d4-4487-a370-aa2bae090120',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 810.001687] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 21a3b55c-64ce-4782-808a-31350166c184: rpc.has_security_group_logging(os_id): False [ 810.025130] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 810.025370] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 810.025594] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 810.025781] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 810.025904] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 810.026261] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 810.026418] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 810.026531] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 810.026750] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 810.026891] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 810.027052] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 21a3b55c-64ce-4782-808a-31350166c184 is going to be created. [ 810.108540] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 810.108639] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 810.108902] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 810.108902] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 810.109123] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 810.125803] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 21a3b55c-64ce-4782-808a-31350166c184 in Status: IN_PROGRESS for 2s [ 810.284810] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock member-7960de7e-23b5-46db-b2ee-c5bd971f27a6 taken with stack trace [, , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 810.285039] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7960de7e-23b5-46db-b2ee-c5bd971f27a6" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 810.285158] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7960de7e-23b5-46db-b2ee-c5bd971f27a6" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 810.285285] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7960de7e-23b5-46db-b2ee-c5bd971f27a6" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 810.285896] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 810.285896] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 810.285896] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 810.285896] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 810.286128] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 810.286282] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7960de7e-23b5-46db-b2ee-c5bd971f27a6" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 810.286404] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock member-7960de7e-23b5-46db-b2ee-c5bd971f27a6 taken with stack trace [, , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 810.286476] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7960de7e-23b5-46db-b2ee-c5bd971f27a6" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 810.286619] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7960de7e-23b5-46db-b2ee-c5bd971f27a6" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 810.286757] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7960de7e-23b5-46db-b2ee-c5bd971f27a6" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 810.287215] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 810.287215] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 810.287215] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 810.287215] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 810.288332] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 810.288332] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7960de7e-23b5-46db-b2ee-c5bd971f27a6" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 810.288332] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('7960de7e-23b5-46db-b2ee-c5bd971f27a6',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 810.324715] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('0cacf152-a4d4-4487-a370-aa2bae090120',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 810.795819] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 7960de7e-23b5-46db-b2ee-c5bd971f27a6: rpc.has_security_group_logging(os_id): False [ 810.820450] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 810.820661] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 810.820703] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 810.821282] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 810.821282] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 810.821282] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 810.821566] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 810.821566] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 810.821684] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 810.821684] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 810.822282] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 810.822447] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 810.822509] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 810.822661] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 810.822661] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 810.822864] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 810.822956] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 810.823026] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 810.823161] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 810.823223] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 810.823311] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 7960de7e-23b5-46db-b2ee-c5bd971f27a6 is going to be updated. [ 810.827421] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 810.827617] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 810.827617] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 810.827812] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 810.827897] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 810.827995] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0cacf152-a4d4-4487-a370-aa2bae090120 is going to be updated. [ 810.884176] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 810.884356] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 810.884443] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 810.884867] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 810.885711] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 810.900529] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0cacf152-a4d4-4487-a370-aa2bae090120 in Status: IN_PROGRESS for 2s [ 810.942479] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 810.942639] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 810.942823] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 810.943234] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 810.943506] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 810.969013] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7960de7e-23b5-46db-b2ee-c5bd971f27a6 in Status: IN_PROGRESS for 2s [ 811.744596] env[65370]: INFO networking_nsxv3.common.synchronization [req-469c3fb0-25f8-49fc-b844-b9448b10a965 req-dbf426b0-614c-44a9-b2ac-df9603eb2daa tempest-ServersAdminNegativeTestJSON-2075318315 tempest-ServersAdminNegativeTestJSON-2075318315-project-member] Enqueued Resource ID: ae63a79d-837f-4a55-a83c-bcd245828917 with Priority: HIGHEST for action security_group_members [ 811.745308] env[65370]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ae63a79d-837f-4a55-a83c-bcd245828917 with Priority: HIGHEST for action security_group_members [ 811.745685] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock member-ae63a79d-837f-4a55-a83c-bcd245828917 taken with stack trace [, , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 811.745943] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ae63a79d-837f-4a55-a83c-bcd245828917" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 811.746054] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ae63a79d-837f-4a55-a83c-bcd245828917" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 811.746315] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ae63a79d-837f-4a55-a83c-bcd245828917" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 811.746486] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 811.746624] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 811.746705] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 811.746823] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 811.747324] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 811.747324] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ae63a79d-837f-4a55-a83c-bcd245828917',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 812.143032] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 21a3b55c-64ce-4782-808a-31350166c184 in Status: SUCCESS [ 812.143379] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-21a3b55c-64ce-4782-808a-31350166c184" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 812.214302] env[65370]: DEBUG networking_nsxv3.common.locking [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Lock network-449 taken with stack trace [, , , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 812.214302] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquiring lock "network-449" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 812.214302] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquired lock "network-449" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 812.214302] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquired external semaphore "network-449" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 812.214302] env[65370]: DEBUG networking_nsxv3.common.locking [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 812.214799] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquiring lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 812.215058] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquired lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 812.218093] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquired external semaphore "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 812.218093] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Releasing lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 812.218093] env[65370]: DEBUG dogpile.cache.region [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] No value present for key: 'zone-id' {{(pid=65370) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 812.218093] env[65370]: DEBUG dogpile.lock [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] NeedRegenerationException {{(pid=65370) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 812.218093] env[65370]: DEBUG dogpile.lock [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] no value, waiting for create lock {{(pid=65370) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 812.218093] env[65370]: DEBUG dogpile.lock [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] value creation lock acquired {{(pid=65370) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 812.218093] env[65370]: DEBUG dogpile.cache.region [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] No value present for key: 'zone-id' {{(pid=65370) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 812.218093] env[65370]: DEBUG dogpile.lock [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Calling creation function for not-yet-present value {{(pid=65370) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 812.218093] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 812.247025] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 812.247025] env[65370]: DEBUG dogpile.cache.region [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Cache value generated in 0.029 seconds for key(s): 'zone-id' {{(pid=65370) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 812.247025] env[65370]: DEBUG dogpile.lock [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Released creation lock {{(pid=65370) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 812.247025] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Releasing lock "network-449" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 812.247025] env[65370]: DEBUG networking_nsxv3.common.locking [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Lock port-a8179981-0cb0-4f0a-b247-3bb2e7d5dbc4 taken with stack trace [, , , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 812.247025] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquiring lock "port-a8179981-0cb0-4f0a-b247-3bb2e7d5dbc4" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 812.247025] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquired lock "port-a8179981-0cb0-4f0a-b247-3bb2e7d5dbc4" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 812.247025] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquired external semaphore "port-a8179981-0cb0-4f0a-b247-3bb2e7d5dbc4" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 812.247025] env[65370]: DEBUG networking_nsxv3.api.rpc [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a8179981-0cb0-4f0a-b247-3bb2e7d5dbc4',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 812.251032] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 812.251032] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 812.251032] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 812.251032] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 812.251032] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 812.251032] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 812.251032] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 812.251032] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 812.251032] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 812.251032] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 812.251032] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ae63a79d-837f-4a55-a83c-bcd245828917 already deleted. [ 812.251655] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ae63a79d-837f-4a55-a83c-bcd245828917" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 812.752035] env[65370]: DEBUG networking_nsxv3.common.locking [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 812.752035] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquiring lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 812.752035] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquired lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 812.752035] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquired external semaphore "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 812.752035] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Releasing lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 812.752035] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Segment Port a8179981-0cb0-4f0a-b247-3bb2e7d5dbc4 not found, creating... [ 812.752035] env[65370]: DEBUG networking_nsxv3.common.locking [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 812.752035] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquiring lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 812.752035] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquired lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 812.752035] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquired external semaphore "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 812.752035] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Releasing lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 812.752594] env[65370]: DEBUG networking_nsxv3.common.locking [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 812.752594] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquiring lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 812.752594] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquired lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 812.753315] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquired external semaphore "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 812.753680] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Releasing lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 812.754389] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Resource: SegmentPort with ID: a8179981-0cb0-4f0a-b247-3bb2e7d5dbc4 is going to be created. [ 812.785228] env[65370]: DEBUG networking_nsxv3.common.locking [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 812.785713] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquiring lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 812.785713] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquired lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 812.785927] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquired external semaphore "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 812.786253] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Releasing lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 812.786568] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Releasing lock "port-a8179981-0cb0-4f0a-b247-3bb2e7d5dbc4" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 812.915731] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0cacf152-a4d4-4487-a370-aa2bae090120 in Status: SUCCESS [ 812.916050] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0cacf152-a4d4-4487-a370-aa2bae090120" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 812.916261] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0cacf152-a4d4-4487-a370-aa2bae090120" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 812.916524] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0cacf152-a4d4-4487-a370-aa2bae090120" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 812.917263] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 812.917439] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 812.917511] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 812.917897] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 812.917897] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 812.918081] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0cacf152-a4d4-4487-a370-aa2bae090120',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 812.996636] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7960de7e-23b5-46db-b2ee-c5bd971f27a6 in Status: SUCCESS [ 812.998276] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-7960de7e-23b5-46db-b2ee-c5bd971f27a6" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 812.998276] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-7960de7e-23b5-46db-b2ee-c5bd971f27a6" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 812.998276] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-7960de7e-23b5-46db-b2ee-c5bd971f27a6" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 812.998276] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('7960de7e-23b5-46db-b2ee-c5bd971f27a6',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 813.420858] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 813.421328] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 813.421328] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 813.421450] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 813.447570] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 813.448335] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 813.448335] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 813.448335] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 813.449573] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 813.449573] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 813.449573] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0cacf152-a4d4-4487-a370-aa2bae090120 is going to be updated. [ 813.483390] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 813.483623] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 813.483623] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 813.483934] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 813.484092] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 813.494455] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0cacf152-a4d4-4487-a370-aa2bae090120 in Status: IN_PROGRESS for 2s [ 813.502059] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock member-7960de7e-23b5-46db-b2ee-c5bd971f27a6 taken with stack trace [, , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 813.502260] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7960de7e-23b5-46db-b2ee-c5bd971f27a6" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 813.502423] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7960de7e-23b5-46db-b2ee-c5bd971f27a6" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 813.502605] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7960de7e-23b5-46db-b2ee-c5bd971f27a6" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 813.502826] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 813.502924] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 813.502966] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 813.503180] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 813.503250] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 813.503288] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7960de7e-23b5-46db-b2ee-c5bd971f27a6" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 813.503373] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('7960de7e-23b5-46db-b2ee-c5bd971f27a6',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 813.518833] env[65370]: INFO networking_nsxv3.common.synchronization [req-469c3fb0-25f8-49fc-b844-b9448b10a965 req-04dd5a5a-d0d6-497f-8824-2a8554ebc77b service nova] Enqueued Resource ID: ae63a79d-837f-4a55-a83c-bcd245828917 with Priority: HIGHEST for action security_group_rules [ 813.518833] env[65370]: INFO networking_nsxv3.common.synchronization [req-469c3fb0-25f8-49fc-b844-b9448b10a965 req-04dd5a5a-d0d6-497f-8824-2a8554ebc77b service nova] Enqueued Resource ID: ae63a79d-837f-4a55-a83c-bcd245828917 with Priority: HIGHEST for action security_group_members [ 813.518971] env[65370]: INFO networking_nsxv3.common.synchronization [req-469c3fb0-25f8-49fc-b844-b9448b10a965 req-04dd5a5a-d0d6-497f-8824-2a8554ebc77b service nova] Enqueued Resource ID: a8179981-0cb0-4f0a-b247-3bb2e7d5dbc4 with Priority: HIGHEST for action port [ 813.519510] env[65370]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ae63a79d-837f-4a55-a83c-bcd245828917 with Priority: HIGHEST for action security_group_rules [ 813.519560] env[65370]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ae63a79d-837f-4a55-a83c-bcd245828917 with Priority: HIGHEST for action security_group_members [ 813.519909] env[65370]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a8179981-0cb0-4f0a-b247-3bb2e7d5dbc4 with Priority: HIGHEST for action port [ 813.520123] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock rules-ae63a79d-837f-4a55-a83c-bcd245828917 taken with stack trace [, , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 813.520469] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-ae63a79d-837f-4a55-a83c-bcd245828917" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 813.520469] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-ae63a79d-837f-4a55-a83c-bcd245828917" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 813.520754] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-ae63a79d-837f-4a55-a83c-bcd245828917" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 813.520866] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('ae63a79d-837f-4a55-a83c-bcd245828917',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 813.521971] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock member-ae63a79d-837f-4a55-a83c-bcd245828917 taken with stack trace [, , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 813.522158] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ae63a79d-837f-4a55-a83c-bcd245828917" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 813.522261] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ae63a79d-837f-4a55-a83c-bcd245828917" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 813.524507] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ae63a79d-837f-4a55-a83c-bcd245828917" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 813.524507] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 813.524507] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 813.524507] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 813.524507] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 813.524507] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 813.524507] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ae63a79d-837f-4a55-a83c-bcd245828917',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 813.525453] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock port-a8179981-0cb0-4f0a-b247-3bb2e7d5dbc4 taken with stack trace [, , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 813.525656] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-a8179981-0cb0-4f0a-b247-3bb2e7d5dbc4" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 813.525781] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-a8179981-0cb0-4f0a-b247-3bb2e7d5dbc4" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 813.525971] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-a8179981-0cb0-4f0a-b247-3bb2e7d5dbc4" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 813.526086] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a8179981-0cb0-4f0a-b247-3bb2e7d5dbc4',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 813.754545] env[65370]: INFO networking_nsxv3.common.synchronization [None req-7f2bfff7-9a9a-4d35-ba60-80abdbeff6bd None None] Enqueued Resource ID: 2e3ef3bf-8218-4313-9766-29effffc35c5 with Priority: HIGHEST for action port [ 813.755752] env[65370]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2e3ef3bf-8218-4313-9766-29effffc35c5 with Priority: HIGHEST for action port [ 813.756419] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock port-2e3ef3bf-8218-4313-9766-29effffc35c5 taken with stack trace [, , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 813.756564] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-2e3ef3bf-8218-4313-9766-29effffc35c5" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 813.757659] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-2e3ef3bf-8218-4313-9766-29effffc35c5" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 813.757659] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-2e3ef3bf-8218-4313-9766-29effffc35c5" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 813.757659] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2e3ef3bf-8218-4313-9766-29effffc35c5',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 814.006993] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock member-7960de7e-23b5-46db-b2ee-c5bd971f27a6 taken with stack trace [, , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 814.006993] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7960de7e-23b5-46db-b2ee-c5bd971f27a6" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 814.006993] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7960de7e-23b5-46db-b2ee-c5bd971f27a6" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 814.006993] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7960de7e-23b5-46db-b2ee-c5bd971f27a6" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 814.006993] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 814.006993] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 814.006993] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 814.006993] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 814.006993] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 814.007542] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7960de7e-23b5-46db-b2ee-c5bd971f27a6" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 814.007542] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock member-7960de7e-23b5-46db-b2ee-c5bd971f27a6 taken with stack trace [, , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 814.007542] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7960de7e-23b5-46db-b2ee-c5bd971f27a6" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 814.007690] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7960de7e-23b5-46db-b2ee-c5bd971f27a6" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 814.007753] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7960de7e-23b5-46db-b2ee-c5bd971f27a6" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 814.007871] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 814.007960] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 814.008029] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 814.008168] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 814.008244] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 814.008325] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7960de7e-23b5-46db-b2ee-c5bd971f27a6" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 814.008654] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('7960de7e-23b5-46db-b2ee-c5bd971f27a6',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 814.027896] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('ae63a79d-837f-4a55-a83c-bcd245828917',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 814.029074] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock member-ae63a79d-837f-4a55-a83c-bcd245828917 taken with stack trace [, , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 814.029176] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ae63a79d-837f-4a55-a83c-bcd245828917" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 814.029647] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port a8179981-0cb0-4f0a-b247-3bb2e7d5dbc4 with status ACTIVE [ 814.029857] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 814.030048] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 814.030048] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 814.030228] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 814.030326] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 814.030507] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 814.030605] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 814.030665] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 814.030875] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 814.031025] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 814.031859] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 814.031859] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 814.031859] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 814.031859] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 814.031859] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 814.031859] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: a8179981-0cb0-4f0a-b247-3bb2e7d5dbc4 is going to be updated. [ 814.068496] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 814.068744] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 814.068795] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 814.069078] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 814.069238] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 814.069447] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-a8179981-0cb0-4f0a-b247-3bb2e7d5dbc4" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 814.259836] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 2e3ef3bf-8218-4313-9766-29effffc35c5 [ 814.259836] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 814.259836] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 814.259836] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 814.261189] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 814.261362] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 814.261418] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:2e3ef3bf-8218-4313-9766-29effffc35c5 already deleted. [ 814.261667] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-2e3ef3bf-8218-4313-9766-29effffc35c5" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 814.512342] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 7960de7e-23b5-46db-b2ee-c5bd971f27a6: rpc.has_security_group_logging(os_id): False [ 814.536030] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('ae63a79d-837f-4a55-a83c-bcd245828917',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 814.540394] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 814.540547] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 814.540619] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 814.540833] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 814.540925] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 814.541138] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 814.542092] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 814.542092] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 814.542092] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 814.542092] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 814.542092] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 814.542092] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 814.542092] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 814.542092] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 814.543804] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 814.543804] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 814.543804] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 814.543804] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 814.543804] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 814.543804] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 814.543804] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 7960de7e-23b5-46db-b2ee-c5bd971f27a6 is going to be updated. [ 814.621024] env[65370]: INFO networking_nsxv3.common.synchronization [req-bd790212-7db4-44d3-b418-5f25426d4b5c req-3dffee50-b007-4737-835d-cae89a1012bb tempest-ServersTestBootFromVolume-1353776408 tempest-ServersTestBootFromVolume-1353776408-project-member] Enqueued Resource ID: c26b8d0b-5a65-4082-8dff-404228d547c4 with Priority: HIGHEST for action security_group_members [ 814.621024] env[65370]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c26b8d0b-5a65-4082-8dff-404228d547c4 with Priority: HIGHEST for action security_group_members [ 814.621024] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock member-c26b8d0b-5a65-4082-8dff-404228d547c4 taken with stack trace [, , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 814.621498] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c26b8d0b-5a65-4082-8dff-404228d547c4" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 814.621677] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c26b8d0b-5a65-4082-8dff-404228d547c4" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 814.622037] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c26b8d0b-5a65-4082-8dff-404228d547c4" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 814.622353] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 814.622593] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 814.622871] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 814.623141] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 814.623355] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 814.624806] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c26b8d0b-5a65-4082-8dff-404228d547c4',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 814.626559] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 814.629140] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 814.629140] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 814.629140] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 814.629307] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 814.648036] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7960de7e-23b5-46db-b2ee-c5bd971f27a6 in Status: IN_PROGRESS for 2s [ 815.048685] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 815.048685] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 815.048685] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 815.048685] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 815.048685] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 815.048685] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ae63a79d-837f-4a55-a83c-bcd245828917 is going to be created. [ 815.082853] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 815.083332] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 815.083332] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 815.083332] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 815.083479] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 815.098009] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ae63a79d-837f-4a55-a83c-bcd245828917 in Status: UNINITIALIZED for 2s [ 815.132053] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 815.133046] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 815.133046] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 815.134801] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 815.134801] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 815.134801] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 815.134801] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 815.134801] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 815.134801] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 815.134801] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 815.134801] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c26b8d0b-5a65-4082-8dff-404228d547c4 already deleted. [ 815.134801] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c26b8d0b-5a65-4082-8dff-404228d547c4" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 815.231029] env[65370]: DEBUG networking_nsxv3.common.locking [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Lock network-735 taken with stack trace [, , , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 815.231313] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquiring lock "network-735" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 815.231483] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquired lock "network-735" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 815.231789] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquired external semaphore "network-735" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 815.236074] env[65370]: DEBUG networking_nsxv3.common.locking [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 815.237037] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquiring lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 815.237037] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquired lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 815.237403] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquired external semaphore "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 815.237696] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Releasing lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 815.238011] env[65370]: DEBUG dogpile.cache.region [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] No value present for key: 'zone-id' {{(pid=65370) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 815.238214] env[65370]: DEBUG dogpile.lock [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] NeedRegenerationException {{(pid=65370) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 815.238392] env[65370]: DEBUG dogpile.lock [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] no value, waiting for create lock {{(pid=65370) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 815.238736] env[65370]: DEBUG dogpile.lock [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] value creation lock acquired {{(pid=65370) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 815.238736] env[65370]: DEBUG dogpile.cache.region [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] No value present for key: 'zone-id' {{(pid=65370) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 815.239139] env[65370]: DEBUG dogpile.lock [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Calling creation function for not-yet-present value {{(pid=65370) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 815.239139] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 815.262461] env[65370]: INFO networking_nsxv3.common.synchronization [None req-047504a2-f88a-4f11-8008-40b0cd328733 tempest-AttachInterfacesUnderV243Test-197944153 tempest-AttachInterfacesUnderV243Test-197944153-project-member] Enqueued Resource ID: 84a5376d-c8c0-4dd2-bea4-f01f11567a72 with Priority: HIGHEST for action security_group_rules [ 815.264321] env[65370]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 84a5376d-c8c0-4dd2-bea4-f01f11567a72 with Priority: HIGHEST for action security_group_rules [ 815.264852] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock rules-84a5376d-c8c0-4dd2-bea4-f01f11567a72 taken with stack trace [, , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 815.265068] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-84a5376d-c8c0-4dd2-bea4-f01f11567a72" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 815.265191] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-84a5376d-c8c0-4dd2-bea4-f01f11567a72" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 815.265592] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-84a5376d-c8c0-4dd2-bea4-f01f11567a72" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 815.265756] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('84a5376d-c8c0-4dd2-bea4-f01f11567a72',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 815.288722] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 815.289058] env[65370]: DEBUG dogpile.cache.region [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Cache value generated in 0.050 seconds for key(s): 'zone-id' {{(pid=65370) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 815.289293] env[65370]: DEBUG dogpile.lock [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Released creation lock {{(pid=65370) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 815.289566] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Releasing lock "network-735" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 815.290186] env[65370]: DEBUG networking_nsxv3.common.locking [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Lock port-d64f14e0-a97b-49bd-adba-e51a01965440 taken with stack trace [, , , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 815.290494] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquiring lock "port-d64f14e0-a97b-49bd-adba-e51a01965440" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 815.290745] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquired lock "port-d64f14e0-a97b-49bd-adba-e51a01965440" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 815.291222] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquired external semaphore "port-d64f14e0-a97b-49bd-adba-e51a01965440" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 815.291834] env[65370]: DEBUG networking_nsxv3.api.rpc [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d64f14e0-a97b-49bd-adba-e51a01965440',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 815.422386] env[65370]: INFO networking_nsxv3.common.synchronization [None req-eea927c8-5095-48d9-8b5f-97a8b3484fb3 tempest-AttachInterfacesUnderV243Test-197944153 tempest-AttachInterfacesUnderV243Test-197944153-project-member] Enqueued Resource ID: 84a5376d-c8c0-4dd2-bea4-f01f11567a72 with Priority: HIGHEST for action security_group_rules [ 815.422386] env[65370]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 84a5376d-c8c0-4dd2-bea4-f01f11567a72 with Priority: HIGHEST for action security_group_rules [ 815.422386] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock rules-84a5376d-c8c0-4dd2-bea4-f01f11567a72 taken with stack trace [, , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 815.422386] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-84a5376d-c8c0-4dd2-bea4-f01f11567a72" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 815.514233] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0cacf152-a4d4-4487-a370-aa2bae090120 in Status: SUCCESS [ 815.514233] env[65370]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0cacf152-a4d4-4487-a370-aa2bae090120 deletion is rescheduled due to dependency. [ 815.514233] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0cacf152-a4d4-4487-a370-aa2bae090120" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 815.797299] env[65370]: DEBUG networking_nsxv3.common.locking [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 815.797459] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquiring lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 815.797459] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquired lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 815.797699] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquired external semaphore "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 815.797887] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Releasing lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 815.798197] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Segment Port d64f14e0-a97b-49bd-adba-e51a01965440 not found, creating... [ 815.798549] env[65370]: DEBUG networking_nsxv3.common.locking [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 815.798808] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquiring lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 815.799054] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquired lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 815.799351] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquired external semaphore "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 815.799498] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Releasing lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 815.799810] env[65370]: DEBUG networking_nsxv3.common.locking [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 815.799999] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquiring lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 815.800131] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquired lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 815.800357] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquired external semaphore "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 815.800494] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Releasing lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 815.800650] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Resource: SegmentPort with ID: d64f14e0-a97b-49bd-adba-e51a01965440 is going to be created. [ 815.808565] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 815.808803] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 815.808803] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 815.809051] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 815.809150] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 815.809246] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 84a5376d-c8c0-4dd2-bea4-f01f11567a72 already deleted. [ 815.809332] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-84a5376d-c8c0-4dd2-bea4-f01f11567a72" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 815.809487] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-84a5376d-c8c0-4dd2-bea4-f01f11567a72" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 815.809650] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-84a5376d-c8c0-4dd2-bea4-f01f11567a72" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 815.809750] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('84a5376d-c8c0-4dd2-bea4-f01f11567a72',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 815.853250] env[65370]: DEBUG networking_nsxv3.common.locking [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 815.853515] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquiring lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 815.853693] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquired lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 815.854038] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquired external semaphore "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 815.854279] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Releasing lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 815.854508] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Releasing lock "port-d64f14e0-a97b-49bd-adba-e51a01965440" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 816.338528] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 816.338528] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 816.338528] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 816.338528] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 816.338528] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 816.338528] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 84a5376d-c8c0-4dd2-bea4-f01f11567a72 already deleted. [ 816.338528] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-84a5376d-c8c0-4dd2-bea4-f01f11567a72" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 816.493919] env[65370]: INFO networking_nsxv3.common.synchronization [None req-b0f32b59-872c-4072-bc8f-dd233be85c74 None None] Enqueued Resource ID: 2c5f3a5f-1b70-4439-9249-0d17582d09be with Priority: HIGHEST for action port [ 816.495018] env[65370]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2c5f3a5f-1b70-4439-9249-0d17582d09be with Priority: HIGHEST for action port [ 816.497235] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock port-2c5f3a5f-1b70-4439-9249-0d17582d09be taken with stack trace [, , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 816.497235] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-2c5f3a5f-1b70-4439-9249-0d17582d09be" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 816.497235] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-2c5f3a5f-1b70-4439-9249-0d17582d09be" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 816.497235] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-2c5f3a5f-1b70-4439-9249-0d17582d09be" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 816.497235] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2c5f3a5f-1b70-4439-9249-0d17582d09be',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 816.538145] env[65370]: INFO networking_nsxv3.common.synchronization [req-bd790212-7db4-44d3-b418-5f25426d4b5c req-aff58376-f9fc-4175-9358-d17388511f1a service nova] Enqueued Resource ID: c26b8d0b-5a65-4082-8dff-404228d547c4 with Priority: HIGHEST for action security_group_rules [ 816.538145] env[65370]: INFO networking_nsxv3.common.synchronization [req-bd790212-7db4-44d3-b418-5f25426d4b5c req-aff58376-f9fc-4175-9358-d17388511f1a service nova] Enqueued Resource ID: c26b8d0b-5a65-4082-8dff-404228d547c4 with Priority: HIGHEST for action security_group_members [ 816.538145] env[65370]: INFO networking_nsxv3.common.synchronization [req-bd790212-7db4-44d3-b418-5f25426d4b5c req-aff58376-f9fc-4175-9358-d17388511f1a service nova] Enqueued Resource ID: d64f14e0-a97b-49bd-adba-e51a01965440 with Priority: HIGHEST for action port [ 816.538145] env[65370]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c26b8d0b-5a65-4082-8dff-404228d547c4 with Priority: HIGHEST for action security_group_rules [ 816.538900] env[65370]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c26b8d0b-5a65-4082-8dff-404228d547c4 with Priority: HIGHEST for action security_group_members [ 816.538900] env[65370]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d64f14e0-a97b-49bd-adba-e51a01965440 with Priority: HIGHEST for action port [ 816.539060] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock rules-c26b8d0b-5a65-4082-8dff-404228d547c4 taken with stack trace [, , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 816.539060] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-c26b8d0b-5a65-4082-8dff-404228d547c4" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 816.539182] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-c26b8d0b-5a65-4082-8dff-404228d547c4" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 816.539531] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-c26b8d0b-5a65-4082-8dff-404228d547c4" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 816.539667] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('c26b8d0b-5a65-4082-8dff-404228d547c4',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 816.541531] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock member-c26b8d0b-5a65-4082-8dff-404228d547c4 taken with stack trace [, , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 816.541667] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c26b8d0b-5a65-4082-8dff-404228d547c4" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 816.541765] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c26b8d0b-5a65-4082-8dff-404228d547c4" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 816.542063] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c26b8d0b-5a65-4082-8dff-404228d547c4" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 816.542336] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 816.542477] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 816.542599] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 816.542847] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 816.543015] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 816.543208] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c26b8d0b-5a65-4082-8dff-404228d547c4',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 816.544259] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock port-d64f14e0-a97b-49bd-adba-e51a01965440 taken with stack trace [, , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 816.544423] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-d64f14e0-a97b-49bd-adba-e51a01965440" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 816.544536] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-d64f14e0-a97b-49bd-adba-e51a01965440" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 816.545396] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-d64f14e0-a97b-49bd-adba-e51a01965440" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 816.545396] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d64f14e0-a97b-49bd-adba-e51a01965440',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 816.663819] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7960de7e-23b5-46db-b2ee-c5bd971f27a6 in Status: SUCCESS [ 816.664601] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-7960de7e-23b5-46db-b2ee-c5bd971f27a6" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 816.999302] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 2c5f3a5f-1b70-4439-9249-0d17582d09be [ 816.999302] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 816.999302] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 816.999302] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 816.999302] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 816.999302] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 816.999302] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:2c5f3a5f-1b70-4439-9249-0d17582d09be already deleted. [ 816.999302] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-2c5f3a5f-1b70-4439-9249-0d17582d09be" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 817.050174] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('c26b8d0b-5a65-4082-8dff-404228d547c4',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 817.050174] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock member-c26b8d0b-5a65-4082-8dff-404228d547c4 taken with stack trace [, , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 817.050174] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c26b8d0b-5a65-4082-8dff-404228d547c4" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 817.050174] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port d64f14e0-a97b-49bd-adba-e51a01965440 with status ACTIVE [ 817.050174] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 817.050174] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 817.050174] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 817.050951] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 817.050951] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 817.051999] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 817.052176] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 817.052363] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 817.052589] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 817.053154] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 817.053358] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 817.053508] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 817.053600] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 817.053808] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 817.054294] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 817.054424] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: d64f14e0-a97b-49bd-adba-e51a01965440 is going to be updated. [ 817.087428] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 817.087840] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 817.087935] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 817.088229] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 817.088496] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 817.088575] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-d64f14e0-a97b-49bd-adba-e51a01965440" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 817.110026] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ae63a79d-837f-4a55-a83c-bcd245828917 in Status: SUCCESS [ 817.110026] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ae63a79d-837f-4a55-a83c-bcd245828917" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 817.110026] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ae63a79d-837f-4a55-a83c-bcd245828917" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 817.110026] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ae63a79d-837f-4a55-a83c-bcd245828917" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 817.110026] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 817.110026] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 817.110026] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 817.110026] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 817.110026] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 817.110026] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ae63a79d-837f-4a55-a83c-bcd245828917" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 817.110026] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('ae63a79d-837f-4a55-a83c-bcd245828917',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 817.558020] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('c26b8d0b-5a65-4082-8dff-404228d547c4',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 817.615246] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock member-ae63a79d-837f-4a55-a83c-bcd245828917 taken with stack trace [, , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 817.615246] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ae63a79d-837f-4a55-a83c-bcd245828917" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 817.615246] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ae63a79d-837f-4a55-a83c-bcd245828917" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 817.615246] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ae63a79d-837f-4a55-a83c-bcd245828917" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 817.615246] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 817.615246] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 817.615246] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 817.615246] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 817.615246] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 817.615246] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ae63a79d-837f-4a55-a83c-bcd245828917" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 817.615246] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock member-ae63a79d-837f-4a55-a83c-bcd245828917 taken with stack trace [, , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 817.615246] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ae63a79d-837f-4a55-a83c-bcd245828917" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 817.615246] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ae63a79d-837f-4a55-a83c-bcd245828917" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 817.615246] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ae63a79d-837f-4a55-a83c-bcd245828917" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 817.615246] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 817.616090] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 817.616234] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 817.616418] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 817.616507] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 817.616597] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ae63a79d-837f-4a55-a83c-bcd245828917" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 817.616692] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('ae63a79d-837f-4a55-a83c-bcd245828917',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 818.061480] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 818.061480] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 818.061713] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 818.061755] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 818.061860] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 818.061985] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c26b8d0b-5a65-4082-8dff-404228d547c4 is going to be created. [ 818.098806] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 818.098806] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 818.099119] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 818.099119] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 818.099477] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 818.111825] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c26b8d0b-5a65-4082-8dff-404228d547c4 in Status: UNINITIALIZED for 2s [ 818.119433] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for ae63a79d-837f-4a55-a83c-bcd245828917: rpc.has_security_group_logging(os_id): False [ 818.145543] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 818.145543] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 818.145543] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 818.145543] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 818.145543] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 818.145781] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 818.145781] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 818.145864] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 818.146025] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 818.146083] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 818.146694] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 818.146694] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 818.146694] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 818.146694] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 818.146694] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 818.146936] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 818.146987] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 818.149101] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 818.149342] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 818.149450] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 818.149668] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: ae63a79d-837f-4a55-a83c-bcd245828917 is going to be created. [ 818.252819] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 818.253047] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 818.253116] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 818.253323] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 818.253513] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 818.270524] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ae63a79d-837f-4a55-a83c-bcd245828917 in Status: IN_PROGRESS for 2s [ 819.969890] env[65370]: INFO networking_nsxv3.common.synchronization [req-fa9e15fc-b2e0-4064-8723-646dad201d23 req-ba67400c-f0a1-43b3-9277-a933eb2131ef tempest-ServersTestMultiNic-1884782823 tempest-ServersTestMultiNic-1884782823-project-member] Enqueued Resource ID: 7960de7e-23b5-46db-b2ee-c5bd971f27a6 with Priority: HIGHEST for action security_group_members [ 819.971314] env[65370]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7960de7e-23b5-46db-b2ee-c5bd971f27a6 with Priority: HIGHEST for action security_group_members [ 819.972125] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock member-7960de7e-23b5-46db-b2ee-c5bd971f27a6 taken with stack trace [, , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 819.972125] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7960de7e-23b5-46db-b2ee-c5bd971f27a6" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 819.972125] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7960de7e-23b5-46db-b2ee-c5bd971f27a6" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 819.972353] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7960de7e-23b5-46db-b2ee-c5bd971f27a6" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 819.972483] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 819.972741] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 819.972809] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 819.973058] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 819.973264] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 819.973394] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7960de7e-23b5-46db-b2ee-c5bd971f27a6',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 820.132983] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c26b8d0b-5a65-4082-8dff-404228d547c4 in Status: SUCCESS [ 820.132983] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c26b8d0b-5a65-4082-8dff-404228d547c4" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 820.132983] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c26b8d0b-5a65-4082-8dff-404228d547c4" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 820.132983] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c26b8d0b-5a65-4082-8dff-404228d547c4" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 820.132983] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 820.132983] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 820.133314] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 820.134858] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 820.134958] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 820.135574] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c26b8d0b-5a65-4082-8dff-404228d547c4" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 820.135574] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('c26b8d0b-5a65-4082-8dff-404228d547c4',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 820.253861] env[65370]: INFO networking_nsxv3.common.synchronization [req-fa9e15fc-b2e0-4064-8723-646dad201d23 req-7b4fb593-1dda-4682-b3de-f5e2c5c3758e tempest-ServersTestMultiNic-1884782823 tempest-ServersTestMultiNic-1884782823-project-member] Enqueued Resource ID: 7960de7e-23b5-46db-b2ee-c5bd971f27a6 with Priority: HIGHEST for action security_group_members [ 820.254479] env[65370]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7960de7e-23b5-46db-b2ee-c5bd971f27a6 with Priority: HIGHEST for action security_group_members [ 820.256898] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock member-7960de7e-23b5-46db-b2ee-c5bd971f27a6 taken with stack trace [, , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 820.256898] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7960de7e-23b5-46db-b2ee-c5bd971f27a6" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 820.288734] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ae63a79d-837f-4a55-a83c-bcd245828917 in Status: SUCCESS [ 820.289289] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-ae63a79d-837f-4a55-a83c-bcd245828917" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 820.477516] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('7960de7e-23b5-46db-b2ee-c5bd971f27a6',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 820.505046] env[65370]: INFO networking_nsxv3.common.synchronization [req-fa9e15fc-b2e0-4064-8723-646dad201d23 req-f3f54206-12b6-4902-b8c1-2379b6cf8e4a tempest-ServersTestMultiNic-1884782823 tempest-ServersTestMultiNic-1884782823-project-member] Enqueued Resource ID: 7960de7e-23b5-46db-b2ee-c5bd971f27a6 with Priority: HIGHEST for action security_group_members [ 820.505310] env[65370]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7960de7e-23b5-46db-b2ee-c5bd971f27a6 with Priority: HIGHEST for action security_group_members [ 820.505654] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock member-7960de7e-23b5-46db-b2ee-c5bd971f27a6 taken with stack trace [, , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 820.505821] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7960de7e-23b5-46db-b2ee-c5bd971f27a6" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 820.640028] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('c26b8d0b-5a65-4082-8dff-404228d547c4',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 820.987934] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('7960de7e-23b5-46db-b2ee-c5bd971f27a6',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 821.142429] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for c26b8d0b-5a65-4082-8dff-404228d547c4: rpc.has_security_group_logging(os_id): False [ 821.173398] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 821.173398] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 821.173398] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 821.173398] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 821.173398] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 821.173398] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 821.173398] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 821.173398] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 821.173398] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 821.173890] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 821.174488] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: c26b8d0b-5a65-4082-8dff-404228d547c4 is going to be created. [ 821.292942] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 821.293145] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 821.293291] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 821.293885] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 821.293973] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 821.325956] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c26b8d0b-5a65-4082-8dff-404228d547c4 in Status: IN_PROGRESS for 2s [ 821.488833] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 821.489070] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 821.489182] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 821.489387] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 821.489508] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 821.489635] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7960de7e-23b5-46db-b2ee-c5bd971f27a6 is going to be updated. [ 821.557351] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 821.557619] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 821.557732] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 821.558084] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 821.558358] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 821.579554] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7960de7e-23b5-46db-b2ee-c5bd971f27a6 in Status: IN_PROGRESS for 2s [ 821.714520] env[65370]: INFO networking_nsxv3.common.synchronization [None req-64355d4a-2110-44cd-af23-ad8f112a939e tempest-ServerActionsTestOtherA-1239332614 tempest-ServerActionsTestOtherA-1239332614-project-member] Enqueued Resource ID: f37147a2-7642-4b7c-a970-ffec078fbee9 with Priority: HIGHEST for action security_group_rules [ 821.714883] env[65370]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f37147a2-7642-4b7c-a970-ffec078fbee9 with Priority: HIGHEST for action security_group_rules [ 821.715232] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock rules-f37147a2-7642-4b7c-a970-ffec078fbee9 taken with stack trace [, , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 821.715375] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-f37147a2-7642-4b7c-a970-ffec078fbee9" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 821.715459] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-f37147a2-7642-4b7c-a970-ffec078fbee9" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 821.715681] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-f37147a2-7642-4b7c-a970-ffec078fbee9" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 821.715836] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('f37147a2-7642-4b7c-a970-ffec078fbee9',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 821.825250] env[65370]: INFO networking_nsxv3.common.synchronization [None req-786dbdba-f46e-48dc-a747-9fcf19499693 tempest-ServerActionsTestOtherA-1239332614 tempest-ServerActionsTestOtherA-1239332614-project-member] Enqueued Resource ID: f37147a2-7642-4b7c-a970-ffec078fbee9 with Priority: HIGHEST for action security_group_rules [ 821.826285] env[65370]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f37147a2-7642-4b7c-a970-ffec078fbee9 with Priority: HIGHEST for action security_group_rules [ 821.827433] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock rules-f37147a2-7642-4b7c-a970-ffec078fbee9 taken with stack trace [, , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 821.829195] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-f37147a2-7642-4b7c-a970-ffec078fbee9" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 822.251907] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 822.251907] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 822.251907] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 822.251907] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 822.251907] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 822.251907] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: f37147a2-7642-4b7c-a970-ffec078fbee9 already deleted. [ 822.251907] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-f37147a2-7642-4b7c-a970-ffec078fbee9" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 822.251907] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-f37147a2-7642-4b7c-a970-ffec078fbee9" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 822.251907] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-f37147a2-7642-4b7c-a970-ffec078fbee9" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 822.251907] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('f37147a2-7642-4b7c-a970-ffec078fbee9',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 822.754901] env[65370]: INFO networking_nsxv3.common.synchronization [req-584d2a2a-1d2b-4b60-a457-d681d2fff945 req-1c44cd62-debf-4246-95d6-8a87a37432da tempest-ServerActionsTestJSON-720598601 tempest-ServerActionsTestJSON-720598601-project-member] Enqueued Resource ID: fe248172-4be4-4d95-a8ca-c9c2ef203894 with Priority: HIGHEST for action security_group_members [ 822.754901] env[65370]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fe248172-4be4-4d95-a8ca-c9c2ef203894 with Priority: HIGHEST for action security_group_members [ 822.760442] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock member-fe248172-4be4-4d95-a8ca-c9c2ef203894 taken with stack trace [, , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 822.760766] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fe248172-4be4-4d95-a8ca-c9c2ef203894" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 822.760766] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fe248172-4be4-4d95-a8ca-c9c2ef203894" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 822.760961] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fe248172-4be4-4d95-a8ca-c9c2ef203894" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 822.761207] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 822.761311] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 822.761311] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 822.761441] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 822.761524] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 822.761619] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('fe248172-4be4-4d95-a8ca-c9c2ef203894',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 822.782755] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 822.783224] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 822.783224] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 822.783224] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 822.783399] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 822.783399] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: f37147a2-7642-4b7c-a970-ffec078fbee9 already deleted. [ 822.783462] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-f37147a2-7642-4b7c-a970-ffec078fbee9" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 823.153534] env[65370]: DEBUG networking_nsxv3.common.locking [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Lock network-609 taken with stack trace [, , , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 823.153717] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquiring lock "network-609" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 823.153986] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquired lock "network-609" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 823.154219] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquired external semaphore "network-609" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 823.154636] env[65370]: DEBUG networking_nsxv3.common.locking [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 823.154910] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquiring lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 823.155117] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquired lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 823.156068] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquired external semaphore "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 823.156409] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Releasing lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 823.156504] env[65370]: DEBUG dogpile.cache.region [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] No value present for key: 'zone-id' {{(pid=65370) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 823.156590] env[65370]: DEBUG dogpile.lock [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] NeedRegenerationException {{(pid=65370) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 823.156955] env[65370]: DEBUG dogpile.lock [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] no value, waiting for create lock {{(pid=65370) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 823.156955] env[65370]: DEBUG dogpile.lock [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] value creation lock acquired {{(pid=65370) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 823.157194] env[65370]: DEBUG dogpile.cache.region [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] No value present for key: 'zone-id' {{(pid=65370) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 823.157316] env[65370]: DEBUG dogpile.lock [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Calling creation function for not-yet-present value {{(pid=65370) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 823.157531] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 823.182014] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 823.182151] env[65370]: DEBUG dogpile.cache.region [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Cache value generated in 0.025 seconds for key(s): 'zone-id' {{(pid=65370) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 823.182333] env[65370]: DEBUG dogpile.lock [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Released creation lock {{(pid=65370) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 823.182912] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Releasing lock "network-609" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 823.182912] env[65370]: DEBUG networking_nsxv3.common.locking [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Lock port-eb477aac-94d7-4699-97ef-75f53c8ac3f3 taken with stack trace [, , , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 823.183205] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquiring lock "port-eb477aac-94d7-4699-97ef-75f53c8ac3f3" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 823.183205] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquired lock "port-eb477aac-94d7-4699-97ef-75f53c8ac3f3" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 823.183413] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquired external semaphore "port-eb477aac-94d7-4699-97ef-75f53c8ac3f3" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 823.183549] env[65370]: DEBUG networking_nsxv3.api.rpc [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('eb477aac-94d7-4699-97ef-75f53c8ac3f3',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 823.265708] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 823.265708] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 823.265708] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 823.265708] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 823.265708] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 823.265708] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 823.265708] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 823.265708] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 823.266749] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 823.266749] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 823.266749] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: fe248172-4be4-4d95-a8ca-c9c2ef203894 already deleted. [ 823.266749] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fe248172-4be4-4d95-a8ca-c9c2ef203894" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 823.340917] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c26b8d0b-5a65-4082-8dff-404228d547c4 in Status: SUCCESS [ 823.341286] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-c26b8d0b-5a65-4082-8dff-404228d547c4" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 823.593572] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7960de7e-23b5-46db-b2ee-c5bd971f27a6 in Status: SUCCESS [ 823.593572] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7960de7e-23b5-46db-b2ee-c5bd971f27a6" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 823.593572] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7960de7e-23b5-46db-b2ee-c5bd971f27a6" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 823.593572] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7960de7e-23b5-46db-b2ee-c5bd971f27a6" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 823.593572] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 823.593572] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 823.593572] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 823.593572] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 823.593572] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 823.593572] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7960de7e-23b5-46db-b2ee-c5bd971f27a6',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 823.686294] env[65370]: DEBUG networking_nsxv3.common.locking [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 823.686561] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquiring lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 823.689109] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquired lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 823.689109] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquired external semaphore "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 823.689109] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Releasing lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 823.689109] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Segment Port eb477aac-94d7-4699-97ef-75f53c8ac3f3 not found, creating... [ 823.689109] env[65370]: DEBUG networking_nsxv3.common.locking [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 823.689109] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquiring lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 823.689109] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquired lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 823.689109] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquired external semaphore "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 823.689109] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Releasing lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 823.689109] env[65370]: DEBUG networking_nsxv3.common.locking [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 823.689544] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquiring lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 823.689544] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquired lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 823.689544] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquired external semaphore "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 823.689544] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Releasing lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 823.689544] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Resource: SegmentPort with ID: eb477aac-94d7-4699-97ef-75f53c8ac3f3 is going to be created. [ 823.724559] env[65370]: DEBUG networking_nsxv3.common.locking [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 823.724779] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquiring lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 823.724902] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquired lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 823.725228] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquired external semaphore "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 823.725434] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Releasing lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 823.725974] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Releasing lock "port-eb477aac-94d7-4699-97ef-75f53c8ac3f3" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 824.096282] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 824.096479] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 824.096479] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 824.096690] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 824.096875] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 824.097143] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 824.097275] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 824.097382] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 824.097557] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 824.097657] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 824.097757] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7960de7e-23b5-46db-b2ee-c5bd971f27a6 is going to be updated. [ 824.200297] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 824.200489] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 824.200534] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 824.201318] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 824.201318] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 824.217537] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7960de7e-23b5-46db-b2ee-c5bd971f27a6 in Status: IN_PROGRESS for 2s [ 824.605598] env[65370]: INFO networking_nsxv3.common.synchronization [req-584d2a2a-1d2b-4b60-a457-d681d2fff945 req-d20b1c20-d328-4dc3-9a3e-bc3b058bc1f6 service nova] Enqueued Resource ID: fe248172-4be4-4d95-a8ca-c9c2ef203894 with Priority: HIGHEST for action security_group_rules [ 824.605998] env[65370]: INFO networking_nsxv3.common.synchronization [req-584d2a2a-1d2b-4b60-a457-d681d2fff945 req-d20b1c20-d328-4dc3-9a3e-bc3b058bc1f6 service nova] Enqueued Resource ID: fe248172-4be4-4d95-a8ca-c9c2ef203894 with Priority: HIGHEST for action security_group_members [ 824.605998] env[65370]: INFO networking_nsxv3.common.synchronization [req-584d2a2a-1d2b-4b60-a457-d681d2fff945 req-d20b1c20-d328-4dc3-9a3e-bc3b058bc1f6 service nova] Enqueued Resource ID: eb477aac-94d7-4699-97ef-75f53c8ac3f3 with Priority: HIGHEST for action port [ 824.606545] env[65370]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fe248172-4be4-4d95-a8ca-c9c2ef203894 with Priority: HIGHEST for action security_group_rules [ 824.606712] env[65370]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fe248172-4be4-4d95-a8ca-c9c2ef203894 with Priority: HIGHEST for action security_group_members [ 824.606836] env[65370]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: eb477aac-94d7-4699-97ef-75f53c8ac3f3 with Priority: HIGHEST for action port [ 824.608545] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock rules-fe248172-4be4-4d95-a8ca-c9c2ef203894 taken with stack trace [, , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 824.608687] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-fe248172-4be4-4d95-a8ca-c9c2ef203894" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 824.608753] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-fe248172-4be4-4d95-a8ca-c9c2ef203894" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 824.609203] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-fe248172-4be4-4d95-a8ca-c9c2ef203894" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 824.609290] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('fe248172-4be4-4d95-a8ca-c9c2ef203894',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 824.610825] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock member-fe248172-4be4-4d95-a8ca-c9c2ef203894 taken with stack trace [, , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 824.610998] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fe248172-4be4-4d95-a8ca-c9c2ef203894" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 824.611059] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fe248172-4be4-4d95-a8ca-c9c2ef203894" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 824.611358] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fe248172-4be4-4d95-a8ca-c9c2ef203894" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 824.611525] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 824.611642] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 824.611702] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 824.611864] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 824.611938] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 824.612048] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('fe248172-4be4-4d95-a8ca-c9c2ef203894',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 824.612945] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock port-eb477aac-94d7-4699-97ef-75f53c8ac3f3 taken with stack trace [, , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 824.613065] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-eb477aac-94d7-4699-97ef-75f53c8ac3f3" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 824.613115] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-eb477aac-94d7-4699-97ef-75f53c8ac3f3" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 824.613291] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-eb477aac-94d7-4699-97ef-75f53c8ac3f3" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 824.613356] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('eb477aac-94d7-4699-97ef-75f53c8ac3f3',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 825.111459] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock member-fe248172-4be4-4d95-a8ca-c9c2ef203894 taken with stack trace [, , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 825.111643] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fe248172-4be4-4d95-a8ca-c9c2ef203894" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 825.117584] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port eb477aac-94d7-4699-97ef-75f53c8ac3f3 with status ACTIVE [ 825.118800] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 825.118800] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 825.118800] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 825.118800] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 825.118800] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 825.118800] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 825.118800] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 825.118800] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 825.119299] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 825.119299] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 825.119299] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 825.119299] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 825.119299] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 825.119512] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 825.119558] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 825.119642] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: eb477aac-94d7-4699-97ef-75f53c8ac3f3 is going to be updated. [ 825.120845] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('fe248172-4be4-4d95-a8ca-c9c2ef203894',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 825.145388] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 825.145613] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 825.145613] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 825.145982] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 825.146069] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 825.146230] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-eb477aac-94d7-4699-97ef-75f53c8ac3f3" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 825.624439] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('fe248172-4be4-4d95-a8ca-c9c2ef203894',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 826.127538] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 826.127662] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 826.127662] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 826.127879] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 826.127963] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 826.128071] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: fe248172-4be4-4d95-a8ca-c9c2ef203894 is going to be created. [ 826.176680] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 826.176904] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 826.176904] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 826.177892] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 826.177892] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 826.191022] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fe248172-4be4-4d95-a8ca-c9c2ef203894 in Status: UNINITIALIZED for 2s [ 826.231739] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7960de7e-23b5-46db-b2ee-c5bd971f27a6 in Status: SUCCESS [ 826.232027] env[65370]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7960de7e-23b5-46db-b2ee-c5bd971f27a6 deletion is rescheduled due to dependency. [ 826.232221] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7960de7e-23b5-46db-b2ee-c5bd971f27a6" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 826.232456] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7960de7e-23b5-46db-b2ee-c5bd971f27a6" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 826.232946] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7960de7e-23b5-46db-b2ee-c5bd971f27a6" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 826.232946] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 826.233142] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 826.233219] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 826.233365] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 826.233463] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 826.233567] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7960de7e-23b5-46db-b2ee-c5bd971f27a6',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 826.740391] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 826.740391] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 826.740391] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 826.740391] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 826.740391] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 826.740391] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 826.740391] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 826.740391] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 826.740391] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 826.740391] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 826.740391] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7960de7e-23b5-46db-b2ee-c5bd971f27a6 is going to be updated. [ 826.783365] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 826.783365] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 826.783365] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 826.783365] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 826.783365] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 826.799534] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7960de7e-23b5-46db-b2ee-c5bd971f27a6 in Status: IN_PROGRESS for 2s [ 827.813187] env[65370]: INFO networking_nsxv3.common.synchronization [req-8780da5c-31ee-4200-ba46-0d776cbd42d5 req-2bc6496c-8aaa-43fd-ad25-2b702524e73b tempest-ServerDiskConfigTestJSON-902849627 tempest-ServerDiskConfigTestJSON-902849627-project-member] Enqueued Resource ID: 420136f3-91df-4669-b5e3-cee436aeacb9 with Priority: HIGHEST for action security_group_members [ 827.813589] env[65370]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 420136f3-91df-4669-b5e3-cee436aeacb9 with Priority: HIGHEST for action security_group_members [ 827.813919] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock member-420136f3-91df-4669-b5e3-cee436aeacb9 taken with stack trace [, , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.814183] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-420136f3-91df-4669-b5e3-cee436aeacb9" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.814299] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-420136f3-91df-4669-b5e3-cee436aeacb9" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 827.814470] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-420136f3-91df-4669-b5e3-cee436aeacb9" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 827.814626] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.814729] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.814801] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 827.815077] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 827.815077] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 827.815192] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('420136f3-91df-4669-b5e3-cee436aeacb9',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 828.198830] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fe248172-4be4-4d95-a8ca-c9c2ef203894 in Status: SUCCESS [ 828.199018] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fe248172-4be4-4d95-a8ca-c9c2ef203894" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 828.199166] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fe248172-4be4-4d95-a8ca-c9c2ef203894" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 828.199385] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fe248172-4be4-4d95-a8ca-c9c2ef203894" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 828.199584] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 828.199696] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 828.199762] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 828.199892] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 828.199974] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 828.200157] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fe248172-4be4-4d95-a8ca-c9c2ef203894" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 828.200157] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('fe248172-4be4-4d95-a8ca-c9c2ef203894',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 828.210838] env[65370]: DEBUG networking_nsxv3.common.locking [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Lock network-974 taken with stack trace [, , , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 828.210838] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquiring lock "network-974" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 828.210838] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquired lock "network-974" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 828.211058] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquired external semaphore "network-974" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 828.211249] env[65370]: DEBUG networking_nsxv3.common.locking [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 828.211397] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquiring lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 828.211506] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquired lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 828.211704] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquired external semaphore "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 828.211840] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Releasing lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 828.212049] env[65370]: DEBUG dogpile.cache.region [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] No value present for key: 'zone-id' {{(pid=65370) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 828.212153] env[65370]: DEBUG dogpile.lock [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] NeedRegenerationException {{(pid=65370) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 828.212256] env[65370]: DEBUG dogpile.lock [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] no value, waiting for create lock {{(pid=65370) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 828.212355] env[65370]: DEBUG dogpile.lock [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] value creation lock acquired {{(pid=65370) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 828.212453] env[65370]: DEBUG dogpile.cache.region [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] No value present for key: 'zone-id' {{(pid=65370) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 828.212548] env[65370]: DEBUG dogpile.lock [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Calling creation function for not-yet-present value {{(pid=65370) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 828.212666] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 828.232474] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 828.232629] env[65370]: DEBUG dogpile.cache.region [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=65370) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 828.232775] env[65370]: DEBUG dogpile.lock [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Released creation lock {{(pid=65370) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 828.232949] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Releasing lock "network-974" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 828.233378] env[65370]: DEBUG networking_nsxv3.common.locking [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Lock port-4bb8ee6e-c123-4736-926d-3acd16128f9a taken with stack trace [, , , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 828.233640] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquiring lock "port-4bb8ee6e-c123-4736-926d-3acd16128f9a" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 828.233863] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquired lock "port-4bb8ee6e-c123-4736-926d-3acd16128f9a" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 828.234195] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquired external semaphore "port-4bb8ee6e-c123-4736-926d-3acd16128f9a" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 828.234319] env[65370]: DEBUG networking_nsxv3.api.rpc [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4bb8ee6e-c123-4736-926d-3acd16128f9a',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 828.317739] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 828.317953] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 828.317953] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 828.318201] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 828.318295] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 828.318489] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 828.318587] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 828.318688] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 828.318789] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 828.318866] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 828.318957] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 420136f3-91df-4669-b5e3-cee436aeacb9 is going to be deleted. [ 828.350616] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 828.350786] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 828.350844] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 828.351063] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 828.351220] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 828.351283] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-420136f3-91df-4669-b5e3-cee436aeacb9" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 828.702941] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('fe248172-4be4-4d95-a8ca-c9c2ef203894',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 828.736705] env[65370]: DEBUG networking_nsxv3.common.locking [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 828.737317] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquiring lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 828.737486] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquired lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 828.737767] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquired external semaphore "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 828.737916] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Releasing lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 828.739210] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Segment Port 4bb8ee6e-c123-4736-926d-3acd16128f9a not found, creating... [ 828.739210] env[65370]: DEBUG networking_nsxv3.common.locking [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 828.739210] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquiring lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 828.739210] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquired lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 828.739210] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquired external semaphore "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 828.739210] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Releasing lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 828.739456] env[65370]: DEBUG networking_nsxv3.common.locking [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 828.739456] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquiring lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 828.740719] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquired lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 828.740719] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquired external semaphore "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 828.740719] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Releasing lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 828.740719] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Resource: SegmentPort with ID: 4bb8ee6e-c123-4736-926d-3acd16128f9a is going to be created. [ 828.770558] env[65370]: DEBUG networking_nsxv3.common.locking [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 828.770819] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquiring lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 828.770942] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquired lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 828.771244] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquired external semaphore "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 828.771473] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Releasing lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 828.771696] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Releasing lock "port-4bb8ee6e-c123-4736-926d-3acd16128f9a" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 828.815223] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7960de7e-23b5-46db-b2ee-c5bd971f27a6 in Status: SUCCESS [ 828.815223] env[65370]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7960de7e-23b5-46db-b2ee-c5bd971f27a6 deletion is rescheduled due to dependency. [ 828.815577] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7960de7e-23b5-46db-b2ee-c5bd971f27a6" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 829.206316] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for fe248172-4be4-4d95-a8ca-c9c2ef203894: rpc.has_security_group_logging(os_id): False [ 829.230682] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 829.230935] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 829.231039] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 829.231289] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 829.231385] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 829.231667] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 829.231787] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 829.231856] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 829.232296] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 829.232430] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 829.232570] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: fe248172-4be4-4d95-a8ca-c9c2ef203894 is going to be created. [ 829.308548] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 829.308548] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 829.308548] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 829.308798] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 829.308928] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 829.322066] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: fe248172-4be4-4d95-a8ca-c9c2ef203894 in Status: IN_PROGRESS for 2s [ 829.514883] env[65370]: INFO networking_nsxv3.common.synchronization [req-8780da5c-31ee-4200-ba46-0d776cbd42d5 req-5119df70-3df5-4a03-8147-c306c5be4096 service nova] Enqueued Resource ID: 420136f3-91df-4669-b5e3-cee436aeacb9 with Priority: HIGHEST for action security_group_rules [ 829.515036] env[65370]: INFO networking_nsxv3.common.synchronization [req-8780da5c-31ee-4200-ba46-0d776cbd42d5 req-5119df70-3df5-4a03-8147-c306c5be4096 service nova] Enqueued Resource ID: 420136f3-91df-4669-b5e3-cee436aeacb9 with Priority: HIGHEST for action security_group_members [ 829.516783] env[65370]: INFO networking_nsxv3.common.synchronization [req-8780da5c-31ee-4200-ba46-0d776cbd42d5 req-5119df70-3df5-4a03-8147-c306c5be4096 service nova] Enqueued Resource ID: 4bb8ee6e-c123-4736-926d-3acd16128f9a with Priority: HIGHEST for action port [ 829.517612] env[65370]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 420136f3-91df-4669-b5e3-cee436aeacb9 with Priority: HIGHEST for action security_group_rules [ 829.517855] env[65370]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 420136f3-91df-4669-b5e3-cee436aeacb9 with Priority: HIGHEST for action security_group_members [ 829.518049] env[65370]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4bb8ee6e-c123-4736-926d-3acd16128f9a with Priority: HIGHEST for action port [ 829.518495] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock rules-420136f3-91df-4669-b5e3-cee436aeacb9 taken with stack trace [, , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 829.518687] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-420136f3-91df-4669-b5e3-cee436aeacb9" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 829.519089] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-420136f3-91df-4669-b5e3-cee436aeacb9" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 829.519159] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-420136f3-91df-4669-b5e3-cee436aeacb9" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 829.519273] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('420136f3-91df-4669-b5e3-cee436aeacb9',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 829.521036] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock member-420136f3-91df-4669-b5e3-cee436aeacb9 taken with stack trace [, , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 829.521036] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-420136f3-91df-4669-b5e3-cee436aeacb9" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 829.521036] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-420136f3-91df-4669-b5e3-cee436aeacb9" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 829.521294] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-420136f3-91df-4669-b5e3-cee436aeacb9" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 829.521565] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 829.521721] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 829.521888] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 829.522147] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 829.522255] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 829.522413] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('420136f3-91df-4669-b5e3-cee436aeacb9',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 829.524031] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock port-4bb8ee6e-c123-4736-926d-3acd16128f9a taken with stack trace [, , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 829.524031] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-4bb8ee6e-c123-4736-926d-3acd16128f9a" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 829.524031] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-4bb8ee6e-c123-4736-926d-3acd16128f9a" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 829.524031] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-4bb8ee6e-c123-4736-926d-3acd16128f9a" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 829.524031] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4bb8ee6e-c123-4736-926d-3acd16128f9a',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 830.026180] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock member-420136f3-91df-4669-b5e3-cee436aeacb9 taken with stack trace [, , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 830.026556] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-420136f3-91df-4669-b5e3-cee436aeacb9" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 830.026556] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('420136f3-91df-4669-b5e3-cee436aeacb9',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 830.029618] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 4bb8ee6e-c123-4736-926d-3acd16128f9a with status ACTIVE [ 830.029618] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 830.029618] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 830.029618] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 830.029806] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 830.029806] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 830.029966] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 830.030070] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 830.030196] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 830.030266] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 830.030566] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 830.030566] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 830.030681] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 830.030681] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 830.030881] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 830.030922] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 830.030995] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 4bb8ee6e-c123-4736-926d-3acd16128f9a is going to be updated. [ 830.068868] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 830.069166] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 830.069166] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 830.069501] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 830.069729] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 830.070011] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-4bb8ee6e-c123-4736-926d-3acd16128f9a" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 830.529098] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('420136f3-91df-4669-b5e3-cee436aeacb9',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 831.032657] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 831.032657] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 831.032657] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 831.032657] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 831.032657] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 831.033168] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 420136f3-91df-4669-b5e3-cee436aeacb9 is going to be created. [ 831.062512] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 831.062671] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 831.062727] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 831.063062] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 831.063244] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 831.073447] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 420136f3-91df-4669-b5e3-cee436aeacb9 in Status: UNINITIALIZED for 2s [ 831.338930] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: fe248172-4be4-4d95-a8ca-c9c2ef203894 in Status: SUCCESS [ 831.339202] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-fe248172-4be4-4d95-a8ca-c9c2ef203894" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 833.084401] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 420136f3-91df-4669-b5e3-cee436aeacb9 in Status: SUCCESS [ 833.084834] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-420136f3-91df-4669-b5e3-cee436aeacb9" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 833.084834] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-420136f3-91df-4669-b5e3-cee436aeacb9" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 833.084939] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-420136f3-91df-4669-b5e3-cee436aeacb9" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 833.085143] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 833.085275] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 833.085334] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 833.085487] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 833.085567] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 833.085652] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-420136f3-91df-4669-b5e3-cee436aeacb9" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 833.085737] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('420136f3-91df-4669-b5e3-cee436aeacb9',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 833.588665] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock member-420136f3-91df-4669-b5e3-cee436aeacb9 taken with stack trace [, , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 833.588803] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-420136f3-91df-4669-b5e3-cee436aeacb9" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 833.588803] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-420136f3-91df-4669-b5e3-cee436aeacb9" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 833.588987] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-420136f3-91df-4669-b5e3-cee436aeacb9" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 833.589178] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 833.589306] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 833.589365] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 833.589477] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 833.589557] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 833.589644] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-420136f3-91df-4669-b5e3-cee436aeacb9" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 833.589791] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock member-420136f3-91df-4669-b5e3-cee436aeacb9 taken with stack trace [, , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 833.589884] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-420136f3-91df-4669-b5e3-cee436aeacb9" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 833.589938] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-420136f3-91df-4669-b5e3-cee436aeacb9" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 833.590092] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-420136f3-91df-4669-b5e3-cee436aeacb9" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 833.590227] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 833.590348] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 833.590435] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 833.590638] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 833.590758] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 833.590864] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-420136f3-91df-4669-b5e3-cee436aeacb9" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 833.590960] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('420136f3-91df-4669-b5e3-cee436aeacb9',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 834.094086] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 420136f3-91df-4669-b5e3-cee436aeacb9: rpc.has_security_group_logging(os_id): False [ 834.113042] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 834.113232] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 834.113297] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 834.113487] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 834.113569] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 834.113758] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 834.113867] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 834.113913] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 834.114071] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 834.114147] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 834.114345] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 834.114474] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 834.114615] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 834.114615] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 834.114683] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 834.114910] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 834.114969] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 834.115167] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 834.115167] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 834.115320] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 834.115320] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 420136f3-91df-4669-b5e3-cee436aeacb9 is going to be created. [ 834.184073] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 834.184260] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 834.184302] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 834.184612] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 834.184735] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 834.228900] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 420136f3-91df-4669-b5e3-cee436aeacb9 in Status: IN_PROGRESS for 2s [ 834.519491] env[65370]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 834.519687] env[65370]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=1 [ 834.803969] env[65370]: INFO networking_nsxv3.common.synchronization [req-feb5438f-1940-451a-b064-0598540dd631 req-170d9b28-1ca1-47f1-94c7-f82c37e31d0d tempest-ServersAdminTestJSON-387254877 tempest-ServersAdminTestJSON-387254877-project-member] Enqueued Resource ID: feaf18c3-295c-41df-89f1-309931cdeca1 with Priority: HIGHEST for action security_group_members [ 834.804507] env[65370]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: feaf18c3-295c-41df-89f1-309931cdeca1 with Priority: HIGHEST for action security_group_members [ 834.805032] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock member-feaf18c3-295c-41df-89f1-309931cdeca1 taken with stack trace [, , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 834.805032] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-feaf18c3-295c-41df-89f1-309931cdeca1" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 834.805384] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-feaf18c3-295c-41df-89f1-309931cdeca1" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 834.805384] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-feaf18c3-295c-41df-89f1-309931cdeca1" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 834.805469] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 834.805757] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 834.805875] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 834.806121] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 834.806221] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 834.806378] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('feaf18c3-295c-41df-89f1-309931cdeca1',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 835.309054] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('feaf18c3-295c-41df-89f1-309931cdeca1',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 835.811452] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('feaf18c3-295c-41df-89f1-309931cdeca1',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 836.248231] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 420136f3-91df-4669-b5e3-cee436aeacb9 in Status: SUCCESS [ 836.248381] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-420136f3-91df-4669-b5e3-cee436aeacb9" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 836.315570] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 836.316013] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 836.316013] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 836.316229] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 836.318080] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 836.318232] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: feaf18c3-295c-41df-89f1-309931cdeca1 is going to be updated. [ 836.359886] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 836.360147] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 836.360147] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 836.360407] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 836.360512] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 836.371491] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: feaf18c3-295c-41df-89f1-309931cdeca1 in Status: IN_PROGRESS for 2s [ 838.157056] env[65370]: INFO networking_nsxv3.common.synchronization [req-c886cc11-1160-4402-8a60-f8fd4fbc7c87 req-9c80a8b2-9426-4e49-81e3-2f7ec0d94484 tempest-ListImageFiltersTestJSON-1988219331 tempest-ListImageFiltersTestJSON-1988219331-project-member] Enqueued Resource ID: e4c5be7e-6c74-44a0-bf7b-9581ec4636c2 with Priority: HIGHEST for action security_group_members [ 838.157056] env[65370]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e4c5be7e-6c74-44a0-bf7b-9581ec4636c2 with Priority: HIGHEST for action security_group_members [ 838.157056] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock member-e4c5be7e-6c74-44a0-bf7b-9581ec4636c2 taken with stack trace [, , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 838.157056] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e4c5be7e-6c74-44a0-bf7b-9581ec4636c2" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 838.157056] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e4c5be7e-6c74-44a0-bf7b-9581ec4636c2" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 838.157880] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e4c5be7e-6c74-44a0-bf7b-9581ec4636c2" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 838.157880] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 838.157880] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 838.157880] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 838.157880] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 838.157880] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 838.157880] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e4c5be7e-6c74-44a0-bf7b-9581ec4636c2',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 838.386460] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: feaf18c3-295c-41df-89f1-309931cdeca1 in Status: SUCCESS [ 838.386460] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-feaf18c3-295c-41df-89f1-309931cdeca1" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 838.666203] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 838.666366] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 838.666412] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 838.667126] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 838.696645] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 838.697161] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 838.697308] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 838.697358] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 838.697785] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 838.697878] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 838.697960] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e4c5be7e-6c74-44a0-bf7b-9581ec4636c2 is going to be updated. [ 838.773807] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 838.774059] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 838.774059] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 838.774271] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 838.774415] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 838.785237] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e4c5be7e-6c74-44a0-bf7b-9581ec4636c2 in Status: IN_PROGRESS for 2s [ 840.795318] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e4c5be7e-6c74-44a0-bf7b-9581ec4636c2 in Status: SUCCESS [ 840.795620] env[65370]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e4c5be7e-6c74-44a0-bf7b-9581ec4636c2 deletion is rescheduled due to dependency. [ 840.795701] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e4c5be7e-6c74-44a0-bf7b-9581ec4636c2" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 841.191982] env[65370]: INFO networking_nsxv3.common.synchronization [req-e5ce8642-b3dc-4c2f-a95b-798d445700a9 req-73bd7a0c-d98a-4ff2-9e80-e1496ec7dfb8 tempest-ServerRescueNegativeTestJSON-807527939 tempest-ServerRescueNegativeTestJSON-807527939-project-member] Enqueued Resource ID: 5c5eea1d-0338-4750-8d40-b5e68d251d49 with Priority: HIGHEST for action security_group_members [ 841.192971] env[65370]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5c5eea1d-0338-4750-8d40-b5e68d251d49 with Priority: HIGHEST for action security_group_members [ 841.196212] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock member-5c5eea1d-0338-4750-8d40-b5e68d251d49 taken with stack trace [, , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 841.197016] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5c5eea1d-0338-4750-8d40-b5e68d251d49" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 841.197016] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5c5eea1d-0338-4750-8d40-b5e68d251d49" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 841.197127] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5c5eea1d-0338-4750-8d40-b5e68d251d49" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 841.197248] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 841.198206] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 841.198206] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 841.198206] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 841.198206] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 841.198206] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5c5eea1d-0338-4750-8d40-b5e68d251d49',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 841.518025] env[65370]: DEBUG networking_nsxv3.common.locking [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Lock network-467 taken with stack trace [, , , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 841.518025] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquiring lock "network-467" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 841.518025] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquired lock "network-467" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 841.518025] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquired external semaphore "network-467" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 841.518025] env[65370]: DEBUG networking_nsxv3.common.locking [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 841.518025] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquiring lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 841.518025] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquired lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 841.518025] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquired external semaphore "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 841.518025] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Releasing lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 841.518025] env[65370]: DEBUG dogpile.cache.region [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] No value present for key: 'zone-id' {{(pid=65370) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 841.519751] env[65370]: DEBUG dogpile.lock [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] NeedRegenerationException {{(pid=65370) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 841.519751] env[65370]: DEBUG dogpile.lock [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] no value, waiting for create lock {{(pid=65370) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 841.519751] env[65370]: DEBUG dogpile.lock [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] value creation lock acquired {{(pid=65370) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 841.519966] env[65370]: DEBUG dogpile.cache.region [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] No value present for key: 'zone-id' {{(pid=65370) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 841.520085] env[65370]: DEBUG dogpile.lock [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Calling creation function for not-yet-present value {{(pid=65370) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 841.520396] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 841.541015] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 841.541231] env[65370]: DEBUG dogpile.cache.region [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=65370) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 841.541348] env[65370]: DEBUG dogpile.lock [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Released creation lock {{(pid=65370) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 841.541605] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Releasing lock "network-467" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 841.541963] env[65370]: DEBUG networking_nsxv3.common.locking [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Lock port-0788ad8d-7842-4897-acf3-ff3cd793b855 taken with stack trace [, , , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 841.542198] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquiring lock "port-0788ad8d-7842-4897-acf3-ff3cd793b855" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 841.542345] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquired lock "port-0788ad8d-7842-4897-acf3-ff3cd793b855" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 841.542689] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquired external semaphore "port-0788ad8d-7842-4897-acf3-ff3cd793b855" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 841.542914] env[65370]: DEBUG networking_nsxv3.api.rpc [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0788ad8d-7842-4897-acf3-ff3cd793b855',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 841.700155] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 841.701038] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 841.701038] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 841.701756] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 841.701756] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 841.701756] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 841.701756] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 841.702180] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 841.702180] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 841.702180] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 841.702180] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5c5eea1d-0338-4750-8d40-b5e68d251d49 already deleted. [ 841.702459] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5c5eea1d-0338-4750-8d40-b5e68d251d49" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 842.045995] env[65370]: DEBUG networking_nsxv3.common.locking [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 842.046421] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquiring lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 842.046421] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquired lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 842.046702] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquired external semaphore "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 842.046884] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Releasing lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 842.047100] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Segment Port 0788ad8d-7842-4897-acf3-ff3cd793b855 not found, creating... [ 842.047366] env[65370]: DEBUG networking_nsxv3.common.locking [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 842.047523] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquiring lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 842.047634] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquired lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 842.047846] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquired external semaphore "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 842.047985] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Releasing lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 842.048335] env[65370]: DEBUG networking_nsxv3.common.locking [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 842.048518] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquiring lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 842.048651] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquired lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 842.048860] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquired external semaphore "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 842.048995] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Releasing lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 842.049144] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Resource: SegmentPort with ID: 0788ad8d-7842-4897-acf3-ff3cd793b855 is going to be created. [ 842.071796] env[65370]: DEBUG networking_nsxv3.common.locking [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 842.072028] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquiring lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 842.072144] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquired lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 842.072420] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquired external semaphore "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 842.072649] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Releasing lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 842.072881] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Releasing lock "port-0788ad8d-7842-4897-acf3-ff3cd793b855" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 842.796287] env[65370]: INFO networking_nsxv3.common.synchronization [req-e5ce8642-b3dc-4c2f-a95b-798d445700a9 req-ea22d666-2a61-4d05-bba9-4d3448ca95db service nova] Enqueued Resource ID: 5c5eea1d-0338-4750-8d40-b5e68d251d49 with Priority: HIGHEST for action security_group_rules [ 842.796568] env[65370]: INFO networking_nsxv3.common.synchronization [req-e5ce8642-b3dc-4c2f-a95b-798d445700a9 req-ea22d666-2a61-4d05-bba9-4d3448ca95db service nova] Enqueued Resource ID: 5c5eea1d-0338-4750-8d40-b5e68d251d49 with Priority: HIGHEST for action security_group_members [ 842.796791] env[65370]: INFO networking_nsxv3.common.synchronization [req-e5ce8642-b3dc-4c2f-a95b-798d445700a9 req-ea22d666-2a61-4d05-bba9-4d3448ca95db service nova] Enqueued Resource ID: 0788ad8d-7842-4897-acf3-ff3cd793b855 with Priority: HIGHEST for action port [ 842.797387] env[65370]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5c5eea1d-0338-4750-8d40-b5e68d251d49 with Priority: HIGHEST for action security_group_rules [ 842.797559] env[65370]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5c5eea1d-0338-4750-8d40-b5e68d251d49 with Priority: HIGHEST for action security_group_members [ 842.797682] env[65370]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0788ad8d-7842-4897-acf3-ff3cd793b855 with Priority: HIGHEST for action port [ 842.798085] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock rules-5c5eea1d-0338-4750-8d40-b5e68d251d49 taken with stack trace [, , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 842.798593] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-5c5eea1d-0338-4750-8d40-b5e68d251d49" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 842.798694] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-5c5eea1d-0338-4750-8d40-b5e68d251d49" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 842.798959] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-5c5eea1d-0338-4750-8d40-b5e68d251d49" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 842.800140] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('5c5eea1d-0338-4750-8d40-b5e68d251d49',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 842.805819] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock member-5c5eea1d-0338-4750-8d40-b5e68d251d49 taken with stack trace [, , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 842.805819] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5c5eea1d-0338-4750-8d40-b5e68d251d49" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 842.805819] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5c5eea1d-0338-4750-8d40-b5e68d251d49" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 842.805819] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5c5eea1d-0338-4750-8d40-b5e68d251d49" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 842.805819] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 842.805819] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 842.805819] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 842.805819] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 842.805819] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 842.805819] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5c5eea1d-0338-4750-8d40-b5e68d251d49',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 842.805819] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock port-0788ad8d-7842-4897-acf3-ff3cd793b855 taken with stack trace [, , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 842.805819] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-0788ad8d-7842-4897-acf3-ff3cd793b855" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 842.805819] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-0788ad8d-7842-4897-acf3-ff3cd793b855" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 842.805819] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-0788ad8d-7842-4897-acf3-ff3cd793b855" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 842.805819] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0788ad8d-7842-4897-acf3-ff3cd793b855',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 843.308830] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock member-5c5eea1d-0338-4750-8d40-b5e68d251d49 taken with stack trace [, , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 843.308830] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5c5eea1d-0338-4750-8d40-b5e68d251d49" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 843.308830] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('5c5eea1d-0338-4750-8d40-b5e68d251d49',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 843.310566] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 0788ad8d-7842-4897-acf3-ff3cd793b855 with status ACTIVE [ 843.311202] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 843.312017] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 843.312017] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 843.312017] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 843.312432] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 843.312936] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 843.314027] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 843.314027] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 843.314027] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 843.314027] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 843.315631] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 843.315631] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 843.315631] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 843.315631] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 843.315631] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 843.315631] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 0788ad8d-7842-4897-acf3-ff3cd793b855 is going to be updated. [ 843.338717] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 843.339730] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 843.339730] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 843.339730] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 843.339730] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 843.339730] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-0788ad8d-7842-4897-acf3-ff3cd793b855" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 843.817950] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('5c5eea1d-0338-4750-8d40-b5e68d251d49',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 844.320782] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 844.321217] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 844.321217] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 844.321430] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 844.321556] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 844.321663] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5c5eea1d-0338-4750-8d40-b5e68d251d49 is going to be created. [ 844.351299] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 844.351515] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 844.351515] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 844.351745] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 844.351999] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 844.363995] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5c5eea1d-0338-4750-8d40-b5e68d251d49 in Status: UNINITIALIZED for 2s [ 844.371950] env[65370]: INFO networking_nsxv3.common.synchronization [None req-8ad641dc-4996-42f4-b283-2d533fd650a1 None None] Enqueued Resource ID: 16a1de9b-21d8-4a13-b7d5-cb9fac9adfce with Priority: HIGHEST for action port [ 844.371950] env[65370]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 16a1de9b-21d8-4a13-b7d5-cb9fac9adfce with Priority: HIGHEST for action port [ 844.373276] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock port-16a1de9b-21d8-4a13-b7d5-cb9fac9adfce taken with stack trace [, , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 844.373742] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-16a1de9b-21d8-4a13-b7d5-cb9fac9adfce" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 844.375339] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-16a1de9b-21d8-4a13-b7d5-cb9fac9adfce" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 844.375339] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-16a1de9b-21d8-4a13-b7d5-cb9fac9adfce" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 844.375339] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('16a1de9b-21d8-4a13-b7d5-cb9fac9adfce',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 844.877967] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 16a1de9b-21d8-4a13-b7d5-cb9fac9adfce [ 844.879228] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 844.879644] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 844.879815] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 844.880424] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 844.880685] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 844.880955] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:16a1de9b-21d8-4a13-b7d5-cb9fac9adfce already deleted. [ 844.881158] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-16a1de9b-21d8-4a13-b7d5-cb9fac9adfce" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 846.380080] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5c5eea1d-0338-4750-8d40-b5e68d251d49 in Status: SUCCESS [ 846.380478] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5c5eea1d-0338-4750-8d40-b5e68d251d49" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 846.380571] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5c5eea1d-0338-4750-8d40-b5e68d251d49" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 846.380854] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5c5eea1d-0338-4750-8d40-b5e68d251d49" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 846.381073] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 846.381213] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 846.381297] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 846.381417] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 846.381493] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 846.381635] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5c5eea1d-0338-4750-8d40-b5e68d251d49" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 846.381788] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('5c5eea1d-0338-4750-8d40-b5e68d251d49',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 846.887037] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('5c5eea1d-0338-4750-8d40-b5e68d251d49',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 847.388398] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 5c5eea1d-0338-4750-8d40-b5e68d251d49: rpc.has_security_group_logging(os_id): False [ 847.407794] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 847.407936] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 847.407986] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 847.408225] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 847.408354] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 847.408603] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 847.408704] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 847.408766] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 847.408972] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 847.409057] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 847.409096] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 5c5eea1d-0338-4750-8d40-b5e68d251d49 is going to be created. [ 847.476273] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 847.476510] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 847.476510] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 847.476702] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 847.476974] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 847.489978] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 5c5eea1d-0338-4750-8d40-b5e68d251d49 in Status: IN_PROGRESS for 2s [ 848.249128] env[65370]: INFO networking_nsxv3.common.synchronization [None req-e634c0c9-4d90-4df0-b6d0-3eecfbaa80ac None None] Enqueued Resource ID: 09b422ef-9196-4ec9-bcf3-ead5fe77166a with Priority: HIGHEST for action port [ 848.249385] env[65370]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 09b422ef-9196-4ec9-bcf3-ead5fe77166a with Priority: HIGHEST for action port [ 848.249937] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock port-09b422ef-9196-4ec9-bcf3-ead5fe77166a taken with stack trace [, , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 848.250073] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-09b422ef-9196-4ec9-bcf3-ead5fe77166a" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 848.250137] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-09b422ef-9196-4ec9-bcf3-ead5fe77166a" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 848.250388] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-09b422ef-9196-4ec9-bcf3-ead5fe77166a" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 848.251858] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('09b422ef-9196-4ec9-bcf3-ead5fe77166a',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 848.753225] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 09b422ef-9196-4ec9-bcf3-ead5fe77166a [ 848.754307] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 848.754475] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 848.754546] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 848.754782] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 848.754875] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 848.754982] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:09b422ef-9196-4ec9-bcf3-ead5fe77166a already deleted. [ 848.755104] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-09b422ef-9196-4ec9-bcf3-ead5fe77166a" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 849.319623] env[65370]: INFO networking_nsxv3.common.synchronization [req-460aca42-5fb0-488f-b445-8dcdea7873e8 req-a7c80468-6d6c-423c-85ba-359d1496c715 tempest-ServersTestJSON-152322471 tempest-ServersTestJSON-152322471-project-member] Enqueued Resource ID: 21a3b55c-64ce-4782-808a-31350166c184 with Priority: HIGHEST for action security_group_members [ 849.320185] env[65370]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 21a3b55c-64ce-4782-808a-31350166c184 with Priority: HIGHEST for action security_group_members [ 849.320522] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock member-21a3b55c-64ce-4782-808a-31350166c184 taken with stack trace [, , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 849.320628] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-21a3b55c-64ce-4782-808a-31350166c184" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 849.320689] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-21a3b55c-64ce-4782-808a-31350166c184" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 849.320888] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-21a3b55c-64ce-4782-808a-31350166c184" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 849.321079] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 849.321896] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 849.321896] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 849.321896] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 849.321896] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 849.321896] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('21a3b55c-64ce-4782-808a-31350166c184',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 849.455429] env[65370]: INFO networking_nsxv3.common.synchronization [req-d4ffc5d2-1c5a-459c-a5c5-af5c7f7f64bf req-3668f746-b35b-49b2-bca7-77c7cac5f7a1 tempest-SecurityGroupsTestJSON-1618218766 tempest-SecurityGroupsTestJSON-1618218766-project-member] Enqueued Resource ID: 4269e0a9-b570-412a-9993-d1965229c186 with Priority: HIGHEST for action security_group_members [ 849.455429] env[65370]: INFO networking_nsxv3.common.synchronization [req-d4ffc5d2-1c5a-459c-a5c5-af5c7f7f64bf req-3668f746-b35b-49b2-bca7-77c7cac5f7a1 tempest-SecurityGroupsTestJSON-1618218766 tempest-SecurityGroupsTestJSON-1618218766-project-member] Enqueued Resource ID: 8d9c7efa-60b6-44af-830b-f32145b1b403 with Priority: HIGHEST for action security_group_members [ 849.455627] env[65370]: INFO networking_nsxv3.common.synchronization [req-d4ffc5d2-1c5a-459c-a5c5-af5c7f7f64bf req-3668f746-b35b-49b2-bca7-77c7cac5f7a1 tempest-SecurityGroupsTestJSON-1618218766 tempest-SecurityGroupsTestJSON-1618218766-project-member] Enqueued Resource ID: 1a7b0f53-ef43-4301-97b8-ab12f1f2ae45 with Priority: HIGHEST for action security_group_members [ 849.456623] env[65370]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4269e0a9-b570-412a-9993-d1965229c186 with Priority: HIGHEST for action security_group_members [ 849.456623] env[65370]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8d9c7efa-60b6-44af-830b-f32145b1b403 with Priority: HIGHEST for action security_group_members [ 849.456623] env[65370]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1a7b0f53-ef43-4301-97b8-ab12f1f2ae45 with Priority: HIGHEST for action security_group_members [ 849.456894] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock member-4269e0a9-b570-412a-9993-d1965229c186 taken with stack trace [, , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 849.457129] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4269e0a9-b570-412a-9993-d1965229c186" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 849.457201] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4269e0a9-b570-412a-9993-d1965229c186" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 849.458162] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4269e0a9-b570-412a-9993-d1965229c186" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 849.458162] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 849.458162] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 849.458162] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 849.458162] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 849.458162] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 849.458162] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4269e0a9-b570-412a-9993-d1965229c186',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 849.459517] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock member-8d9c7efa-60b6-44af-830b-f32145b1b403 taken with stack trace [, , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 849.459517] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8d9c7efa-60b6-44af-830b-f32145b1b403" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 849.459517] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8d9c7efa-60b6-44af-830b-f32145b1b403" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 849.459517] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8d9c7efa-60b6-44af-830b-f32145b1b403" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 849.459517] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 849.459517] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 849.459517] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 849.459781] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 849.459781] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 849.459781] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('8d9c7efa-60b6-44af-830b-f32145b1b403',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 849.462105] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock member-1a7b0f53-ef43-4301-97b8-ab12f1f2ae45 taken with stack trace [, , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 849.462105] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1a7b0f53-ef43-4301-97b8-ab12f1f2ae45" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 849.462105] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1a7b0f53-ef43-4301-97b8-ab12f1f2ae45" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 849.462105] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1a7b0f53-ef43-4301-97b8-ab12f1f2ae45" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 849.462105] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 849.462105] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 849.462105] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 849.462105] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 849.462105] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 849.462105] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1a7b0f53-ef43-4301-97b8-ab12f1f2ae45',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 849.503832] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 5c5eea1d-0338-4750-8d40-b5e68d251d49 in Status: SUCCESS [ 849.504118] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-5c5eea1d-0338-4750-8d40-b5e68d251d49" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 849.824416] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 849.824779] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 849.824779] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 849.825708] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 849.825708] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 849.825708] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 849.825708] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 849.826046] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 849.826046] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 849.826157] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 849.826222] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 21a3b55c-64ce-4782-808a-31350166c184 is going to be updated. [ 849.872918] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 849.873086] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 849.873184] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 849.873437] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 849.873586] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 849.887060] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 21a3b55c-64ce-4782-808a-31350166c184 in Status: IN_PROGRESS for 2s [ 849.963593] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 849.963865] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 849.963865] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 849.964681] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 849.964681] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 849.964681] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 849.965376] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 849.965376] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 849.965376] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 849.965376] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 849.965376] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8d9c7efa-60b6-44af-830b-f32145b1b403 is going to be updated. [ 849.967091] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 849.967091] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 849.967256] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 849.967304] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 849.968446] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 849.968563] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 849.995807] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 849.996750] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 849.996750] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 849.996750] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 849.996750] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 849.996750] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 849.997151] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4269e0a9-b570-412a-9993-d1965229c186 is going to be updated. [ 849.997863] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 849.998220] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 850.015896] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 850.015896] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 850.015896] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 850.016292] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 850.016504] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 850.037875] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8d9c7efa-60b6-44af-830b-f32145b1b403 in Status: IN_PROGRESS for 2s [ 850.050467] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 850.050778] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 850.050947] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 850.051048] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 850.051258] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 850.051344] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 850.051442] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1a7b0f53-ef43-4301-97b8-ab12f1f2ae45 is going to be updated. [ 850.070837] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 850.070837] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 850.070837] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 850.071063] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 850.071498] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 850.090797] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4269e0a9-b570-412a-9993-d1965229c186 in Status: IN_PROGRESS for 2s [ 850.117046] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 850.117263] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 850.117304] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 850.117476] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 850.117608] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 850.131470] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1a7b0f53-ef43-4301-97b8-ab12f1f2ae45 in Status: IN_PROGRESS for 2s [ 850.562585] env[65370]: INFO networking_nsxv3.common.synchronization [req-94bd55fa-fef8-4ef5-a44f-0411b933ed5c req-598e9f14-3ea7-41d4-9e19-267ad88a479c tempest-AttachVolumeNegativeTest-719365731 tempest-AttachVolumeNegativeTest-719365731-project-member] Enqueued Resource ID: a64b2117-cdc3-4b72-a9f3-57dfa8198991 with Priority: HIGHEST for action security_group_members [ 850.563191] env[65370]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a64b2117-cdc3-4b72-a9f3-57dfa8198991 with Priority: HIGHEST for action security_group_members [ 850.563480] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock member-a64b2117-cdc3-4b72-a9f3-57dfa8198991 taken with stack trace [, , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 850.563599] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a64b2117-cdc3-4b72-a9f3-57dfa8198991" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 850.563658] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a64b2117-cdc3-4b72-a9f3-57dfa8198991" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 850.563924] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a64b2117-cdc3-4b72-a9f3-57dfa8198991" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 850.564702] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 850.564815] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 850.565633] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 850.565712] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 850.565805] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 850.565903] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a64b2117-cdc3-4b72-a9f3-57dfa8198991',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 851.071673] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 851.071673] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 851.071673] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 851.071673] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 851.071673] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 851.071673] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 851.071673] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 851.071673] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 851.071673] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 851.071673] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 851.071673] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a64b2117-cdc3-4b72-a9f3-57dfa8198991 already deleted. [ 851.071673] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a64b2117-cdc3-4b72-a9f3-57dfa8198991" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 851.488358] env[65370]: DEBUG networking_nsxv3.common.locking [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Lock network-600 taken with stack trace [, , , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 851.488358] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquiring lock "network-600" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 851.488358] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquired lock "network-600" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 851.489363] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquired external semaphore "network-600" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 851.489946] env[65370]: DEBUG networking_nsxv3.common.locking [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 851.493145] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquiring lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 851.493145] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquired lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 851.493145] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquired external semaphore "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 851.493145] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Releasing lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 851.493145] env[65370]: DEBUG dogpile.cache.region [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] No value present for key: 'zone-id' {{(pid=65370) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 851.493145] env[65370]: DEBUG dogpile.lock [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] NeedRegenerationException {{(pid=65370) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 851.493145] env[65370]: DEBUG dogpile.lock [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] no value, waiting for create lock {{(pid=65370) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 851.493145] env[65370]: DEBUG dogpile.lock [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] value creation lock acquired {{(pid=65370) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 851.493531] env[65370]: DEBUG dogpile.cache.region [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] No value present for key: 'zone-id' {{(pid=65370) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 851.493531] env[65370]: DEBUG dogpile.lock [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Calling creation function for not-yet-present value {{(pid=65370) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 851.494534] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 851.516657] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 851.516845] env[65370]: DEBUG dogpile.cache.region [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=65370) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 851.517067] env[65370]: DEBUG dogpile.lock [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Released creation lock {{(pid=65370) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 851.517271] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Releasing lock "network-600" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 851.517595] env[65370]: DEBUG networking_nsxv3.common.locking [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Lock port-9133fd32-cbec-4750-adfe-229b149f8d27 taken with stack trace [, , , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 851.517765] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquiring lock "port-9133fd32-cbec-4750-adfe-229b149f8d27" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 851.517878] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquired lock "port-9133fd32-cbec-4750-adfe-229b149f8d27" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 851.518225] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquired external semaphore "port-9133fd32-cbec-4750-adfe-229b149f8d27" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 851.518364] env[65370]: DEBUG networking_nsxv3.api.rpc [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9133fd32-cbec-4750-adfe-229b149f8d27',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 851.896835] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 21a3b55c-64ce-4782-808a-31350166c184 in Status: SUCCESS [ 851.897069] env[65370]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 21a3b55c-64ce-4782-808a-31350166c184 deletion is rescheduled due to dependency. [ 851.897200] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-21a3b55c-64ce-4782-808a-31350166c184" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 852.023226] env[65370]: DEBUG networking_nsxv3.common.locking [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 852.023503] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquiring lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 852.023627] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquired lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 852.023974] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquired external semaphore "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 852.024145] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Releasing lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 852.024296] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Segment Port 9133fd32-cbec-4750-adfe-229b149f8d27 not found, creating... [ 852.024596] env[65370]: DEBUG networking_nsxv3.common.locking [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 852.024769] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquiring lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 852.025366] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquired lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 852.025366] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquired external semaphore "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 852.025366] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Releasing lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 852.025575] env[65370]: DEBUG networking_nsxv3.common.locking [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 852.025739] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquiring lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 852.025880] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquired lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 852.026150] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquired external semaphore "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 852.026278] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Releasing lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 852.026435] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Resource: SegmentPort with ID: 9133fd32-cbec-4750-adfe-229b149f8d27 is going to be created. [ 852.046595] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8d9c7efa-60b6-44af-830b-f32145b1b403 in Status: SUCCESS [ 852.046813] env[65370]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8d9c7efa-60b6-44af-830b-f32145b1b403 deletion is rescheduled due to dependency. [ 852.046874] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8d9c7efa-60b6-44af-830b-f32145b1b403" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 852.049681] env[65370]: DEBUG networking_nsxv3.common.locking [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 852.049891] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquiring lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 852.050012] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquired lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 852.050295] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquired external semaphore "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 852.050560] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Releasing lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 852.050834] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Releasing lock "port-9133fd32-cbec-4750-adfe-229b149f8d27" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 852.103070] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4269e0a9-b570-412a-9993-d1965229c186 in Status: SUCCESS [ 852.103595] env[65370]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4269e0a9-b570-412a-9993-d1965229c186 deletion is rescheduled due to dependency. [ 852.103595] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4269e0a9-b570-412a-9993-d1965229c186" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 852.149794] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1a7b0f53-ef43-4301-97b8-ab12f1f2ae45 in Status: SUCCESS [ 852.150074] env[65370]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1a7b0f53-ef43-4301-97b8-ab12f1f2ae45 deletion is rescheduled due to dependency. [ 852.150139] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1a7b0f53-ef43-4301-97b8-ab12f1f2ae45" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 852.818117] env[65370]: INFO networking_nsxv3.common.synchronization [req-94bd55fa-fef8-4ef5-a44f-0411b933ed5c req-97859019-a63a-41d0-b661-556c23521acd service nova] Enqueued Resource ID: a64b2117-cdc3-4b72-a9f3-57dfa8198991 with Priority: HIGHEST for action security_group_rules [ 852.820932] env[65370]: INFO networking_nsxv3.common.synchronization [req-94bd55fa-fef8-4ef5-a44f-0411b933ed5c req-97859019-a63a-41d0-b661-556c23521acd service nova] Enqueued Resource ID: a64b2117-cdc3-4b72-a9f3-57dfa8198991 with Priority: HIGHEST for action security_group_members [ 852.820932] env[65370]: INFO networking_nsxv3.common.synchronization [req-94bd55fa-fef8-4ef5-a44f-0411b933ed5c req-97859019-a63a-41d0-b661-556c23521acd service nova] Enqueued Resource ID: 9133fd32-cbec-4750-adfe-229b149f8d27 with Priority: HIGHEST for action port [ 852.820932] env[65370]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a64b2117-cdc3-4b72-a9f3-57dfa8198991 with Priority: HIGHEST for action security_group_rules [ 852.820932] env[65370]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a64b2117-cdc3-4b72-a9f3-57dfa8198991 with Priority: HIGHEST for action security_group_members [ 852.820932] env[65370]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9133fd32-cbec-4750-adfe-229b149f8d27 with Priority: HIGHEST for action port [ 852.820932] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a64b2117-cdc3-4b72-a9f3-57dfa8198991 taken with stack trace [, , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 852.821889] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a64b2117-cdc3-4b72-a9f3-57dfa8198991" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 852.821889] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a64b2117-cdc3-4b72-a9f3-57dfa8198991" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 852.821889] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a64b2117-cdc3-4b72-a9f3-57dfa8198991" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 852.821889] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a64b2117-cdc3-4b72-a9f3-57dfa8198991',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 852.824173] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock member-a64b2117-cdc3-4b72-a9f3-57dfa8198991 taken with stack trace [, , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 852.824173] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a64b2117-cdc3-4b72-a9f3-57dfa8198991" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 852.824173] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a64b2117-cdc3-4b72-a9f3-57dfa8198991" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 852.824173] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a64b2117-cdc3-4b72-a9f3-57dfa8198991" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 852.824873] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 852.824873] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 852.824873] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 852.824873] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 852.824873] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 852.825601] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a64b2117-cdc3-4b72-a9f3-57dfa8198991',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 852.827177] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock port-9133fd32-cbec-4750-adfe-229b149f8d27 taken with stack trace [, , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 852.827371] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-9133fd32-cbec-4750-adfe-229b149f8d27" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 852.827371] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-9133fd32-cbec-4750-adfe-229b149f8d27" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 852.828116] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-9133fd32-cbec-4750-adfe-229b149f8d27" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 852.828242] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9133fd32-cbec-4750-adfe-229b149f8d27',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 853.334673] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('a64b2117-cdc3-4b72-a9f3-57dfa8198991',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 853.334673] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock member-a64b2117-cdc3-4b72-a9f3-57dfa8198991 taken with stack trace [, , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 853.334673] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a64b2117-cdc3-4b72-a9f3-57dfa8198991" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 853.334673] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 9133fd32-cbec-4750-adfe-229b149f8d27 with status ACTIVE [ 853.334673] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 853.334673] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 853.335487] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 853.335487] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 853.335487] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 853.335487] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 853.335487] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 853.335487] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 853.335487] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 853.335487] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 853.335907] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 853.335907] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 853.335907] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 853.336165] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 853.336165] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 853.336165] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 9133fd32-cbec-4750-adfe-229b149f8d27 is going to be updated. [ 853.358176] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 853.358408] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 853.358408] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 853.358594] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 853.358712] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 853.359298] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-9133fd32-cbec-4750-adfe-229b149f8d27" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 853.646337] env[65370]: INFO networking_nsxv3.common.synchronization [req-4c601487-a0ed-401e-92a2-7bb39d7c79dc req-fe6396c9-9254-4efd-bc01-d0c001ae9fc5 tempest-ServerDiskConfigTestJSON-902849627 tempest-ServerDiskConfigTestJSON-902849627-project-member] Enqueued Resource ID: 420136f3-91df-4669-b5e3-cee436aeacb9 with Priority: HIGHEST for action security_group_members [ 853.647746] env[65370]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 420136f3-91df-4669-b5e3-cee436aeacb9 with Priority: HIGHEST for action security_group_members [ 853.647746] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock member-420136f3-91df-4669-b5e3-cee436aeacb9 taken with stack trace [, , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 853.647746] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-420136f3-91df-4669-b5e3-cee436aeacb9" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 853.647746] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-420136f3-91df-4669-b5e3-cee436aeacb9" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 853.647746] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-420136f3-91df-4669-b5e3-cee436aeacb9" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 853.647746] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 853.648464] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 853.648464] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 853.648464] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 853.648464] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 853.648618] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('420136f3-91df-4669-b5e3-cee436aeacb9',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 853.837871] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('a64b2117-cdc3-4b72-a9f3-57dfa8198991',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 854.151398] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 854.151623] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 854.151623] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 854.151878] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 854.152080] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 854.152446] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 854.153340] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 854.153461] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 854.153556] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 854.153639] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 854.153732] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 420136f3-91df-4669-b5e3-cee436aeacb9 is going to be updated. [ 854.192189] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 854.193556] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 854.193744] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 854.193878] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 854.194410] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 854.204167] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 420136f3-91df-4669-b5e3-cee436aeacb9 in Status: IN_PROGRESS for 2s [ 854.340923] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 854.340923] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 854.341479] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 854.341479] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 854.341479] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 854.341479] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a64b2117-cdc3-4b72-a9f3-57dfa8198991 is going to be created. [ 854.385605] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 854.385605] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 854.386048] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 854.386048] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 854.386193] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 854.398139] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a64b2117-cdc3-4b72-a9f3-57dfa8198991 in Status: UNINITIALIZED for 2s [ 856.214971] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 420136f3-91df-4669-b5e3-cee436aeacb9 in Status: SUCCESS [ 856.215318] env[65370]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 420136f3-91df-4669-b5e3-cee436aeacb9 deletion is rescheduled due to dependency. [ 856.215378] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-420136f3-91df-4669-b5e3-cee436aeacb9" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 856.407544] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a64b2117-cdc3-4b72-a9f3-57dfa8198991 in Status: SUCCESS [ 856.407870] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a64b2117-cdc3-4b72-a9f3-57dfa8198991" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 856.408125] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a64b2117-cdc3-4b72-a9f3-57dfa8198991" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 856.412021] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a64b2117-cdc3-4b72-a9f3-57dfa8198991" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 856.412021] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 856.412021] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 856.412021] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 856.412021] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 856.412021] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 856.412021] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a64b2117-cdc3-4b72-a9f3-57dfa8198991" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 856.412021] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('a64b2117-cdc3-4b72-a9f3-57dfa8198991',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 856.914019] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('a64b2117-cdc3-4b72-a9f3-57dfa8198991',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 857.417230] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for a64b2117-cdc3-4b72-a9f3-57dfa8198991: rpc.has_security_group_logging(os_id): False [ 857.437213] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 857.437393] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 857.437667] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 857.437733] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 857.437848] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 857.442028] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 857.442028] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 857.442028] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 857.442028] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 857.442028] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 857.442028] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a64b2117-cdc3-4b72-a9f3-57dfa8198991 is going to be created. [ 857.503842] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 857.504076] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 857.504131] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 857.504326] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 857.504544] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 857.523298] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a64b2117-cdc3-4b72-a9f3-57dfa8198991 in Status: IN_PROGRESS for 2s [ 858.160531] env[65370]: INFO networking_nsxv3.common.synchronization [None req-5dbd62b9-0104-45fa-aec0-b7deecd06779 None None] Enqueued Resource ID: 8ccd112c-f78c-4c0d-b280-7ef91c3e5d3f with Priority: HIGHEST for action port [ 858.160531] env[65370]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8ccd112c-f78c-4c0d-b280-7ef91c3e5d3f with Priority: HIGHEST for action port [ 858.160531] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock port-8ccd112c-f78c-4c0d-b280-7ef91c3e5d3f taken with stack trace [, , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 858.160531] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-8ccd112c-f78c-4c0d-b280-7ef91c3e5d3f" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 858.160531] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-8ccd112c-f78c-4c0d-b280-7ef91c3e5d3f" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 858.160531] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-8ccd112c-f78c-4c0d-b280-7ef91c3e5d3f" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 858.160531] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8ccd112c-f78c-4c0d-b280-7ef91c3e5d3f',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 858.663371] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 8ccd112c-f78c-4c0d-b280-7ef91c3e5d3f [ 858.663744] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 858.663744] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 858.663907] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 858.664032] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 858.664139] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 858.664236] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:8ccd112c-f78c-4c0d-b280-7ef91c3e5d3f already deleted. [ 858.664320] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-8ccd112c-f78c-4c0d-b280-7ef91c3e5d3f" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 859.544071] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a64b2117-cdc3-4b72-a9f3-57dfa8198991 in Status: SUCCESS [ 859.545617] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a64b2117-cdc3-4b72-a9f3-57dfa8198991" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 861.371362] env[65370]: INFO networking_nsxv3.common.synchronization [None req-390a6a01-2a56-4c5c-ae2a-755d32728366 None None] Enqueued Resource ID: 733fb5ff-ef5f-4c5b-8a7a-8363b5e403cc with Priority: HIGHEST for action port [ 861.372205] env[65370]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 733fb5ff-ef5f-4c5b-8a7a-8363b5e403cc with Priority: HIGHEST for action port [ 861.372205] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock port-733fb5ff-ef5f-4c5b-8a7a-8363b5e403cc taken with stack trace [, , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 861.372375] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-733fb5ff-ef5f-4c5b-8a7a-8363b5e403cc" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 861.372375] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-733fb5ff-ef5f-4c5b-8a7a-8363b5e403cc" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 861.372617] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-733fb5ff-ef5f-4c5b-8a7a-8363b5e403cc" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 861.372692] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('733fb5ff-ef5f-4c5b-8a7a-8363b5e403cc',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 861.602583] env[65370]: INFO networking_nsxv3.common.synchronization [req-7f36159b-91f6-4e33-ac03-56dae3441dcb req-ade04e1d-f429-4635-a820-e7cb1c12d533 tempest-AttachInterfacesUnderV243Test-197944153 tempest-AttachInterfacesUnderV243Test-197944153-project-member] Enqueued Resource ID: 84a5376d-c8c0-4dd2-bea4-f01f11567a72 with Priority: HIGHEST for action security_group_members [ 861.603394] env[65370]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 84a5376d-c8c0-4dd2-bea4-f01f11567a72 with Priority: HIGHEST for action security_group_members [ 861.603488] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock member-84a5376d-c8c0-4dd2-bea4-f01f11567a72 taken with stack trace [, , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 861.603563] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-84a5376d-c8c0-4dd2-bea4-f01f11567a72" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 861.603601] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-84a5376d-c8c0-4dd2-bea4-f01f11567a72" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 861.604028] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-84a5376d-c8c0-4dd2-bea4-f01f11567a72" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 861.604102] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 861.604717] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 861.604717] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 861.604717] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 861.604717] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 861.604717] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('84a5376d-c8c0-4dd2-bea4-f01f11567a72',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 861.876296] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 733fb5ff-ef5f-4c5b-8a7a-8363b5e403cc [ 861.876564] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 861.876698] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 861.876768] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 861.876989] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 861.877093] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 861.877189] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:733fb5ff-ef5f-4c5b-8a7a-8363b5e403cc already deleted. [ 861.877273] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-733fb5ff-ef5f-4c5b-8a7a-8363b5e403cc" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 861.971906] env[65370]: DEBUG networking_nsxv3.common.locking [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Lock network-811 taken with stack trace [, , , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 861.972162] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquiring lock "network-811" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 861.972276] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquired lock "network-811" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 861.972698] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquired external semaphore "network-811" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 861.972982] env[65370]: DEBUG networking_nsxv3.common.locking [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 861.973176] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquiring lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 861.973406] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquired lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 861.973664] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquired external semaphore "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 861.973816] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Releasing lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 861.974048] env[65370]: DEBUG dogpile.cache.region [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] No value present for key: 'zone-id' {{(pid=65370) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 861.974165] env[65370]: DEBUG dogpile.lock [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] NeedRegenerationException {{(pid=65370) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 861.974271] env[65370]: DEBUG dogpile.lock [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] no value, waiting for create lock {{(pid=65370) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 861.974391] env[65370]: DEBUG dogpile.lock [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] value creation lock acquired {{(pid=65370) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 861.974498] env[65370]: DEBUG dogpile.cache.region [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] No value present for key: 'zone-id' {{(pid=65370) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 861.974616] env[65370]: DEBUG dogpile.lock [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Calling creation function for not-yet-present value {{(pid=65370) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 861.974752] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 861.996520] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 861.996720] env[65370]: DEBUG dogpile.cache.region [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=65370) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 861.997172] env[65370]: DEBUG dogpile.lock [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Released creation lock {{(pid=65370) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 861.997172] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Releasing lock "network-811" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 861.997400] env[65370]: DEBUG networking_nsxv3.common.locking [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Lock port-5aebefd2-c896-4612-a30a-7f40acda0a45 taken with stack trace [, , , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 861.997646] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquiring lock "port-5aebefd2-c896-4612-a30a-7f40acda0a45" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 861.997798] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquired lock "port-5aebefd2-c896-4612-a30a-7f40acda0a45" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 861.998202] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquired external semaphore "port-5aebefd2-c896-4612-a30a-7f40acda0a45" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 861.998383] env[65370]: DEBUG networking_nsxv3.api.rpc [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5aebefd2-c896-4612-a30a-7f40acda0a45',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 862.108373] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 862.108520] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 862.108589] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 862.108795] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 862.108889] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 862.109088] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 862.109190] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 862.109251] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 862.109959] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 862.110092] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 862.110188] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 84a5376d-c8c0-4dd2-bea4-f01f11567a72 already deleted. [ 862.110276] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-84a5376d-c8c0-4dd2-bea4-f01f11567a72" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 862.501093] env[65370]: DEBUG networking_nsxv3.common.locking [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 862.501093] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquiring lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 862.501573] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquired lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 862.501573] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquired external semaphore "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 862.501689] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Releasing lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 862.501746] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Segment Port 5aebefd2-c896-4612-a30a-7f40acda0a45 not found, creating... [ 862.501996] env[65370]: DEBUG networking_nsxv3.common.locking [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 862.502166] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquiring lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 862.502278] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquired lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 862.502486] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquired external semaphore "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 862.502615] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Releasing lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 862.502884] env[65370]: DEBUG networking_nsxv3.common.locking [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 862.503042] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquiring lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 862.503157] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquired lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 862.503400] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquired external semaphore "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 862.503568] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Releasing lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 862.503626] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Resource: SegmentPort with ID: 5aebefd2-c896-4612-a30a-7f40acda0a45 is going to be created. [ 862.524110] env[65370]: DEBUG networking_nsxv3.common.locking [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 862.524356] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquiring lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 862.524477] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquired lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 862.524760] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquired external semaphore "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 862.524989] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Releasing lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 862.525232] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Releasing lock "port-5aebefd2-c896-4612-a30a-7f40acda0a45" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 863.264428] env[65370]: INFO networking_nsxv3.common.synchronization [req-7f36159b-91f6-4e33-ac03-56dae3441dcb req-73b54ff6-a88d-412e-9537-2179cf990d3e service nova] Enqueued Resource ID: 84a5376d-c8c0-4dd2-bea4-f01f11567a72 with Priority: HIGHEST for action security_group_rules [ 863.264603] env[65370]: INFO networking_nsxv3.common.synchronization [req-7f36159b-91f6-4e33-ac03-56dae3441dcb req-73b54ff6-a88d-412e-9537-2179cf990d3e service nova] Enqueued Resource ID: 84a5376d-c8c0-4dd2-bea4-f01f11567a72 with Priority: HIGHEST for action security_group_members [ 863.264737] env[65370]: INFO networking_nsxv3.common.synchronization [req-7f36159b-91f6-4e33-ac03-56dae3441dcb req-73b54ff6-a88d-412e-9537-2179cf990d3e service nova] Enqueued Resource ID: 5aebefd2-c896-4612-a30a-7f40acda0a45 with Priority: HIGHEST for action port [ 863.265334] env[65370]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 84a5376d-c8c0-4dd2-bea4-f01f11567a72 with Priority: HIGHEST for action security_group_rules [ 863.265473] env[65370]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 84a5376d-c8c0-4dd2-bea4-f01f11567a72 with Priority: HIGHEST for action security_group_members [ 863.265567] env[65370]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5aebefd2-c896-4612-a30a-7f40acda0a45 with Priority: HIGHEST for action port [ 863.265836] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock rules-84a5376d-c8c0-4dd2-bea4-f01f11567a72 taken with stack trace [, , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 863.266284] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-84a5376d-c8c0-4dd2-bea4-f01f11567a72" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 863.266284] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-84a5376d-c8c0-4dd2-bea4-f01f11567a72" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 863.266284] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-84a5376d-c8c0-4dd2-bea4-f01f11567a72" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 863.266467] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('84a5376d-c8c0-4dd2-bea4-f01f11567a72',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 863.267207] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock member-84a5376d-c8c0-4dd2-bea4-f01f11567a72 taken with stack trace [, , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 863.267333] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-84a5376d-c8c0-4dd2-bea4-f01f11567a72" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 863.267393] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-84a5376d-c8c0-4dd2-bea4-f01f11567a72" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 863.267553] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-84a5376d-c8c0-4dd2-bea4-f01f11567a72" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 863.267700] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 863.267794] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 863.267863] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 863.267991] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 863.268098] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 863.268171] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('84a5376d-c8c0-4dd2-bea4-f01f11567a72',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 863.268930] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock port-5aebefd2-c896-4612-a30a-7f40acda0a45 taken with stack trace [, , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 863.269045] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-5aebefd2-c896-4612-a30a-7f40acda0a45" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 863.269318] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-5aebefd2-c896-4612-a30a-7f40acda0a45" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 863.269318] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-5aebefd2-c896-4612-a30a-7f40acda0a45" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 863.269399] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5aebefd2-c896-4612-a30a-7f40acda0a45',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 863.770893] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('84a5376d-c8c0-4dd2-bea4-f01f11567a72',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 863.771969] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock member-84a5376d-c8c0-4dd2-bea4-f01f11567a72 taken with stack trace [, , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 863.772096] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-84a5376d-c8c0-4dd2-bea4-f01f11567a72" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 863.772271] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 5aebefd2-c896-4612-a30a-7f40acda0a45 with status ACTIVE [ 863.772463] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 863.772575] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 863.772894] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 863.772894] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 863.773011] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 863.773113] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 863.773202] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 863.773260] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 863.773415] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 863.774026] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 863.774026] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 863.774026] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 863.774026] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 863.774026] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 863.774026] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 863.774368] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 5aebefd2-c896-4612-a30a-7f40acda0a45 is going to be updated. [ 863.797986] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 863.798227] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 863.798227] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 863.798339] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 863.798480] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 863.798634] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-5aebefd2-c896-4612-a30a-7f40acda0a45" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 864.276523] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('84a5376d-c8c0-4dd2-bea4-f01f11567a72',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 864.781959] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 864.781959] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 864.781959] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 864.781959] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 864.781959] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 864.781959] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 84a5376d-c8c0-4dd2-bea4-f01f11567a72 is going to be created. [ 864.805211] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 864.805378] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 864.805378] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 864.805594] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 864.805759] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 864.816774] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 84a5376d-c8c0-4dd2-bea4-f01f11567a72 in Status: UNINITIALIZED for 2s [ 866.828066] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 84a5376d-c8c0-4dd2-bea4-f01f11567a72 in Status: SUCCESS [ 866.828066] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-84a5376d-c8c0-4dd2-bea4-f01f11567a72" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 866.828453] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-84a5376d-c8c0-4dd2-bea4-f01f11567a72" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 866.828453] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-84a5376d-c8c0-4dd2-bea4-f01f11567a72" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 866.828716] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 866.828902] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 866.829090] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 866.829321] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 866.829505] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 866.829658] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-84a5376d-c8c0-4dd2-bea4-f01f11567a72" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 866.829837] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('84a5376d-c8c0-4dd2-bea4-f01f11567a72',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 867.332939] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('84a5376d-c8c0-4dd2-bea4-f01f11567a72',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 867.834780] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 84a5376d-c8c0-4dd2-bea4-f01f11567a72: rpc.has_security_group_logging(os_id): False [ 867.857278] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 867.857509] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 867.857594] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 867.857858] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 867.857958] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 867.858234] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 867.858509] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 867.858509] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 867.858648] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 867.858648] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 867.858725] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 84a5376d-c8c0-4dd2-bea4-f01f11567a72 is going to be created. [ 867.921466] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 867.921702] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 867.921702] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 867.921961] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 867.922255] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 867.933772] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 84a5376d-c8c0-4dd2-bea4-f01f11567a72 in Status: IN_PROGRESS for 2s [ 868.267769] env[65370]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 868.267769] env[65370]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=1 [ 868.511937] env[65370]: INFO networking_nsxv3.common.synchronization [req-50b25e31-ba1f-4a28-999d-5243d9df816e req-ad00165e-95c5-460e-83ec-59d3c8140ba3 tempest-ServersTestFqdnHostnames-1392648948 tempest-ServersTestFqdnHostnames-1392648948-project-member] Enqueued Resource ID: 6f93689f-ae79-496c-bd6b-5fcec0a3824f with Priority: HIGHEST for action security_group_members [ 868.512994] env[65370]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6f93689f-ae79-496c-bd6b-5fcec0a3824f with Priority: HIGHEST for action security_group_members [ 868.512994] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock member-6f93689f-ae79-496c-bd6b-5fcec0a3824f taken with stack trace [, , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 868.512994] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6f93689f-ae79-496c-bd6b-5fcec0a3824f" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 868.513234] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6f93689f-ae79-496c-bd6b-5fcec0a3824f" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 868.513429] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6f93689f-ae79-496c-bd6b-5fcec0a3824f" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 868.513592] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 868.513694] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 868.513751] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 868.514268] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 868.514268] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 868.514268] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6f93689f-ae79-496c-bd6b-5fcec0a3824f',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 869.016432] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 869.016702] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 869.016702] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 869.017991] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 869.038833] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 869.039157] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 869.039295] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 869.039362] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 869.039568] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 869.039659] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 869.039763] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6f93689f-ae79-496c-bd6b-5fcec0a3824f is going to be updated. [ 869.068853] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 869.069321] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 869.069405] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 869.069623] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 869.069766] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 869.081669] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6f93689f-ae79-496c-bd6b-5fcec0a3824f in Status: IN_PROGRESS for 2s [ 869.552224] env[65370]: INFO networking_nsxv3.common.synchronization [req-2e6d0524-fece-4dc3-a355-06e34546ac9d req-61b312a8-7097-48b2-9643-7d2197752c35 tempest-ServerActionsTestOtherA-1239332614 tempest-ServerActionsTestOtherA-1239332614-project-member] Enqueued Resource ID: f37147a2-7642-4b7c-a970-ffec078fbee9 with Priority: HIGHEST for action security_group_members [ 869.552739] env[65370]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f37147a2-7642-4b7c-a970-ffec078fbee9 with Priority: HIGHEST for action security_group_members [ 869.553046] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock member-f37147a2-7642-4b7c-a970-ffec078fbee9 taken with stack trace [, , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 869.553176] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f37147a2-7642-4b7c-a970-ffec078fbee9" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 869.553245] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f37147a2-7642-4b7c-a970-ffec078fbee9" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 869.553496] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f37147a2-7642-4b7c-a970-ffec078fbee9" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 869.553651] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 869.553752] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 869.553816] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 869.553972] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 869.554200] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 869.554307] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f37147a2-7642-4b7c-a970-ffec078fbee9',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 869.870852] env[65370]: DEBUG networking_nsxv3.common.locking [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Lock network-865 taken with stack trace [, , , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 869.871207] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquiring lock "network-865" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 869.871282] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquired lock "network-865" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 869.871558] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquired external semaphore "network-865" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 869.871807] env[65370]: DEBUG networking_nsxv3.common.locking [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 869.871961] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquiring lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 869.872331] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquired lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 869.872562] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquired external semaphore "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 869.872782] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Releasing lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 869.873169] env[65370]: DEBUG dogpile.cache.region [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] No value present for key: 'zone-id' {{(pid=65370) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 869.873297] env[65370]: DEBUG dogpile.lock [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] NeedRegenerationException {{(pid=65370) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 869.873403] env[65370]: DEBUG dogpile.lock [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] no value, waiting for create lock {{(pid=65370) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 869.873505] env[65370]: DEBUG dogpile.lock [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] value creation lock acquired {{(pid=65370) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 869.873611] env[65370]: DEBUG dogpile.cache.region [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] No value present for key: 'zone-id' {{(pid=65370) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 869.873709] env[65370]: DEBUG dogpile.lock [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Calling creation function for not-yet-present value {{(pid=65370) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 869.873836] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 869.892244] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 869.892439] env[65370]: DEBUG dogpile.cache.region [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=65370) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 869.892654] env[65370]: DEBUG dogpile.lock [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Released creation lock {{(pid=65370) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 869.892804] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Releasing lock "network-865" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 869.893186] env[65370]: DEBUG networking_nsxv3.common.locking [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Lock port-24748655-8dd5-4ae0-9e7b-0df721b6022f taken with stack trace [, , , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 869.893391] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquiring lock "port-24748655-8dd5-4ae0-9e7b-0df721b6022f" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 869.893550] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquired lock "port-24748655-8dd5-4ae0-9e7b-0df721b6022f" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 869.893897] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquired external semaphore "port-24748655-8dd5-4ae0-9e7b-0df721b6022f" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 869.894059] env[65370]: DEBUG networking_nsxv3.api.rpc [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('24748655-8dd5-4ae0-9e7b-0df721b6022f',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 869.946505] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 84a5376d-c8c0-4dd2-bea4-f01f11567a72 in Status: SUCCESS [ 869.946505] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-84a5376d-c8c0-4dd2-bea4-f01f11567a72" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 870.056365] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 870.056746] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 870.056746] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 870.056746] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 870.056946] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 870.057121] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 870.057225] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 870.057225] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 870.057329] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 870.057702] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 870.057702] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f37147a2-7642-4b7c-a970-ffec078fbee9 already deleted. [ 870.057702] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f37147a2-7642-4b7c-a970-ffec078fbee9" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 870.397736] env[65370]: DEBUG networking_nsxv3.common.locking [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 870.397736] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquiring lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 870.397736] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquired lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 870.397736] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquired external semaphore "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 870.398285] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Releasing lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 870.398285] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Segment Port 24748655-8dd5-4ae0-9e7b-0df721b6022f not found, creating... [ 870.398502] env[65370]: DEBUG networking_nsxv3.common.locking [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 870.398562] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquiring lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 870.399538] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquired lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 870.399538] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquired external semaphore "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 870.399538] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Releasing lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 870.399538] env[65370]: DEBUG networking_nsxv3.common.locking [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 870.399538] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquiring lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 870.399538] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquired lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 870.399840] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquired external semaphore "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 870.399840] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Releasing lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 870.399947] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Resource: SegmentPort with ID: 24748655-8dd5-4ae0-9e7b-0df721b6022f is going to be created. [ 870.421437] env[65370]: DEBUG networking_nsxv3.common.locking [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 870.421611] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquiring lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 870.421741] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquired lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 870.422015] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquired external semaphore "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 870.422247] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Releasing lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 870.422474] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Releasing lock "port-24748655-8dd5-4ae0-9e7b-0df721b6022f" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 871.093081] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6f93689f-ae79-496c-bd6b-5fcec0a3824f in Status: SUCCESS [ 871.093381] env[65370]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6f93689f-ae79-496c-bd6b-5fcec0a3824f deletion is rescheduled due to dependency. [ 871.093381] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6f93689f-ae79-496c-bd6b-5fcec0a3824f" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 871.174014] env[65370]: INFO networking_nsxv3.common.synchronization [req-2e6d0524-fece-4dc3-a355-06e34546ac9d req-b28ced02-cff3-43c5-8a14-94acd23b0868 service nova] Enqueued Resource ID: f37147a2-7642-4b7c-a970-ffec078fbee9 with Priority: HIGHEST for action security_group_rules [ 871.174310] env[65370]: INFO networking_nsxv3.common.synchronization [req-2e6d0524-fece-4dc3-a355-06e34546ac9d req-b28ced02-cff3-43c5-8a14-94acd23b0868 service nova] Enqueued Resource ID: f37147a2-7642-4b7c-a970-ffec078fbee9 with Priority: HIGHEST for action security_group_members [ 871.174488] env[65370]: INFO networking_nsxv3.common.synchronization [req-2e6d0524-fece-4dc3-a355-06e34546ac9d req-b28ced02-cff3-43c5-8a14-94acd23b0868 service nova] Enqueued Resource ID: 24748655-8dd5-4ae0-9e7b-0df721b6022f with Priority: HIGHEST for action port [ 871.174962] env[65370]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f37147a2-7642-4b7c-a970-ffec078fbee9 with Priority: HIGHEST for action security_group_rules [ 871.176988] env[65370]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f37147a2-7642-4b7c-a970-ffec078fbee9 with Priority: HIGHEST for action security_group_members [ 871.176988] env[65370]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 24748655-8dd5-4ae0-9e7b-0df721b6022f with Priority: HIGHEST for action port [ 871.177378] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock rules-f37147a2-7642-4b7c-a970-ffec078fbee9 taken with stack trace [, , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 871.177507] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-f37147a2-7642-4b7c-a970-ffec078fbee9" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 871.178073] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-f37147a2-7642-4b7c-a970-ffec078fbee9" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 871.178073] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-f37147a2-7642-4b7c-a970-ffec078fbee9" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 871.178073] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('f37147a2-7642-4b7c-a970-ffec078fbee9',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 871.179136] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock member-f37147a2-7642-4b7c-a970-ffec078fbee9 taken with stack trace [, , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 871.179300] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f37147a2-7642-4b7c-a970-ffec078fbee9" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 871.179362] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f37147a2-7642-4b7c-a970-ffec078fbee9" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 871.179570] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f37147a2-7642-4b7c-a970-ffec078fbee9" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 871.181404] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 871.181404] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 871.181404] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 871.181404] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 871.181404] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 871.181404] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f37147a2-7642-4b7c-a970-ffec078fbee9',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 871.183848] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock port-24748655-8dd5-4ae0-9e7b-0df721b6022f taken with stack trace [, , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 871.183848] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-24748655-8dd5-4ae0-9e7b-0df721b6022f" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 871.183848] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-24748655-8dd5-4ae0-9e7b-0df721b6022f" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 871.183848] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-24748655-8dd5-4ae0-9e7b-0df721b6022f" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 871.183848] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('24748655-8dd5-4ae0-9e7b-0df721b6022f',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 871.407213] env[65370]: INFO networking_nsxv3.common.synchronization [req-46472351-431a-49ef-beb2-6d2c8ade7920 req-af644960-207a-4180-8a61-0db68fec4b66 tempest-ServersTestBootFromVolume-1353776408 tempest-ServersTestBootFromVolume-1353776408-project-member] Enqueued Resource ID: c26b8d0b-5a65-4082-8dff-404228d547c4 with Priority: HIGHEST for action security_group_members [ 871.407713] env[65370]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c26b8d0b-5a65-4082-8dff-404228d547c4 with Priority: HIGHEST for action security_group_members [ 871.408019] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock member-c26b8d0b-5a65-4082-8dff-404228d547c4 taken with stack trace [, , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 871.408305] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c26b8d0b-5a65-4082-8dff-404228d547c4" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 871.408404] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c26b8d0b-5a65-4082-8dff-404228d547c4" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 871.408586] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c26b8d0b-5a65-4082-8dff-404228d547c4" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 871.408763] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 871.408876] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 871.408913] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 871.409220] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 871.409220] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 871.409357] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c26b8d0b-5a65-4082-8dff-404228d547c4',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 871.685609] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock member-f37147a2-7642-4b7c-a970-ffec078fbee9 taken with stack trace [, , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 871.685609] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f37147a2-7642-4b7c-a970-ffec078fbee9" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 871.685791] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('f37147a2-7642-4b7c-a970-ffec078fbee9',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 871.686737] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 24748655-8dd5-4ae0-9e7b-0df721b6022f with status ACTIVE [ 871.686836] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 871.686909] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 871.686951] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 871.687812] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 871.687812] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 871.687812] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 871.687812] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 871.687812] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 871.687812] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 871.688150] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 871.691534] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 871.691850] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 871.691850] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 871.691943] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 871.691983] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 871.692099] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 24748655-8dd5-4ae0-9e7b-0df721b6022f is going to be updated. [ 871.720429] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 871.720429] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 871.720429] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 871.720429] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 871.720429] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 871.720767] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-24748655-8dd5-4ae0-9e7b-0df721b6022f" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 871.911225] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 871.911453] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 871.911569] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 871.915707] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 871.915707] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 871.915707] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 871.915707] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 871.915707] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 871.915707] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 871.915707] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 871.915707] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c26b8d0b-5a65-4082-8dff-404228d547c4 is going to be updated. [ 871.962046] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 871.962275] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 871.962374] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 871.962603] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 871.962811] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 871.973298] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c26b8d0b-5a65-4082-8dff-404228d547c4 in Status: IN_PROGRESS for 2s [ 872.193899] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('f37147a2-7642-4b7c-a970-ffec078fbee9',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 872.700181] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 872.700181] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 872.700181] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 872.700181] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 872.700181] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 872.700181] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f37147a2-7642-4b7c-a970-ffec078fbee9 is going to be created. [ 872.750585] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 872.750737] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 872.750832] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 872.751091] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 872.751250] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 872.765024] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f37147a2-7642-4b7c-a970-ffec078fbee9 in Status: UNINITIALIZED for 2s [ 873.983758] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c26b8d0b-5a65-4082-8dff-404228d547c4 in Status: SUCCESS [ 873.984114] env[65370]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c26b8d0b-5a65-4082-8dff-404228d547c4 deletion is rescheduled due to dependency. [ 873.984114] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c26b8d0b-5a65-4082-8dff-404228d547c4" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 874.776319] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f37147a2-7642-4b7c-a970-ffec078fbee9 in Status: SUCCESS [ 874.776319] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f37147a2-7642-4b7c-a970-ffec078fbee9" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 874.776591] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f37147a2-7642-4b7c-a970-ffec078fbee9" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 874.776640] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f37147a2-7642-4b7c-a970-ffec078fbee9" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 874.776887] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 874.777367] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 874.777367] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 874.777367] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 874.777367] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 874.777367] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f37147a2-7642-4b7c-a970-ffec078fbee9" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 874.777688] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('f37147a2-7642-4b7c-a970-ffec078fbee9',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 874.996768] env[65370]: INFO networking_nsxv3.common.synchronization [req-b502e515-747c-426d-a82f-a653c249ec7e req-bdbbdc92-08ad-4bbe-9add-29f74add34f6 tempest-ServersAdminNegativeTestJSON-2075318315 tempest-ServersAdminNegativeTestJSON-2075318315-project-member] Enqueued Resource ID: ae63a79d-837f-4a55-a83c-bcd245828917 with Priority: HIGHEST for action security_group_members [ 874.997791] env[65370]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ae63a79d-837f-4a55-a83c-bcd245828917 with Priority: HIGHEST for action security_group_members [ 874.997791] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock member-ae63a79d-837f-4a55-a83c-bcd245828917 taken with stack trace [, , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 874.998036] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ae63a79d-837f-4a55-a83c-bcd245828917" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 874.998036] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ae63a79d-837f-4a55-a83c-bcd245828917" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 874.998539] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ae63a79d-837f-4a55-a83c-bcd245828917" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 874.998539] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 874.998539] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 874.998539] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 874.998767] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 874.998767] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 874.998847] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ae63a79d-837f-4a55-a83c-bcd245828917',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 875.279357] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('f37147a2-7642-4b7c-a970-ffec078fbee9',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 875.408984] env[65370]: DEBUG networking_nsxv3.common.locking [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Lock network-449 taken with stack trace [, , , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 875.409271] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquiring lock "network-449" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 875.409313] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquired lock "network-449" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 875.410613] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquired external semaphore "network-449" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 875.412788] env[65370]: DEBUG networking_nsxv3.common.locking [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 875.414059] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquiring lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 875.414059] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquired lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 875.414059] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquired external semaphore "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 875.414059] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Releasing lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 875.414059] env[65370]: DEBUG dogpile.cache.region [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] No value present for key: 'zone-id' {{(pid=65370) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 875.414059] env[65370]: DEBUG dogpile.lock [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] NeedRegenerationException {{(pid=65370) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 875.414059] env[65370]: DEBUG dogpile.lock [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] no value, waiting for create lock {{(pid=65370) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 875.414494] env[65370]: DEBUG dogpile.lock [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] value creation lock acquired {{(pid=65370) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 875.414494] env[65370]: DEBUG dogpile.cache.region [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] No value present for key: 'zone-id' {{(pid=65370) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 875.414494] env[65370]: DEBUG dogpile.lock [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Calling creation function for not-yet-present value {{(pid=65370) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 875.414494] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 875.438423] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 875.438731] env[65370]: DEBUG dogpile.cache.region [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Cache value generated in 0.024 seconds for key(s): 'zone-id' {{(pid=65370) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 875.438817] env[65370]: DEBUG dogpile.lock [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Released creation lock {{(pid=65370) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 875.438995] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Releasing lock "network-449" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 875.439418] env[65370]: DEBUG networking_nsxv3.common.locking [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Lock port-a5f04d6b-e091-4e4d-a150-2e74f0dde50e taken with stack trace [, , , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 875.439635] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquiring lock "port-a5f04d6b-e091-4e4d-a150-2e74f0dde50e" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 875.439813] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquired lock "port-a5f04d6b-e091-4e4d-a150-2e74f0dde50e" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 875.440209] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquired external semaphore "port-a5f04d6b-e091-4e4d-a150-2e74f0dde50e" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 875.440345] env[65370]: DEBUG networking_nsxv3.api.rpc [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a5f04d6b-e091-4e4d-a150-2e74f0dde50e',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 875.501496] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('ae63a79d-837f-4a55-a83c-bcd245828917',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 875.782427] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for f37147a2-7642-4b7c-a970-ffec078fbee9: rpc.has_security_group_logging(os_id): False [ 875.808908] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 875.809672] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 875.809936] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 875.810197] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 875.810311] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 875.810973] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 875.811174] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 875.811270] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 875.811484] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 875.811618] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 875.811739] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: f37147a2-7642-4b7c-a970-ffec078fbee9 is going to be created. [ 875.906810] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 875.906810] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 875.906810] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 875.906810] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 875.906810] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 875.924134] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: f37147a2-7642-4b7c-a970-ffec078fbee9 in Status: IN_PROGRESS for 2s [ 875.944942] env[65370]: DEBUG networking_nsxv3.common.locking [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 875.945228] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquiring lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 875.948153] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquired lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 875.948153] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquired external semaphore "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 875.948153] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Releasing lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 875.948153] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Segment Port a5f04d6b-e091-4e4d-a150-2e74f0dde50e not found, creating... [ 875.948153] env[65370]: DEBUG networking_nsxv3.common.locking [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 875.948153] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquiring lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 875.948153] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquired lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 875.948153] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquired external semaphore "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 875.948153] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Releasing lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 875.948153] env[65370]: DEBUG networking_nsxv3.common.locking [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 875.948900] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquiring lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 875.949089] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquired lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 875.949334] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquired external semaphore "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 875.949466] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Releasing lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 875.949606] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Resource: SegmentPort with ID: a5f04d6b-e091-4e4d-a150-2e74f0dde50e is going to be created. [ 875.982037] env[65370]: DEBUG networking_nsxv3.common.locking [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 875.982396] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquiring lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 875.982502] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquired lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 875.983122] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquired external semaphore "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 875.983319] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Releasing lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 875.983758] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Releasing lock "port-a5f04d6b-e091-4e4d-a150-2e74f0dde50e" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 876.006988] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('ae63a79d-837f-4a55-a83c-bcd245828917',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 876.511710] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 876.512245] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 876.513066] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 876.513560] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 876.513667] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 876.513747] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ae63a79d-837f-4a55-a83c-bcd245828917 is going to be updated. [ 876.544978] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 876.545217] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 876.545217] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 876.545573] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 876.545573] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 876.562284] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ae63a79d-837f-4a55-a83c-bcd245828917 in Status: IN_PROGRESS for 2s [ 876.691287] env[65370]: INFO networking_nsxv3.common.synchronization [req-b502e515-747c-426d-a82f-a653c249ec7e req-232efe67-434d-44d2-877f-5584fdee9739 service nova] Enqueued Resource ID: ae63a79d-837f-4a55-a83c-bcd245828917 with Priority: HIGHEST for action security_group_rules [ 876.691483] env[65370]: INFO networking_nsxv3.common.synchronization [req-b502e515-747c-426d-a82f-a653c249ec7e req-232efe67-434d-44d2-877f-5584fdee9739 service nova] Enqueued Resource ID: ae63a79d-837f-4a55-a83c-bcd245828917 with Priority: HIGHEST for action security_group_members [ 876.691623] env[65370]: INFO networking_nsxv3.common.synchronization [req-b502e515-747c-426d-a82f-a653c249ec7e req-232efe67-434d-44d2-877f-5584fdee9739 service nova] Enqueued Resource ID: a5f04d6b-e091-4e4d-a150-2e74f0dde50e with Priority: HIGHEST for action port [ 876.692185] env[65370]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ae63a79d-837f-4a55-a83c-bcd245828917 with Priority: HIGHEST for action security_group_rules [ 876.692335] env[65370]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ae63a79d-837f-4a55-a83c-bcd245828917 with Priority: HIGHEST for action security_group_members [ 876.692437] env[65370]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a5f04d6b-e091-4e4d-a150-2e74f0dde50e with Priority: HIGHEST for action port [ 876.692740] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock rules-ae63a79d-837f-4a55-a83c-bcd245828917 taken with stack trace [, , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 876.692920] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-ae63a79d-837f-4a55-a83c-bcd245828917" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 876.692920] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-ae63a79d-837f-4a55-a83c-bcd245828917" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 876.693140] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-ae63a79d-837f-4a55-a83c-bcd245828917" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 876.693221] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('ae63a79d-837f-4a55-a83c-bcd245828917',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 876.694067] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock member-ae63a79d-837f-4a55-a83c-bcd245828917 taken with stack trace [, , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 876.694185] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ae63a79d-837f-4a55-a83c-bcd245828917" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 876.694382] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock port-a5f04d6b-e091-4e4d-a150-2e74f0dde50e taken with stack trace [, , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 876.694499] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-a5f04d6b-e091-4e4d-a150-2e74f0dde50e" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 876.694561] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-a5f04d6b-e091-4e4d-a150-2e74f0dde50e" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 876.694805] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-a5f04d6b-e091-4e4d-a150-2e74f0dde50e" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 876.694858] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a5f04d6b-e091-4e4d-a150-2e74f0dde50e',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 877.199989] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock member-ae63a79d-837f-4a55-a83c-bcd245828917 taken with stack trace [, , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 877.200328] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ae63a79d-837f-4a55-a83c-bcd245828917" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 877.200479] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port a5f04d6b-e091-4e4d-a150-2e74f0dde50e with status ACTIVE [ 877.200598] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 877.200722] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 877.200787] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 877.201036] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 877.201353] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 877.202027] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 877.202027] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 877.202027] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 877.202027] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 877.202027] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 877.202434] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 877.202434] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 877.202534] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 877.202644] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 877.202743] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 877.202849] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: a5f04d6b-e091-4e4d-a150-2e74f0dde50e is going to be updated. [ 877.228697] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 877.228886] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 877.228949] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 877.229130] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 877.229273] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 877.229436] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-a5f04d6b-e091-4e4d-a150-2e74f0dde50e" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 877.830237] env[65370]: INFO networking_nsxv3.common.synchronization [req-ec30ae9e-593e-47f0-bbf2-0ad8d1cf31f4 req-0b105ad0-b59c-4fe3-9123-da20afcf042a tempest-ImagesTestJSON-246049254 tempest-ImagesTestJSON-246049254-project-member] Enqueued Resource ID: 67f4a0c1-3a3c-4ed8-9358-3a9645aba154 with Priority: HIGHEST for action security_group_members [ 877.830758] env[65370]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 67f4a0c1-3a3c-4ed8-9358-3a9645aba154 with Priority: HIGHEST for action security_group_members [ 877.831068] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock member-67f4a0c1-3a3c-4ed8-9358-3a9645aba154 taken with stack trace [, , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 877.831192] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-67f4a0c1-3a3c-4ed8-9358-3a9645aba154" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 877.831255] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-67f4a0c1-3a3c-4ed8-9358-3a9645aba154" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 877.831451] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-67f4a0c1-3a3c-4ed8-9358-3a9645aba154" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 877.831603] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 877.831711] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 877.831771] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 877.831900] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 877.831984] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 877.832092] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('67f4a0c1-3a3c-4ed8-9358-3a9645aba154',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 877.941326] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: f37147a2-7642-4b7c-a970-ffec078fbee9 in Status: SUCCESS [ 877.941682] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-f37147a2-7642-4b7c-a970-ffec078fbee9" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 878.225041] env[65370]: DEBUG networking_nsxv3.common.locking [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Lock network-955 taken with stack trace [, , , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 878.225356] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquiring lock "network-955" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 878.225356] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquired lock "network-955" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 878.225615] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquired external semaphore "network-955" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 878.225877] env[65370]: DEBUG networking_nsxv3.common.locking [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 878.226046] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquiring lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 878.226210] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquired lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 878.226445] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquired external semaphore "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 878.226590] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Releasing lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 878.226800] env[65370]: DEBUG dogpile.cache.region [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] No value present for key: 'zone-id' {{(pid=65370) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 878.226909] env[65370]: DEBUG dogpile.lock [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] NeedRegenerationException {{(pid=65370) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 878.227028] env[65370]: DEBUG dogpile.lock [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] no value, waiting for create lock {{(pid=65370) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 878.227138] env[65370]: DEBUG dogpile.lock [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] value creation lock acquired {{(pid=65370) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 878.227251] env[65370]: DEBUG dogpile.cache.region [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] No value present for key: 'zone-id' {{(pid=65370) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 878.227347] env[65370]: DEBUG dogpile.lock [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Calling creation function for not-yet-present value {{(pid=65370) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 878.227476] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 878.257307] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 878.257561] env[65370]: DEBUG dogpile.cache.region [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Cache value generated in 0.030 seconds for key(s): 'zone-id' {{(pid=65370) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 878.257762] env[65370]: DEBUG dogpile.lock [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Released creation lock {{(pid=65370) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 878.258104] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Releasing lock "network-955" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 878.258409] env[65370]: DEBUG networking_nsxv3.common.locking [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Lock port-b13c1b6f-a76e-4abc-bbe7-3b586bd445ba taken with stack trace [, , , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 878.258652] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquiring lock "port-b13c1b6f-a76e-4abc-bbe7-3b586bd445ba" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 878.258859] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquired lock "port-b13c1b6f-a76e-4abc-bbe7-3b586bd445ba" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 878.259211] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquired external semaphore "port-b13c1b6f-a76e-4abc-bbe7-3b586bd445ba" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 878.259376] env[65370]: DEBUG networking_nsxv3.api.rpc [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b13c1b6f-a76e-4abc-bbe7-3b586bd445ba',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 878.334558] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('67f4a0c1-3a3c-4ed8-9358-3a9645aba154',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 878.574613] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ae63a79d-837f-4a55-a83c-bcd245828917 in Status: SUCCESS [ 878.574835] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ae63a79d-837f-4a55-a83c-bcd245828917" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 878.575026] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ae63a79d-837f-4a55-a83c-bcd245828917" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 878.575321] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ae63a79d-837f-4a55-a83c-bcd245828917" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 878.575570] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 878.575712] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 878.575787] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 878.575982] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 878.576084] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 878.576210] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ae63a79d-837f-4a55-a83c-bcd245828917',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 878.764053] env[65370]: DEBUG networking_nsxv3.common.locking [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 878.764424] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquiring lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 878.764636] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquired lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 878.764961] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquired external semaphore "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 878.765158] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Releasing lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 878.765349] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Segment Port b13c1b6f-a76e-4abc-bbe7-3b586bd445ba not found, creating... [ 878.765634] env[65370]: DEBUG networking_nsxv3.common.locking [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 878.765914] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquiring lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 878.766065] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquired lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 878.766590] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquired external semaphore "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 878.766809] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Releasing lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 878.767311] env[65370]: DEBUG networking_nsxv3.common.locking [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 878.767498] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquiring lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 878.767618] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquired lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 878.767831] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquired external semaphore "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 878.767968] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Releasing lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 878.768157] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Resource: SegmentPort with ID: b13c1b6f-a76e-4abc-bbe7-3b586bd445ba is going to be created. [ 878.792013] env[65370]: DEBUG networking_nsxv3.common.locking [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 878.792240] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquiring lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 878.792363] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquired lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 878.792782] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquired external semaphore "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 878.793030] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Releasing lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 878.793284] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Releasing lock "port-b13c1b6f-a76e-4abc-bbe7-3b586bd445ba" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 878.838218] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('67f4a0c1-3a3c-4ed8-9358-3a9645aba154',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 879.033099] env[65370]: INFO networking_nsxv3.common.synchronization [req-e97f8031-6351-4338-a9f2-788698a4a5f8 req-c6a47531-6efc-4196-befb-4bb89c7b830e tempest-MigrationsAdminTest-1653527346 tempest-MigrationsAdminTest-1653527346-project-member] Enqueued Resource ID: 00a251e9-7a00-4293-9092-9556bc8b91c2 with Priority: HIGHEST for action security_group_members [ 879.033099] env[65370]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 00a251e9-7a00-4293-9092-9556bc8b91c2 with Priority: HIGHEST for action security_group_members [ 879.033535] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock member-00a251e9-7a00-4293-9092-9556bc8b91c2 taken with stack trace [, , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 879.033535] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-00a251e9-7a00-4293-9092-9556bc8b91c2" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 879.033535] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-00a251e9-7a00-4293-9092-9556bc8b91c2" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 879.033535] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-00a251e9-7a00-4293-9092-9556bc8b91c2" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 879.033710] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 879.033763] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 879.033806] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 879.033930] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 879.034053] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 879.034142] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('00a251e9-7a00-4293-9092-9556bc8b91c2',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 879.111647] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('ae63a79d-837f-4a55-a83c-bcd245828917',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 879.342113] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 879.342473] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 879.342473] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 879.342662] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 879.342662] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 879.342781] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 67f4a0c1-3a3c-4ed8-9358-3a9645aba154 is going to be updated. [ 879.375577] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 879.375730] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 879.375800] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 879.376008] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 879.376192] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 879.385544] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 67f4a0c1-3a3c-4ed8-9358-3a9645aba154 in Status: IN_PROGRESS for 2s [ 879.527080] env[65370]: INFO networking_nsxv3.common.synchronization [req-ec30ae9e-593e-47f0-bbf2-0ad8d1cf31f4 req-6228b921-f01c-4be5-864c-779b88a4eb23 service nova] Enqueued Resource ID: 67f4a0c1-3a3c-4ed8-9358-3a9645aba154 with Priority: HIGHEST for action security_group_rules [ 879.527080] env[65370]: INFO networking_nsxv3.common.synchronization [req-ec30ae9e-593e-47f0-bbf2-0ad8d1cf31f4 req-6228b921-f01c-4be5-864c-779b88a4eb23 service nova] Enqueued Resource ID: 67f4a0c1-3a3c-4ed8-9358-3a9645aba154 with Priority: HIGHEST for action security_group_members [ 879.527080] env[65370]: INFO networking_nsxv3.common.synchronization [req-ec30ae9e-593e-47f0-bbf2-0ad8d1cf31f4 req-6228b921-f01c-4be5-864c-779b88a4eb23 service nova] Enqueued Resource ID: b13c1b6f-a76e-4abc-bbe7-3b586bd445ba with Priority: HIGHEST for action port [ 879.527080] env[65370]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 67f4a0c1-3a3c-4ed8-9358-3a9645aba154 with Priority: HIGHEST for action security_group_rules [ 879.527080] env[65370]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 67f4a0c1-3a3c-4ed8-9358-3a9645aba154 with Priority: HIGHEST for action security_group_members [ 879.527080] env[65370]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b13c1b6f-a76e-4abc-bbe7-3b586bd445ba with Priority: HIGHEST for action port [ 879.527080] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock rules-67f4a0c1-3a3c-4ed8-9358-3a9645aba154 taken with stack trace [, , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 879.527080] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-67f4a0c1-3a3c-4ed8-9358-3a9645aba154" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 879.527080] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-67f4a0c1-3a3c-4ed8-9358-3a9645aba154" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 879.527080] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-67f4a0c1-3a3c-4ed8-9358-3a9645aba154" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 879.527583] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('67f4a0c1-3a3c-4ed8-9358-3a9645aba154',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 879.528010] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock member-67f4a0c1-3a3c-4ed8-9358-3a9645aba154 taken with stack trace [, , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 879.528131] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-67f4a0c1-3a3c-4ed8-9358-3a9645aba154" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 879.528279] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock port-b13c1b6f-a76e-4abc-bbe7-3b586bd445ba taken with stack trace [, , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 879.528416] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b13c1b6f-a76e-4abc-bbe7-3b586bd445ba" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 879.528472] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b13c1b6f-a76e-4abc-bbe7-3b586bd445ba" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 879.528717] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b13c1b6f-a76e-4abc-bbe7-3b586bd445ba" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 879.528717] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b13c1b6f-a76e-4abc-bbe7-3b586bd445ba',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 879.536766] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('00a251e9-7a00-4293-9092-9556bc8b91c2',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 879.580395] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('ae63a79d-837f-4a55-a83c-bcd245828917',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 880.030864] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock member-67f4a0c1-3a3c-4ed8-9358-3a9645aba154 taken with stack trace [, , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 880.032023] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-67f4a0c1-3a3c-4ed8-9358-3a9645aba154" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 880.032139] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port b13c1b6f-a76e-4abc-bbe7-3b586bd445ba with status ACTIVE [ 880.032298] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 880.032412] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 880.032524] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 880.033552] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 880.033552] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 880.033552] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 880.033552] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 880.033552] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 880.033552] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 880.033552] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 880.033903] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 880.033903] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 880.033903] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 880.034078] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 880.034078] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 880.034157] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: b13c1b6f-a76e-4abc-bbe7-3b586bd445ba is going to be updated. [ 880.039138] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('00a251e9-7a00-4293-9092-9556bc8b91c2',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 880.060036] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 880.060036] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 880.060036] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 880.060036] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 880.060036] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 880.060036] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b13c1b6f-a76e-4abc-bbe7-3b586bd445ba" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 880.083077] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 880.083307] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 880.083408] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 880.083665] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 880.083782] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 880.083930] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ae63a79d-837f-4a55-a83c-bcd245828917 is going to be updated. [ 880.133162] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 880.133274] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 880.133358] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 880.133599] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 880.134280] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 880.154586] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ae63a79d-837f-4a55-a83c-bcd245828917 in Status: IN_PROGRESS for 2s [ 880.544728] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 880.544728] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 880.544728] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 880.544728] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 880.544728] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 880.544728] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 00a251e9-7a00-4293-9092-9556bc8b91c2 is going to be updated. [ 880.574845] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 880.574845] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 880.574845] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 880.574845] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 880.574845] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 880.583670] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 00a251e9-7a00-4293-9092-9556bc8b91c2 in Status: IN_PROGRESS for 2s [ 881.398317] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 67f4a0c1-3a3c-4ed8-9358-3a9645aba154 in Status: SUCCESS [ 881.399079] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-67f4a0c1-3a3c-4ed8-9358-3a9645aba154" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 881.399079] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-67f4a0c1-3a3c-4ed8-9358-3a9645aba154" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 881.399079] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-67f4a0c1-3a3c-4ed8-9358-3a9645aba154" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 881.399079] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 881.399243] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 881.399273] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 881.399412] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 881.399495] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 881.399590] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('67f4a0c1-3a3c-4ed8-9358-3a9645aba154',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 881.905036] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('67f4a0c1-3a3c-4ed8-9358-3a9645aba154',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 882.168098] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ae63a79d-837f-4a55-a83c-bcd245828917 in Status: SUCCESS [ 882.168351] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ae63a79d-837f-4a55-a83c-bcd245828917" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 882.168555] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ae63a79d-837f-4a55-a83c-bcd245828917" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 882.168792] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ae63a79d-837f-4a55-a83c-bcd245828917" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 882.168984] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 882.169170] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 882.169216] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 882.169370] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 882.169398] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 882.169481] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ae63a79d-837f-4a55-a83c-bcd245828917" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 882.169571] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('ae63a79d-837f-4a55-a83c-bcd245828917',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 882.408621] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('67f4a0c1-3a3c-4ed8-9358-3a9645aba154',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 882.606321] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 00a251e9-7a00-4293-9092-9556bc8b91c2 in Status: SUCCESS [ 882.606321] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-00a251e9-7a00-4293-9092-9556bc8b91c2" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 882.671908] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock member-ae63a79d-837f-4a55-a83c-bcd245828917 taken with stack trace [, , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 882.672135] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ae63a79d-837f-4a55-a83c-bcd245828917" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 882.672237] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ae63a79d-837f-4a55-a83c-bcd245828917" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 882.672519] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ae63a79d-837f-4a55-a83c-bcd245828917" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 882.673520] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 882.673520] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 882.673520] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 882.673520] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 882.673520] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 882.673520] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ae63a79d-837f-4a55-a83c-bcd245828917" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 882.673520] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock member-ae63a79d-837f-4a55-a83c-bcd245828917 taken with stack trace [, , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 882.673844] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ae63a79d-837f-4a55-a83c-bcd245828917" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 882.673844] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ae63a79d-837f-4a55-a83c-bcd245828917" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 882.673844] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ae63a79d-837f-4a55-a83c-bcd245828917" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 882.673985] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 882.674125] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 882.674193] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 882.674351] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 882.674427] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 882.674532] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ae63a79d-837f-4a55-a83c-bcd245828917" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 882.675449] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('ae63a79d-837f-4a55-a83c-bcd245828917',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 882.911542] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 882.911885] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 882.911885] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 882.912329] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 882.912416] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 882.912565] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 67f4a0c1-3a3c-4ed8-9358-3a9645aba154 is going to be updated. [ 882.947688] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 882.947854] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 882.947907] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 882.948129] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 882.948281] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 882.959534] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 67f4a0c1-3a3c-4ed8-9358-3a9645aba154 in Status: IN_PROGRESS for 2s [ 883.177209] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for ae63a79d-837f-4a55-a83c-bcd245828917: rpc.has_security_group_logging(os_id): False [ 883.200083] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 883.200083] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 883.200083] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 883.200083] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 883.200083] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 883.200083] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 883.200083] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 883.200083] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 883.200083] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 883.200083] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 883.200083] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 883.200083] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 883.200083] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 883.200083] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 883.200083] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 883.200693] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 883.200693] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 883.200693] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 883.200693] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 883.200693] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 883.200693] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: ae63a79d-837f-4a55-a83c-bcd245828917 is going to be updated. [ 883.268818] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 883.268968] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 883.269062] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 883.269265] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 883.269409] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 883.284268] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ae63a79d-837f-4a55-a83c-bcd245828917 in Status: IN_PROGRESS for 2s [ 883.533823] env[65370]: INFO networking_nsxv3.common.synchronization [req-3a99d4f0-40a5-4df3-8893-4217b277a8a4 req-c2d77903-9688-4cad-b121-f3f8969f8c0b tempest-ServersAdminTestJSON-387254877 tempest-ServersAdminTestJSON-387254877-project-member] Enqueued Resource ID: feaf18c3-295c-41df-89f1-309931cdeca1 with Priority: HIGHEST for action security_group_members [ 883.535377] env[65370]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: feaf18c3-295c-41df-89f1-309931cdeca1 with Priority: HIGHEST for action security_group_members [ 883.535377] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock member-feaf18c3-295c-41df-89f1-309931cdeca1 taken with stack trace [, , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 883.535377] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-feaf18c3-295c-41df-89f1-309931cdeca1" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 883.535377] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-feaf18c3-295c-41df-89f1-309931cdeca1" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 883.535377] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-feaf18c3-295c-41df-89f1-309931cdeca1" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 883.535377] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 883.535377] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 883.535377] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 883.535377] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 883.535377] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 883.535784] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('feaf18c3-295c-41df-89f1-309931cdeca1',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 884.038378] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('feaf18c3-295c-41df-89f1-309931cdeca1',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 884.541450] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('feaf18c3-295c-41df-89f1-309931cdeca1',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 884.971926] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 67f4a0c1-3a3c-4ed8-9358-3a9645aba154 in Status: SUCCESS [ 884.972053] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-67f4a0c1-3a3c-4ed8-9358-3a9645aba154" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 884.972783] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-67f4a0c1-3a3c-4ed8-9358-3a9645aba154" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 884.972783] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-67f4a0c1-3a3c-4ed8-9358-3a9645aba154" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 884.972783] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 884.972783] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 884.972996] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 884.972996] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 884.973085] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 884.973159] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-67f4a0c1-3a3c-4ed8-9358-3a9645aba154" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 884.973314] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('67f4a0c1-3a3c-4ed8-9358-3a9645aba154',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 885.045455] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 885.045455] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 885.045455] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 885.045455] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 885.045455] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 885.045455] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: feaf18c3-295c-41df-89f1-309931cdeca1 is going to be updated. [ 885.086438] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 885.087387] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 885.087387] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 885.087387] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 885.087387] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 885.097465] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: feaf18c3-295c-41df-89f1-309931cdeca1 in Status: IN_PROGRESS for 2s [ 885.308396] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ae63a79d-837f-4a55-a83c-bcd245828917 in Status: SUCCESS [ 885.308396] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-ae63a79d-837f-4a55-a83c-bcd245828917" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 885.476843] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock member-67f4a0c1-3a3c-4ed8-9358-3a9645aba154 taken with stack trace [, , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 885.477021] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-67f4a0c1-3a3c-4ed8-9358-3a9645aba154" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 885.477106] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-67f4a0c1-3a3c-4ed8-9358-3a9645aba154" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 885.478933] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-67f4a0c1-3a3c-4ed8-9358-3a9645aba154" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 885.478933] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 885.479079] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 885.479109] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 885.479318] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 885.479399] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 885.479488] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-67f4a0c1-3a3c-4ed8-9358-3a9645aba154" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 885.479645] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock member-67f4a0c1-3a3c-4ed8-9358-3a9645aba154 taken with stack trace [, , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 885.479754] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-67f4a0c1-3a3c-4ed8-9358-3a9645aba154" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 885.479838] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-67f4a0c1-3a3c-4ed8-9358-3a9645aba154" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 885.479971] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-67f4a0c1-3a3c-4ed8-9358-3a9645aba154" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 885.480135] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 885.480239] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 885.480291] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 885.480444] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 885.480516] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 885.480745] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-67f4a0c1-3a3c-4ed8-9358-3a9645aba154" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 885.480745] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('67f4a0c1-3a3c-4ed8-9358-3a9645aba154',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 885.768786] env[65370]: INFO networking_nsxv3.common.synchronization [None req-89792603-93c0-4b96-841e-fc1bc54f3086 None None] Enqueued Resource ID: f32eab9c-faf2-418a-8ae9-da2cc7b33f94 with Priority: HIGHEST for action port [ 885.769437] env[65370]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f32eab9c-faf2-418a-8ae9-da2cc7b33f94 with Priority: HIGHEST for action port [ 885.769761] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock port-f32eab9c-faf2-418a-8ae9-da2cc7b33f94 taken with stack trace [, , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 885.769889] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-f32eab9c-faf2-418a-8ae9-da2cc7b33f94" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 885.769987] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-f32eab9c-faf2-418a-8ae9-da2cc7b33f94" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 885.770424] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-f32eab9c-faf2-418a-8ae9-da2cc7b33f94" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 885.770531] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f32eab9c-faf2-418a-8ae9-da2cc7b33f94',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 885.984288] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 67f4a0c1-3a3c-4ed8-9358-3a9645aba154: rpc.has_security_group_logging(os_id): False [ 886.026603] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 886.026913] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 886.026913] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 886.027280] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 886.073363] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 886.073715] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 886.073892] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 886.073954] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 886.074311] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 886.074416] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 886.074652] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 886.074765] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 886.074827] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 886.074995] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 886.075084] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 886.075272] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 886.075407] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 886.075466] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 886.075568] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 886.075640] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 886.075727] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 67f4a0c1-3a3c-4ed8-9358-3a9645aba154 is going to be updated. [ 886.144583] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 886.144649] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 886.144773] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 886.145399] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 886.145399] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 886.163371] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 67f4a0c1-3a3c-4ed8-9358-3a9645aba154 in Status: IN_PROGRESS for 2s [ 886.274207] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port f32eab9c-faf2-418a-8ae9-da2cc7b33f94 [ 886.274491] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 886.275155] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 886.275233] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 886.275870] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 886.275870] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 886.275870] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:f32eab9c-faf2-418a-8ae9-da2cc7b33f94 already deleted. [ 886.275870] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-f32eab9c-faf2-418a-8ae9-da2cc7b33f94" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 886.295725] env[65370]: INFO networking_nsxv3.common.synchronization [req-cc3dbc9d-9a9d-43fd-b2ad-08baf1d3267e req-0a2b1e5e-392a-465c-a979-84f04a7398ae tempest-FloatingIPsAssociationTestJSON-1189544841 tempest-FloatingIPsAssociationTestJSON-1189544841-project-member] Enqueued Resource ID: de5a6b9b-a5a9-4ccc-b897-0244548cc5fd with Priority: HIGHEST for action security_group_members [ 886.296022] env[65370]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: de5a6b9b-a5a9-4ccc-b897-0244548cc5fd with Priority: HIGHEST for action security_group_members [ 886.296379] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock member-de5a6b9b-a5a9-4ccc-b897-0244548cc5fd taken with stack trace [, , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 886.296507] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-de5a6b9b-a5a9-4ccc-b897-0244548cc5fd" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 886.296570] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-de5a6b9b-a5a9-4ccc-b897-0244548cc5fd" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 886.296842] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-de5a6b9b-a5a9-4ccc-b897-0244548cc5fd" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 886.297012] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 886.299700] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 886.299795] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 886.300036] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 886.300085] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 886.300171] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('de5a6b9b-a5a9-4ccc-b897-0244548cc5fd',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 886.772666] env[65370]: DEBUG networking_nsxv3.common.locking [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Lock network-161 taken with stack trace [, , , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 886.772883] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquiring lock "network-161" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 886.773017] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquired lock "network-161" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 886.773348] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquired external semaphore "network-161" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 886.773602] env[65370]: DEBUG networking_nsxv3.common.locking [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 886.773758] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquiring lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 886.773869] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquired lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 886.774445] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquired external semaphore "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 886.774624] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Releasing lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 886.774835] env[65370]: DEBUG dogpile.cache.region [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] No value present for key: 'zone-id' {{(pid=65370) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 886.774948] env[65370]: DEBUG dogpile.lock [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] NeedRegenerationException {{(pid=65370) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 886.775079] env[65370]: DEBUG dogpile.lock [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] no value, waiting for create lock {{(pid=65370) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 886.775280] env[65370]: DEBUG dogpile.lock [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] value creation lock acquired {{(pid=65370) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 886.775471] env[65370]: DEBUG dogpile.cache.region [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] No value present for key: 'zone-id' {{(pid=65370) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 886.775587] env[65370]: DEBUG dogpile.lock [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Calling creation function for not-yet-present value {{(pid=65370) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 886.775724] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 886.800065] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 886.800329] env[65370]: DEBUG dogpile.cache.region [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Cache value generated in 0.024 seconds for key(s): 'zone-id' {{(pid=65370) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 886.800758] env[65370]: DEBUG dogpile.lock [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Released creation lock {{(pid=65370) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 886.800987] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Releasing lock "network-161" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 886.801176] env[65370]: DEBUG networking_nsxv3.common.locking [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Lock port-bcae91d3-e523-4d84-bbfe-7fc7307454f9 taken with stack trace [, , , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 886.801444] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquiring lock "port-bcae91d3-e523-4d84-bbfe-7fc7307454f9" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 886.801694] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquired lock "port-bcae91d3-e523-4d84-bbfe-7fc7307454f9" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 886.802058] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquired external semaphore "port-bcae91d3-e523-4d84-bbfe-7fc7307454f9" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 886.802268] env[65370]: DEBUG networking_nsxv3.api.rpc [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('bcae91d3-e523-4d84-bbfe-7fc7307454f9',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 886.807143] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 886.807362] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 886.808529] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 886.808529] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 886.808529] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 886.808529] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 886.808529] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 886.808529] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 886.808529] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 886.809235] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 886.809235] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: de5a6b9b-a5a9-4ccc-b897-0244548cc5fd already deleted. [ 886.809235] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-de5a6b9b-a5a9-4ccc-b897-0244548cc5fd" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 887.112123] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: feaf18c3-295c-41df-89f1-309931cdeca1 in Status: SUCCESS [ 887.112427] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-feaf18c3-295c-41df-89f1-309931cdeca1" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 887.311124] env[65370]: DEBUG networking_nsxv3.common.locking [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 887.311124] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquiring lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 887.311124] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquired lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 887.311335] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquired external semaphore "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 887.311335] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Releasing lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 887.311484] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Segment Port bcae91d3-e523-4d84-bbfe-7fc7307454f9 not found, creating... [ 887.311778] env[65370]: DEBUG networking_nsxv3.common.locking [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 887.311972] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquiring lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 887.312276] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquired lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 887.312402] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquired external semaphore "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 887.312449] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Releasing lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 887.312698] env[65370]: DEBUG networking_nsxv3.common.locking [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 887.312850] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquiring lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 887.313108] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquired lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 887.313282] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquired external semaphore "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 887.313423] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Releasing lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 887.313573] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Resource: SegmentPort with ID: bcae91d3-e523-4d84-bbfe-7fc7307454f9 is going to be created. [ 887.337279] env[65370]: DEBUG networking_nsxv3.common.locking [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 887.337885] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquiring lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 887.337985] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquired lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 887.338425] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquired external semaphore "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 887.338837] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Releasing lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 887.339295] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Releasing lock "port-bcae91d3-e523-4d84-bbfe-7fc7307454f9" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 888.085611] env[65370]: INFO networking_nsxv3.common.synchronization [req-cc3dbc9d-9a9d-43fd-b2ad-08baf1d3267e req-1fc03365-952d-4503-b26e-4376e9d737f0 service nova] Enqueued Resource ID: de5a6b9b-a5a9-4ccc-b897-0244548cc5fd with Priority: HIGHEST for action security_group_rules [ 888.086186] env[65370]: INFO networking_nsxv3.common.synchronization [req-cc3dbc9d-9a9d-43fd-b2ad-08baf1d3267e req-1fc03365-952d-4503-b26e-4376e9d737f0 service nova] Enqueued Resource ID: de5a6b9b-a5a9-4ccc-b897-0244548cc5fd with Priority: HIGHEST for action security_group_members [ 888.086186] env[65370]: INFO networking_nsxv3.common.synchronization [req-cc3dbc9d-9a9d-43fd-b2ad-08baf1d3267e req-1fc03365-952d-4503-b26e-4376e9d737f0 service nova] Enqueued Resource ID: bcae91d3-e523-4d84-bbfe-7fc7307454f9 with Priority: HIGHEST for action port [ 888.087123] env[65370]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: de5a6b9b-a5a9-4ccc-b897-0244548cc5fd with Priority: HIGHEST for action security_group_rules [ 888.087123] env[65370]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: de5a6b9b-a5a9-4ccc-b897-0244548cc5fd with Priority: HIGHEST for action security_group_members [ 888.087123] env[65370]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bcae91d3-e523-4d84-bbfe-7fc7307454f9 with Priority: HIGHEST for action port [ 888.087314] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock rules-de5a6b9b-a5a9-4ccc-b897-0244548cc5fd taken with stack trace [, , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 888.087314] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-de5a6b9b-a5a9-4ccc-b897-0244548cc5fd" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 888.087409] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-de5a6b9b-a5a9-4ccc-b897-0244548cc5fd" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 888.087681] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-de5a6b9b-a5a9-4ccc-b897-0244548cc5fd" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 888.087754] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('de5a6b9b-a5a9-4ccc-b897-0244548cc5fd',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 888.088785] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock member-de5a6b9b-a5a9-4ccc-b897-0244548cc5fd taken with stack trace [, , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 888.088924] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-de5a6b9b-a5a9-4ccc-b897-0244548cc5fd" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 888.089025] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-de5a6b9b-a5a9-4ccc-b897-0244548cc5fd" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 888.089257] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-de5a6b9b-a5a9-4ccc-b897-0244548cc5fd" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 888.089795] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 888.089921] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 888.090688] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 888.090688] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 888.090688] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 888.090688] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('de5a6b9b-a5a9-4ccc-b897-0244548cc5fd',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 888.091296] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock port-bcae91d3-e523-4d84-bbfe-7fc7307454f9 taken with stack trace [, , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 888.091550] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-bcae91d3-e523-4d84-bbfe-7fc7307454f9" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 888.091550] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-bcae91d3-e523-4d84-bbfe-7fc7307454f9" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 888.091619] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-bcae91d3-e523-4d84-bbfe-7fc7307454f9" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 888.091726] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('bcae91d3-e523-4d84-bbfe-7fc7307454f9',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 888.179521] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 67f4a0c1-3a3c-4ed8-9358-3a9645aba154 in Status: SUCCESS [ 888.179521] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-67f4a0c1-3a3c-4ed8-9358-3a9645aba154" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 888.593608] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('de5a6b9b-a5a9-4ccc-b897-0244548cc5fd',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 888.595144] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock member-de5a6b9b-a5a9-4ccc-b897-0244548cc5fd taken with stack trace [, , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 888.595285] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-de5a6b9b-a5a9-4ccc-b897-0244548cc5fd" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 888.595932] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port bcae91d3-e523-4d84-bbfe-7fc7307454f9 with status ACTIVE [ 888.601782] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 888.601782] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 888.601782] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 888.601782] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 888.601782] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 888.601782] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 888.601782] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 888.601782] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 888.601782] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 888.601782] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 888.601782] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 888.601782] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 888.601782] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 888.602270] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 888.602270] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 888.602270] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: bcae91d3-e523-4d84-bbfe-7fc7307454f9 is going to be updated. [ 888.624075] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 888.624238] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 888.624282] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 888.624689] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 888.624689] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 888.624793] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-bcae91d3-e523-4d84-bbfe-7fc7307454f9" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 888.790288] env[65370]: INFO networking_nsxv3.common.synchronization [req-d703b09a-8503-481a-b3af-a7e026f83432 req-24e7f7bc-7f84-41bd-ab79-d3b589c57233 tempest-ImagesOneServerNegativeTestJSON-1384686973 tempest-ImagesOneServerNegativeTestJSON-1384686973-project-member] Enqueued Resource ID: e2790d7c-6d0c-45bc-84d1-8cb00d26b9b0 with Priority: HIGHEST for action security_group_members [ 888.790288] env[65370]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e2790d7c-6d0c-45bc-84d1-8cb00d26b9b0 with Priority: HIGHEST for action security_group_members [ 888.790288] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock member-e2790d7c-6d0c-45bc-84d1-8cb00d26b9b0 taken with stack trace [, , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 888.790288] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e2790d7c-6d0c-45bc-84d1-8cb00d26b9b0" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 888.790537] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e2790d7c-6d0c-45bc-84d1-8cb00d26b9b0" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 888.790568] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e2790d7c-6d0c-45bc-84d1-8cb00d26b9b0" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 888.790739] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 888.790818] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 888.790877] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 888.791616] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 888.791616] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 888.791616] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e2790d7c-6d0c-45bc-84d1-8cb00d26b9b0',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 889.103754] env[65370]: INFO networking_nsxv3.common.synchronization [None req-371b8018-adbd-4c51-814b-8c109870b649 None None] Enqueued Resource ID: d93a3ee4-4626-4912-969d-9371e72ef99c with Priority: HIGHEST for action port [ 889.104752] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('de5a6b9b-a5a9-4ccc-b897-0244548cc5fd',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 889.105405] env[65370]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d93a3ee4-4626-4912-969d-9371e72ef99c with Priority: HIGHEST for action port [ 889.106062] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock port-d93a3ee4-4626-4912-969d-9371e72ef99c taken with stack trace [, , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 889.106062] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-d93a3ee4-4626-4912-969d-9371e72ef99c" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 889.106062] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-d93a3ee4-4626-4912-969d-9371e72ef99c" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 889.106378] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-d93a3ee4-4626-4912-969d-9371e72ef99c" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 889.106454] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d93a3ee4-4626-4912-969d-9371e72ef99c',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 889.144799] env[65370]: DEBUG networking_nsxv3.common.locking [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Lock network-823 taken with stack trace [, , , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 889.145341] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquiring lock "network-823" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 889.145582] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquired lock "network-823" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 889.145933] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquired external semaphore "network-823" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 889.146326] env[65370]: DEBUG networking_nsxv3.common.locking [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 889.146613] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquiring lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 889.146813] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquired lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 889.147126] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquired external semaphore "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 889.147379] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Releasing lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 889.147671] env[65370]: DEBUG dogpile.cache.region [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] No value present for key: 'zone-id' {{(pid=65370) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 889.147859] env[65370]: DEBUG dogpile.lock [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] NeedRegenerationException {{(pid=65370) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 889.148047] env[65370]: DEBUG dogpile.lock [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] no value, waiting for create lock {{(pid=65370) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 889.148244] env[65370]: DEBUG dogpile.lock [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] value creation lock acquired {{(pid=65370) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 889.148436] env[65370]: DEBUG dogpile.cache.region [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] No value present for key: 'zone-id' {{(pid=65370) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 889.150635] env[65370]: DEBUG dogpile.lock [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Calling creation function for not-yet-present value {{(pid=65370) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 889.150635] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 889.171828] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 889.171828] env[65370]: DEBUG dogpile.cache.region [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=65370) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 889.171828] env[65370]: DEBUG dogpile.lock [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Released creation lock {{(pid=65370) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 889.171828] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Releasing lock "network-823" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 889.171828] env[65370]: DEBUG networking_nsxv3.common.locking [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Lock port-1ca63f4a-52c8-4d53-89ac-e903b7b7b09b taken with stack trace [, , , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 889.171828] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquiring lock "port-1ca63f4a-52c8-4d53-89ac-e903b7b7b09b" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 889.171828] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquired lock "port-1ca63f4a-52c8-4d53-89ac-e903b7b7b09b" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 889.171828] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquired external semaphore "port-1ca63f4a-52c8-4d53-89ac-e903b7b7b09b" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 889.171828] env[65370]: DEBUG networking_nsxv3.api.rpc [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1ca63f4a-52c8-4d53-89ac-e903b7b7b09b',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 889.295112] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 889.295112] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 889.295112] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 889.295112] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 889.320925] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 889.320925] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 889.320925] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 889.320925] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 889.320925] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 889.320925] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 889.320925] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e2790d7c-6d0c-45bc-84d1-8cb00d26b9b0 is going to be updated. [ 889.355420] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 889.355568] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 889.355640] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 889.355874] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 889.356046] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 889.365381] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e2790d7c-6d0c-45bc-84d1-8cb00d26b9b0 in Status: IN_PROGRESS for 2s [ 889.606874] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 889.607058] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 889.607119] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 889.607377] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 889.607471] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 889.608153] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: de5a6b9b-a5a9-4ccc-b897-0244548cc5fd is going to be created. [ 889.608754] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port d93a3ee4-4626-4912-969d-9371e72ef99c [ 889.608932] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 889.610187] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 889.610187] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 889.610187] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 889.610187] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 889.610187] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:d93a3ee4-4626-4912-969d-9371e72ef99c already deleted. [ 889.610187] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-d93a3ee4-4626-4912-969d-9371e72ef99c" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 889.637070] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 889.637296] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 889.637376] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 889.637627] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 889.637794] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 889.648519] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: de5a6b9b-a5a9-4ccc-b897-0244548cc5fd in Status: UNINITIALIZED for 2s [ 889.676837] env[65370]: DEBUG networking_nsxv3.common.locking [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 889.676837] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquiring lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 889.677153] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquired lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 889.677300] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquired external semaphore "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 889.677475] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Releasing lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 889.677967] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Segment Port 1ca63f4a-52c8-4d53-89ac-e903b7b7b09b not found, creating... [ 889.677967] env[65370]: DEBUG networking_nsxv3.common.locking [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 889.678133] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquiring lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 889.678250] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquired lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 889.678420] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquired external semaphore "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 889.678682] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Releasing lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 889.678844] env[65370]: DEBUG networking_nsxv3.common.locking [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 889.679019] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquiring lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 889.679152] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquired lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 889.679401] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquired external semaphore "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 889.679608] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Releasing lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 889.680483] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Resource: SegmentPort with ID: 1ca63f4a-52c8-4d53-89ac-e903b7b7b09b is going to be created. [ 889.716428] env[65370]: DEBUG networking_nsxv3.common.locking [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 889.718637] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquiring lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 889.718637] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquired lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 889.718637] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquired external semaphore "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 889.718637] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Releasing lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 889.718637] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Releasing lock "port-1ca63f4a-52c8-4d53-89ac-e903b7b7b09b" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 890.432238] env[65370]: INFO networking_nsxv3.common.synchronization [req-d703b09a-8503-481a-b3af-a7e026f83432 req-3b016725-2346-43bc-8b67-193e7dc4a2ae service nova] Enqueued Resource ID: e2790d7c-6d0c-45bc-84d1-8cb00d26b9b0 with Priority: HIGHEST for action security_group_rules [ 890.432484] env[65370]: INFO networking_nsxv3.common.synchronization [req-d703b09a-8503-481a-b3af-a7e026f83432 req-3b016725-2346-43bc-8b67-193e7dc4a2ae service nova] Enqueued Resource ID: e2790d7c-6d0c-45bc-84d1-8cb00d26b9b0 with Priority: HIGHEST for action security_group_members [ 890.432677] env[65370]: INFO networking_nsxv3.common.synchronization [req-d703b09a-8503-481a-b3af-a7e026f83432 req-3b016725-2346-43bc-8b67-193e7dc4a2ae service nova] Enqueued Resource ID: 1ca63f4a-52c8-4d53-89ac-e903b7b7b09b with Priority: HIGHEST for action port [ 890.433822] env[65370]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e2790d7c-6d0c-45bc-84d1-8cb00d26b9b0 with Priority: HIGHEST for action security_group_rules [ 890.434092] env[65370]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e2790d7c-6d0c-45bc-84d1-8cb00d26b9b0 with Priority: HIGHEST for action security_group_members [ 890.434330] env[65370]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1ca63f4a-52c8-4d53-89ac-e903b7b7b09b with Priority: HIGHEST for action port [ 890.434664] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e2790d7c-6d0c-45bc-84d1-8cb00d26b9b0 taken with stack trace [, , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 890.434806] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e2790d7c-6d0c-45bc-84d1-8cb00d26b9b0" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 890.434901] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e2790d7c-6d0c-45bc-84d1-8cb00d26b9b0" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 890.435239] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e2790d7c-6d0c-45bc-84d1-8cb00d26b9b0" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 890.435338] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e2790d7c-6d0c-45bc-84d1-8cb00d26b9b0',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 890.436505] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock member-e2790d7c-6d0c-45bc-84d1-8cb00d26b9b0 taken with stack trace [, , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 890.436609] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e2790d7c-6d0c-45bc-84d1-8cb00d26b9b0" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 890.436828] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock port-1ca63f4a-52c8-4d53-89ac-e903b7b7b09b taken with stack trace [, , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 890.436955] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-1ca63f4a-52c8-4d53-89ac-e903b7b7b09b" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 890.437057] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-1ca63f4a-52c8-4d53-89ac-e903b7b7b09b" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 890.437374] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-1ca63f4a-52c8-4d53-89ac-e903b7b7b09b" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 890.437972] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1ca63f4a-52c8-4d53-89ac-e903b7b7b09b',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 890.943028] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock member-e2790d7c-6d0c-45bc-84d1-8cb00d26b9b0 taken with stack trace [, , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 890.943028] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e2790d7c-6d0c-45bc-84d1-8cb00d26b9b0" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 890.943028] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 1ca63f4a-52c8-4d53-89ac-e903b7b7b09b with status ACTIVE [ 890.943028] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 890.943028] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 890.943028] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 890.943028] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 890.943028] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 890.943028] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 890.943028] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 890.943028] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 890.943028] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 890.943028] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 890.943028] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 890.944074] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 890.944074] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 890.944074] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 890.944074] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 890.944074] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 1ca63f4a-52c8-4d53-89ac-e903b7b7b09b is going to be updated. [ 890.977736] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 890.977736] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 890.977736] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 890.977736] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 890.977736] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 890.977736] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-1ca63f4a-52c8-4d53-89ac-e903b7b7b09b" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 891.378945] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e2790d7c-6d0c-45bc-84d1-8cb00d26b9b0 in Status: SUCCESS [ 891.379155] env[65370]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e2790d7c-6d0c-45bc-84d1-8cb00d26b9b0 deletion is rescheduled due to dependency. [ 891.379310] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e2790d7c-6d0c-45bc-84d1-8cb00d26b9b0" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 891.379471] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e2790d7c-6d0c-45bc-84d1-8cb00d26b9b0" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 891.379691] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e2790d7c-6d0c-45bc-84d1-8cb00d26b9b0" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 891.379872] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 891.379988] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 891.380067] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 891.380258] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 891.380366] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 891.380423] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e2790d7c-6d0c-45bc-84d1-8cb00d26b9b0',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 891.663442] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: de5a6b9b-a5a9-4ccc-b897-0244548cc5fd in Status: SUCCESS [ 891.663881] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-de5a6b9b-a5a9-4ccc-b897-0244548cc5fd" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 891.663881] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-de5a6b9b-a5a9-4ccc-b897-0244548cc5fd" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 891.664087] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-de5a6b9b-a5a9-4ccc-b897-0244548cc5fd" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 891.664355] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 891.664496] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 891.665100] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 891.665100] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 891.665100] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 891.665100] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-de5a6b9b-a5a9-4ccc-b897-0244548cc5fd" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 891.665100] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('de5a6b9b-a5a9-4ccc-b897-0244548cc5fd',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 891.883737] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('e2790d7c-6d0c-45bc-84d1-8cb00d26b9b0',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 892.171575] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock member-de5a6b9b-a5a9-4ccc-b897-0244548cc5fd taken with stack trace [, , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 892.171731] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-de5a6b9b-a5a9-4ccc-b897-0244548cc5fd" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 892.171825] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-de5a6b9b-a5a9-4ccc-b897-0244548cc5fd" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 892.172017] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-de5a6b9b-a5a9-4ccc-b897-0244548cc5fd" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 892.172174] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 892.172272] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 892.172386] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 892.172478] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 892.172562] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 892.172648] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-de5a6b9b-a5a9-4ccc-b897-0244548cc5fd" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 892.172792] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock member-de5a6b9b-a5a9-4ccc-b897-0244548cc5fd taken with stack trace [, , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 892.172882] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-de5a6b9b-a5a9-4ccc-b897-0244548cc5fd" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 892.172964] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-de5a6b9b-a5a9-4ccc-b897-0244548cc5fd" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 892.173093] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-de5a6b9b-a5a9-4ccc-b897-0244548cc5fd" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 892.173227] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 892.173324] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 892.173387] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 892.173512] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 892.173610] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 892.173721] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-de5a6b9b-a5a9-4ccc-b897-0244548cc5fd" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 892.173780] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('de5a6b9b-a5a9-4ccc-b897-0244548cc5fd',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 892.385178] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('e2790d7c-6d0c-45bc-84d1-8cb00d26b9b0',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 892.588244] env[65370]: INFO networking_nsxv3.common.synchronization [req-fff47f0e-d8a9-46b7-95ba-5d80d6579740 req-448705d2-42be-4e4e-b67f-82303af3ab30 tempest-ServersAdminNegativeTestJSON-2075318315 tempest-ServersAdminNegativeTestJSON-2075318315-project-member] Enqueued Resource ID: ae63a79d-837f-4a55-a83c-bcd245828917 with Priority: HIGHEST for action security_group_members [ 892.588244] env[65370]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ae63a79d-837f-4a55-a83c-bcd245828917 with Priority: HIGHEST for action security_group_members [ 892.588244] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock member-ae63a79d-837f-4a55-a83c-bcd245828917 taken with stack trace [, , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 892.588244] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ae63a79d-837f-4a55-a83c-bcd245828917" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 892.588510] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ae63a79d-837f-4a55-a83c-bcd245828917" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 892.588510] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ae63a79d-837f-4a55-a83c-bcd245828917" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 892.588668] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 892.588727] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 892.588778] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 892.588917] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 892.588996] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 892.589969] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ae63a79d-837f-4a55-a83c-bcd245828917',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 892.676406] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for de5a6b9b-a5a9-4ccc-b897-0244548cc5fd: rpc.has_security_group_logging(os_id): False [ 892.698803] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 892.698948] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 892.699033] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 892.699263] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 892.699357] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 892.699545] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 892.699645] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 892.699929] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 892.699929] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 892.699929] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 892.700134] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 892.700227] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 892.700289] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 892.700456] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 892.700549] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 892.700740] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 892.700827] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 892.700885] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 892.701034] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 892.701109] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 892.701192] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: de5a6b9b-a5a9-4ccc-b897-0244548cc5fd is going to be created. [ 892.776604] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 892.776604] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 892.776604] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 892.776604] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 892.776604] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 892.788342] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: de5a6b9b-a5a9-4ccc-b897-0244548cc5fd in Status: IN_PROGRESS for 2s [ 892.890884] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 892.891073] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 892.891140] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 892.891338] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 892.891824] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 892.891824] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e2790d7c-6d0c-45bc-84d1-8cb00d26b9b0 is going to be updated. [ 892.934670] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 892.934892] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 892.934995] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 892.935238] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 892.935393] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 892.953594] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e2790d7c-6d0c-45bc-84d1-8cb00d26b9b0 in Status: IN_PROGRESS for 2s [ 893.093881] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('ae63a79d-837f-4a55-a83c-bcd245828917',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 893.596091] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('ae63a79d-837f-4a55-a83c-bcd245828917',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 894.100739] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 894.100739] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 894.100739] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 894.100739] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 894.100739] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 894.100739] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ae63a79d-837f-4a55-a83c-bcd245828917 is going to be updated. [ 894.138437] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 894.138437] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 894.138707] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 894.138849] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 894.139098] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 894.154302] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ae63a79d-837f-4a55-a83c-bcd245828917 in Status: IN_PROGRESS for 2s [ 894.800991] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: de5a6b9b-a5a9-4ccc-b897-0244548cc5fd in Status: SUCCESS [ 894.802904] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-de5a6b9b-a5a9-4ccc-b897-0244548cc5fd" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 894.967102] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e2790d7c-6d0c-45bc-84d1-8cb00d26b9b0 in Status: SUCCESS [ 894.967102] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e2790d7c-6d0c-45bc-84d1-8cb00d26b9b0" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 894.967102] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e2790d7c-6d0c-45bc-84d1-8cb00d26b9b0" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 894.967102] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e2790d7c-6d0c-45bc-84d1-8cb00d26b9b0" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 894.967102] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 894.967102] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 894.967102] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 894.967102] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 894.967102] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 894.967102] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e2790d7c-6d0c-45bc-84d1-8cb00d26b9b0" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 894.967102] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('e2790d7c-6d0c-45bc-84d1-8cb00d26b9b0',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 895.470049] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock member-e2790d7c-6d0c-45bc-84d1-8cb00d26b9b0 taken with stack trace [, , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 895.470049] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e2790d7c-6d0c-45bc-84d1-8cb00d26b9b0" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 895.470049] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e2790d7c-6d0c-45bc-84d1-8cb00d26b9b0" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 895.470460] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e2790d7c-6d0c-45bc-84d1-8cb00d26b9b0" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 895.470460] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 895.470544] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 895.470578] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 895.470813] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 895.470970] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 895.471130] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e2790d7c-6d0c-45bc-84d1-8cb00d26b9b0" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 895.471327] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock member-e2790d7c-6d0c-45bc-84d1-8cb00d26b9b0 taken with stack trace [, , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 895.471406] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e2790d7c-6d0c-45bc-84d1-8cb00d26b9b0" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 895.471469] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e2790d7c-6d0c-45bc-84d1-8cb00d26b9b0" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 895.471617] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e2790d7c-6d0c-45bc-84d1-8cb00d26b9b0" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 895.471757] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 895.471851] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 895.471911] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 895.472081] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 895.472160] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 895.472293] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e2790d7c-6d0c-45bc-84d1-8cb00d26b9b0" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 895.472360] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('e2790d7c-6d0c-45bc-84d1-8cb00d26b9b0',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 895.976437] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for e2790d7c-6d0c-45bc-84d1-8cb00d26b9b0: rpc.has_security_group_logging(os_id): False [ 896.011053] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 896.011053] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 896.011053] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 896.011396] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 896.011396] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 896.011596] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 896.011757] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 896.011813] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 896.012081] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 896.012529] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 896.012529] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 896.012529] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 896.012678] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 896.012803] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 896.012908] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 896.013732] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 896.013732] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 896.013732] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 896.013931] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 896.013966] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 896.014572] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e2790d7c-6d0c-45bc-84d1-8cb00d26b9b0 is going to be updated. [ 896.103224] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 896.103386] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 896.103456] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 896.103684] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 896.103833] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 896.132881] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e2790d7c-6d0c-45bc-84d1-8cb00d26b9b0 in Status: IN_PROGRESS for 2s [ 896.165666] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ae63a79d-837f-4a55-a83c-bcd245828917 in Status: SUCCESS [ 896.165926] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ae63a79d-837f-4a55-a83c-bcd245828917" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 897.407020] env[65370]: INFO networking_nsxv3.common.synchronization [None req-1290aec4-11a2-42c6-86b7-500424433c0d None None] Enqueued Resource ID: dae3fe38-7bc6-492a-ac26-672f0bff4994 with Priority: HIGHEST for action port [ 897.407020] env[65370]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: dae3fe38-7bc6-492a-ac26-672f0bff4994 with Priority: HIGHEST for action port [ 897.407020] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock port-dae3fe38-7bc6-492a-ac26-672f0bff4994 taken with stack trace [, , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 897.407020] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-dae3fe38-7bc6-492a-ac26-672f0bff4994" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 897.407020] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-dae3fe38-7bc6-492a-ac26-672f0bff4994" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 897.408107] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-dae3fe38-7bc6-492a-ac26-672f0bff4994" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 897.408354] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('dae3fe38-7bc6-492a-ac26-672f0bff4994',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 897.911265] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port dae3fe38-7bc6-492a-ac26-672f0bff4994 [ 897.911473] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 897.911625] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 897.911659] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 897.911882] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 897.911958] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 897.912425] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:dae3fe38-7bc6-492a-ac26-672f0bff4994 already deleted. [ 897.912425] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-dae3fe38-7bc6-492a-ac26-672f0bff4994" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 898.123026] env[65370]: INFO networking_nsxv3.common.synchronization [req-6954743c-8e15-431a-ba32-a59ba262e6d3 req-05926b64-7758-4643-a5f8-00a4e625079e tempest-ServerDiskConfigTestJSON-902849627 tempest-ServerDiskConfigTestJSON-902849627-project-member] Enqueued Resource ID: 420136f3-91df-4669-b5e3-cee436aeacb9 with Priority: HIGHEST for action security_group_members [ 898.123719] env[65370]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 420136f3-91df-4669-b5e3-cee436aeacb9 with Priority: HIGHEST for action security_group_members [ 898.128303] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock member-420136f3-91df-4669-b5e3-cee436aeacb9 taken with stack trace [, , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 898.128303] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-420136f3-91df-4669-b5e3-cee436aeacb9" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 898.128303] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-420136f3-91df-4669-b5e3-cee436aeacb9" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 898.128303] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-420136f3-91df-4669-b5e3-cee436aeacb9" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 898.128303] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 898.128303] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 898.128303] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 898.128303] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 898.128303] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 898.128303] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('420136f3-91df-4669-b5e3-cee436aeacb9',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 898.150258] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e2790d7c-6d0c-45bc-84d1-8cb00d26b9b0 in Status: SUCCESS [ 898.150258] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e2790d7c-6d0c-45bc-84d1-8cb00d26b9b0" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 898.579837] env[65370]: DEBUG networking_nsxv3.common.locking [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Lock network-974 taken with stack trace [, , , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 898.579837] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquiring lock "network-974" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 898.579837] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquired lock "network-974" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 898.579837] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquired external semaphore "network-974" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 898.583164] env[65370]: DEBUG networking_nsxv3.common.locking [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 898.583567] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquiring lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 898.583747] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquired lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 898.584343] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquired external semaphore "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 898.584343] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Releasing lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 898.584646] env[65370]: DEBUG dogpile.cache.region [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] No value present for key: 'zone-id' {{(pid=65370) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 898.584794] env[65370]: DEBUG dogpile.lock [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] NeedRegenerationException {{(pid=65370) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 898.584949] env[65370]: DEBUG dogpile.lock [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] no value, waiting for create lock {{(pid=65370) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 898.585095] env[65370]: DEBUG dogpile.lock [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] value creation lock acquired {{(pid=65370) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 898.585239] env[65370]: DEBUG dogpile.cache.region [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] No value present for key: 'zone-id' {{(pid=65370) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 898.585386] env[65370]: DEBUG dogpile.lock [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Calling creation function for not-yet-present value {{(pid=65370) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 898.585553] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 898.607171] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 898.607372] env[65370]: DEBUG dogpile.cache.region [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=65370) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 898.607527] env[65370]: DEBUG dogpile.lock [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Released creation lock {{(pid=65370) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 898.608044] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Releasing lock "network-974" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 898.608044] env[65370]: DEBUG networking_nsxv3.common.locking [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Lock port-e58068a9-21b2-49d4-9665-225fcf000936 taken with stack trace [, , , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 898.608305] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquiring lock "port-e58068a9-21b2-49d4-9665-225fcf000936" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 898.608305] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquired lock "port-e58068a9-21b2-49d4-9665-225fcf000936" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 898.608628] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquired external semaphore "port-e58068a9-21b2-49d4-9665-225fcf000936" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 898.608761] env[65370]: DEBUG networking_nsxv3.api.rpc [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e58068a9-21b2-49d4-9665-225fcf000936',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 898.629949] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 898.630116] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 898.630190] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 898.630434] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 898.630534] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 898.630725] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 898.630828] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 898.630889] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 898.631050] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 898.631129] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 898.631214] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 420136f3-91df-4669-b5e3-cee436aeacb9 is going to be updated. [ 898.659044] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 898.659044] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 898.659044] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 898.659207] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 898.659374] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 898.671295] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 420136f3-91df-4669-b5e3-cee436aeacb9 in Status: IN_PROGRESS for 2s [ 899.112137] env[65370]: DEBUG networking_nsxv3.common.locking [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 899.114089] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquiring lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 899.114089] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquired lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 899.114089] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquired external semaphore "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 899.114089] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Releasing lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 899.114089] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Segment Port e58068a9-21b2-49d4-9665-225fcf000936 not found, creating... [ 899.114089] env[65370]: DEBUG networking_nsxv3.common.locking [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 899.114089] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquiring lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 899.114089] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquired lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 899.114089] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquired external semaphore "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 899.114559] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Releasing lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 899.114559] env[65370]: DEBUG networking_nsxv3.common.locking [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 899.114665] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquiring lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 899.114765] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquired lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 899.115171] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquired external semaphore "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 899.115171] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Releasing lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 899.115265] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Resource: SegmentPort with ID: e58068a9-21b2-49d4-9665-225fcf000936 is going to be created. [ 899.137669] env[65370]: DEBUG networking_nsxv3.common.locking [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 899.137893] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquiring lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 899.138031] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquired lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 899.138311] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquired external semaphore "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 899.138534] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Releasing lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 899.138804] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Releasing lock "port-e58068a9-21b2-49d4-9665-225fcf000936" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 899.476811] env[65370]: INFO networking_nsxv3.common.synchronization [None req-74c10cc8-26cf-42a7-adff-d977585c57f1 tempest-ServersV294TestFqdnHostnames-48421139 tempest-ServersV294TestFqdnHostnames-48421139-project-member] Enqueued Resource ID: 002e5341-7a4b-4a54-ad04-59531e87f867 with Priority: HIGHEST for action security_group_rules [ 899.477371] env[65370]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 002e5341-7a4b-4a54-ad04-59531e87f867 with Priority: HIGHEST for action security_group_rules [ 899.477705] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock rules-002e5341-7a4b-4a54-ad04-59531e87f867 taken with stack trace [, , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 899.477834] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-002e5341-7a4b-4a54-ad04-59531e87f867" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 899.477917] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-002e5341-7a4b-4a54-ad04-59531e87f867" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 899.478180] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-002e5341-7a4b-4a54-ad04-59531e87f867" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 899.478262] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('002e5341-7a4b-4a54-ad04-59531e87f867',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 899.884382] env[65370]: INFO networking_nsxv3.common.synchronization [req-6954743c-8e15-431a-ba32-a59ba262e6d3 req-6d2a2583-d177-4d34-8214-a1a1764aadd6 service nova] Enqueued Resource ID: 420136f3-91df-4669-b5e3-cee436aeacb9 with Priority: HIGHEST for action security_group_rules [ 899.884382] env[65370]: INFO networking_nsxv3.common.synchronization [req-6954743c-8e15-431a-ba32-a59ba262e6d3 req-6d2a2583-d177-4d34-8214-a1a1764aadd6 service nova] Enqueued Resource ID: 420136f3-91df-4669-b5e3-cee436aeacb9 with Priority: HIGHEST for action security_group_members [ 899.884382] env[65370]: INFO networking_nsxv3.common.synchronization [req-6954743c-8e15-431a-ba32-a59ba262e6d3 req-6d2a2583-d177-4d34-8214-a1a1764aadd6 service nova] Enqueued Resource ID: e58068a9-21b2-49d4-9665-225fcf000936 with Priority: HIGHEST for action port [ 899.885619] env[65370]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 420136f3-91df-4669-b5e3-cee436aeacb9 with Priority: HIGHEST for action security_group_rules [ 899.885761] env[65370]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 420136f3-91df-4669-b5e3-cee436aeacb9 with Priority: HIGHEST for action security_group_members [ 899.885857] env[65370]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e58068a9-21b2-49d4-9665-225fcf000936 with Priority: HIGHEST for action port [ 899.886829] env[65370]: INFO networking_nsxv3.common.synchronization [req-c84f0f63-377e-4722-9f4b-ccfee0f054c5 req-fa81b89e-4174-4e9f-8cf3-d5f01c9f2c57 tempest-ImagesTestJSON-246049254 tempest-ImagesTestJSON-246049254-project-member] Enqueued Resource ID: 67f4a0c1-3a3c-4ed8-9358-3a9645aba154 with Priority: HIGHEST for action security_group_members [ 899.889636] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock rules-420136f3-91df-4669-b5e3-cee436aeacb9 taken with stack trace [, , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 899.889636] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-420136f3-91df-4669-b5e3-cee436aeacb9" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 899.889636] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-420136f3-91df-4669-b5e3-cee436aeacb9" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 899.889636] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-420136f3-91df-4669-b5e3-cee436aeacb9" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 899.889636] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('420136f3-91df-4669-b5e3-cee436aeacb9',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 899.889636] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock member-420136f3-91df-4669-b5e3-cee436aeacb9 taken with stack trace [, , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 899.889636] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-420136f3-91df-4669-b5e3-cee436aeacb9" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 899.889636] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock port-e58068a9-21b2-49d4-9665-225fcf000936 taken with stack trace [, , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 899.889636] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-e58068a9-21b2-49d4-9665-225fcf000936" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 899.889636] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-e58068a9-21b2-49d4-9665-225fcf000936" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 899.889636] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-e58068a9-21b2-49d4-9665-225fcf000936" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 899.889636] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e58068a9-21b2-49d4-9665-225fcf000936',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 899.890636] env[65370]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 67f4a0c1-3a3c-4ed8-9358-3a9645aba154 with Priority: HIGHEST for action security_group_members [ 899.891374] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock member-67f4a0c1-3a3c-4ed8-9358-3a9645aba154 taken with stack trace [, , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 899.891489] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-67f4a0c1-3a3c-4ed8-9358-3a9645aba154" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 899.891730] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-67f4a0c1-3a3c-4ed8-9358-3a9645aba154" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 899.891730] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-67f4a0c1-3a3c-4ed8-9358-3a9645aba154" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 899.893431] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 899.893431] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 899.893431] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 899.893431] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 899.893431] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 899.893431] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('67f4a0c1-3a3c-4ed8-9358-3a9645aba154',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 900.008548] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 900.009394] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 900.009394] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 900.009394] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 900.009394] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 900.009394] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 002e5341-7a4b-4a54-ad04-59531e87f867 already deleted. [ 900.009394] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-002e5341-7a4b-4a54-ad04-59531e87f867" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 900.036332] env[65370]: INFO networking_nsxv3.common.synchronization [None req-1a90b5f3-d45e-4569-9fbc-bc78c4d26037 tempest-ServersV294TestFqdnHostnames-48421139 tempest-ServersV294TestFqdnHostnames-48421139-project-member] Enqueued Resource ID: 002e5341-7a4b-4a54-ad04-59531e87f867 with Priority: HIGHEST for action security_group_rules [ 900.036332] env[65370]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 002e5341-7a4b-4a54-ad04-59531e87f867 with Priority: HIGHEST for action security_group_rules [ 900.036789] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock rules-002e5341-7a4b-4a54-ad04-59531e87f867 taken with stack trace [, , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 900.037920] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-002e5341-7a4b-4a54-ad04-59531e87f867" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 900.037920] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-002e5341-7a4b-4a54-ad04-59531e87f867" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 900.038998] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-002e5341-7a4b-4a54-ad04-59531e87f867" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 900.038998] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('002e5341-7a4b-4a54-ad04-59531e87f867',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 900.270172] env[65370]: INFO networking_nsxv3.common.synchronization [None req-36985e37-1429-4111-97cf-f9bbb245130f None None] Enqueued Resource ID: 6195d22e-a519-437c-9285-aaf6c0758b1e with Priority: HIGHEST for action port [ 900.270848] env[65370]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6195d22e-a519-437c-9285-aaf6c0758b1e with Priority: HIGHEST for action port [ 900.271159] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock port-6195d22e-a519-437c-9285-aaf6c0758b1e taken with stack trace [, , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 900.271287] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-6195d22e-a519-437c-9285-aaf6c0758b1e" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 900.271353] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-6195d22e-a519-437c-9285-aaf6c0758b1e" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 900.271602] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-6195d22e-a519-437c-9285-aaf6c0758b1e" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 900.271686] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6195d22e-a519-437c-9285-aaf6c0758b1e',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 900.395921] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port e58068a9-21b2-49d4-9665-225fcf000936 with status ACTIVE [ 900.395921] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 900.395921] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 900.395921] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 900.395921] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 900.395921] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 900.395921] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 900.395921] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 900.395921] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 900.395921] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 900.395921] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 900.396812] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 900.396812] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 900.396812] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 900.396812] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 900.396812] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 900.396812] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: e58068a9-21b2-49d4-9665-225fcf000936 is going to be updated. [ 900.398975] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock member-420136f3-91df-4669-b5e3-cee436aeacb9 taken with stack trace [, , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 900.398975] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-420136f3-91df-4669-b5e3-cee436aeacb9" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 900.398975] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('67f4a0c1-3a3c-4ed8-9358-3a9645aba154',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 900.455722] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 900.455969] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 900.456152] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 900.457274] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 900.457274] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 900.457274] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-e58068a9-21b2-49d4-9665-225fcf000936" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 900.562286] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 900.562523] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 900.562523] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 900.562691] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 900.562778] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 900.562931] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 002e5341-7a4b-4a54-ad04-59531e87f867 already deleted. [ 900.562931] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-002e5341-7a4b-4a54-ad04-59531e87f867" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 900.682828] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 420136f3-91df-4669-b5e3-cee436aeacb9 in Status: SUCCESS [ 900.683073] env[65370]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 420136f3-91df-4669-b5e3-cee436aeacb9 deletion is rescheduled due to dependency. [ 900.683199] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-420136f3-91df-4669-b5e3-cee436aeacb9" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 900.683731] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-420136f3-91df-4669-b5e3-cee436aeacb9" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 900.683944] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-420136f3-91df-4669-b5e3-cee436aeacb9" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 900.684159] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 900.684288] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 900.684352] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 900.684509] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 900.684614] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 900.684701] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('420136f3-91df-4669-b5e3-cee436aeacb9',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 900.775958] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 6195d22e-a519-437c-9285-aaf6c0758b1e [ 900.775958] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 900.775958] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 900.775958] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 900.775958] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 900.775958] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 900.776270] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:6195d22e-a519-437c-9285-aaf6c0758b1e already deleted. [ 900.776270] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-6195d22e-a519-437c-9285-aaf6c0758b1e" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 900.901980] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('67f4a0c1-3a3c-4ed8-9358-3a9645aba154',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 901.188790] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('420136f3-91df-4669-b5e3-cee436aeacb9',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 901.328451] env[65370]: INFO networking_nsxv3.common.synchronization [None req-6e714150-67cf-433a-9675-d85e8e1a11b2 None None] Enqueued Resource ID: bfd978c7-66b2-40c3-a8a3-77acd5735a1a with Priority: HIGHEST for action port [ 901.329064] env[65370]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bfd978c7-66b2-40c3-a8a3-77acd5735a1a with Priority: HIGHEST for action port [ 901.329634] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock port-bfd978c7-66b2-40c3-a8a3-77acd5735a1a taken with stack trace [, , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 901.329800] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-bfd978c7-66b2-40c3-a8a3-77acd5735a1a" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 901.329889] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-bfd978c7-66b2-40c3-a8a3-77acd5735a1a" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 901.330202] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-bfd978c7-66b2-40c3-a8a3-77acd5735a1a" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 901.330316] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('bfd978c7-66b2-40c3-a8a3-77acd5735a1a',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 901.405569] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 901.405734] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 901.405809] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 901.406046] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 901.406144] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 901.406248] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 67f4a0c1-3a3c-4ed8-9358-3a9645aba154 is going to be updated. [ 901.437970] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 901.438252] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 901.438252] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 901.438427] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 901.438581] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 901.447980] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 67f4a0c1-3a3c-4ed8-9358-3a9645aba154 in Status: IN_PROGRESS for 2s [ 901.691301] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('420136f3-91df-4669-b5e3-cee436aeacb9',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 901.832755] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port bfd978c7-66b2-40c3-a8a3-77acd5735a1a [ 901.832991] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 901.833152] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 901.833223] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 901.833514] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 901.833614] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 901.833714] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:bfd978c7-66b2-40c3-a8a3-77acd5735a1a already deleted. [ 901.833795] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-bfd978c7-66b2-40c3-a8a3-77acd5735a1a" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 902.194609] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 902.194990] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 902.194990] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 902.195110] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 902.195170] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 902.195266] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 420136f3-91df-4669-b5e3-cee436aeacb9 is going to be updated. [ 902.224935] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 902.225124] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 902.225207] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 902.225394] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 902.225543] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 902.249237] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 420136f3-91df-4669-b5e3-cee436aeacb9 in Status: IN_PROGRESS for 2s [ 902.869981] env[65370]: INFO networking_nsxv3.common.synchronization [None req-1a082e22-5b7a-48d8-97e7-6faa88e488dd tempest-AttachInterfacesTestJSON-315686657 tempest-AttachInterfacesTestJSON-315686657-project-member] Enqueued Resource ID: 47d8b360-5d90-42ea-b9c3-ed76fddd03a3 with Priority: HIGHEST for action security_group_rules [ 902.870070] env[65370]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 47d8b360-5d90-42ea-b9c3-ed76fddd03a3 with Priority: HIGHEST for action security_group_rules [ 902.870367] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock rules-47d8b360-5d90-42ea-b9c3-ed76fddd03a3 taken with stack trace [, , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 902.870483] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-47d8b360-5d90-42ea-b9c3-ed76fddd03a3" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 902.870548] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-47d8b360-5d90-42ea-b9c3-ed76fddd03a3" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 902.870804] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-47d8b360-5d90-42ea-b9c3-ed76fddd03a3" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 902.870881] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('47d8b360-5d90-42ea-b9c3-ed76fddd03a3',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 902.960026] env[65370]: INFO networking_nsxv3.common.synchronization [None req-bd6b8115-1eed-48f7-82b1-120291b7e357 tempest-AttachInterfacesTestJSON-315686657 tempest-AttachInterfacesTestJSON-315686657-project-member] Enqueued Resource ID: 47d8b360-5d90-42ea-b9c3-ed76fddd03a3 with Priority: HIGHEST for action security_group_rules [ 902.960026] env[65370]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 47d8b360-5d90-42ea-b9c3-ed76fddd03a3 with Priority: HIGHEST for action security_group_rules [ 902.960026] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock rules-47d8b360-5d90-42ea-b9c3-ed76fddd03a3 taken with stack trace [, , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 902.960026] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-47d8b360-5d90-42ea-b9c3-ed76fddd03a3" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 903.392086] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 903.392372] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 903.392372] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 903.392643] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 903.392760] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 903.392884] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 47d8b360-5d90-42ea-b9c3-ed76fddd03a3 already deleted. [ 903.392995] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-47d8b360-5d90-42ea-b9c3-ed76fddd03a3" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 903.393199] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-47d8b360-5d90-42ea-b9c3-ed76fddd03a3" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 903.393410] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-47d8b360-5d90-42ea-b9c3-ed76fddd03a3" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 903.393528] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('47d8b360-5d90-42ea-b9c3-ed76fddd03a3',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 903.460038] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 67f4a0c1-3a3c-4ed8-9358-3a9645aba154 in Status: SUCCESS [ 903.460226] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-67f4a0c1-3a3c-4ed8-9358-3a9645aba154" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 903.578493] env[65370]: INFO networking_nsxv3.common.synchronization [None req-2cb839e1-aed9-45cb-8e39-5f5bba3db15e None None] Enqueued Resource ID: bceea01d-aed4-457b-a876-dcf7ae16838b with Priority: HIGHEST for action port [ 903.578684] env[65370]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bceea01d-aed4-457b-a876-dcf7ae16838b with Priority: HIGHEST for action port [ 903.579133] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock port-bceea01d-aed4-457b-a876-dcf7ae16838b taken with stack trace [, , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 903.579308] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-bceea01d-aed4-457b-a876-dcf7ae16838b" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 903.579362] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-bceea01d-aed4-457b-a876-dcf7ae16838b" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 903.579562] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-bceea01d-aed4-457b-a876-dcf7ae16838b" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 903.579641] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('bceea01d-aed4-457b-a876-dcf7ae16838b',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 903.917901] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 903.918082] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 903.918155] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 903.918449] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 903.918554] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 903.918727] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 47d8b360-5d90-42ea-b9c3-ed76fddd03a3 already deleted. [ 903.918817] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-47d8b360-5d90-42ea-b9c3-ed76fddd03a3" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 904.081708] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port bceea01d-aed4-457b-a876-dcf7ae16838b [ 904.081940] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 904.082088] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 904.082150] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 904.082382] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 904.082471] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 904.082550] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:bceea01d-aed4-457b-a876-dcf7ae16838b already deleted. [ 904.082653] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-bceea01d-aed4-457b-a876-dcf7ae16838b" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 904.259825] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 420136f3-91df-4669-b5e3-cee436aeacb9 in Status: SUCCESS [ 904.260066] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-420136f3-91df-4669-b5e3-cee436aeacb9" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 904.260228] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-420136f3-91df-4669-b5e3-cee436aeacb9" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 904.260437] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-420136f3-91df-4669-b5e3-cee436aeacb9" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 904.260629] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 904.260746] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 904.260834] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 904.260939] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 904.261032] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 904.261120] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-420136f3-91df-4669-b5e3-cee436aeacb9" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 904.261212] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('420136f3-91df-4669-b5e3-cee436aeacb9',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 904.578486] env[65370]: INFO networking_nsxv3.common.synchronization [req-537d72ee-4635-4ef5-ba39-8bd175a62f2c req-b20ee69b-3f76-4c21-93c5-ea8737aa13f2 tempest-ImagesOneServerNegativeTestJSON-1384686973 tempest-ImagesOneServerNegativeTestJSON-1384686973-project-member] Enqueued Resource ID: e2790d7c-6d0c-45bc-84d1-8cb00d26b9b0 with Priority: HIGHEST for action security_group_members [ 904.579208] env[65370]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e2790d7c-6d0c-45bc-84d1-8cb00d26b9b0 with Priority: HIGHEST for action security_group_members [ 904.579375] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock member-e2790d7c-6d0c-45bc-84d1-8cb00d26b9b0 taken with stack trace [, , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 904.579465] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e2790d7c-6d0c-45bc-84d1-8cb00d26b9b0" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 904.579575] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e2790d7c-6d0c-45bc-84d1-8cb00d26b9b0" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 904.579671] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e2790d7c-6d0c-45bc-84d1-8cb00d26b9b0" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 904.579825] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 904.579937] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 904.579977] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 904.580119] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 904.580205] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 904.580299] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e2790d7c-6d0c-45bc-84d1-8cb00d26b9b0',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 904.763819] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock member-420136f3-91df-4669-b5e3-cee436aeacb9 taken with stack trace [, , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 904.763819] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-420136f3-91df-4669-b5e3-cee436aeacb9" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 904.763819] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-420136f3-91df-4669-b5e3-cee436aeacb9" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 904.763819] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-420136f3-91df-4669-b5e3-cee436aeacb9" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 904.764348] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 904.764348] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 904.764348] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 904.764562] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 904.764721] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 904.764721] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-420136f3-91df-4669-b5e3-cee436aeacb9" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 904.764856] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock member-420136f3-91df-4669-b5e3-cee436aeacb9 taken with stack trace [, , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 904.764977] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-420136f3-91df-4669-b5e3-cee436aeacb9" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 904.765038] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-420136f3-91df-4669-b5e3-cee436aeacb9" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 904.765182] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-420136f3-91df-4669-b5e3-cee436aeacb9" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 904.765375] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 904.765545] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 904.765657] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 904.765851] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 904.765952] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 904.766049] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-420136f3-91df-4669-b5e3-cee436aeacb9" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 904.766148] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('420136f3-91df-4669-b5e3-cee436aeacb9',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 905.083031] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 905.083031] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 905.083210] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 905.083338] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 905.083451] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 905.083709] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 905.083845] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 905.083887] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 905.084070] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 905.084153] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 905.084246] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e2790d7c-6d0c-45bc-84d1-8cb00d26b9b0 is going to be updated. [ 905.130410] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 905.130410] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 905.130579] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 905.130648] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 905.130913] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 905.142111] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e2790d7c-6d0c-45bc-84d1-8cb00d26b9b0 in Status: IN_PROGRESS for 2s [ 905.268672] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 420136f3-91df-4669-b5e3-cee436aeacb9: rpc.has_security_group_logging(os_id): False [ 905.286125] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 905.286303] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 905.286303] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 905.286918] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 905.286918] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 905.286918] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 905.287193] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 905.287193] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 905.287193] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 905.287396] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 905.287486] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 905.287582] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 905.287643] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 905.287786] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 905.287860] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 905.288048] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 905.288133] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 905.288196] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 905.288328] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 905.288401] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 905.288496] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 420136f3-91df-4669-b5e3-cee436aeacb9 is going to be updated. [ 905.357271] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 905.357479] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 905.357584] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 905.357807] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 905.357952] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 905.371915] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 420136f3-91df-4669-b5e3-cee436aeacb9 in Status: IN_PROGRESS for 2s [ 907.151977] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e2790d7c-6d0c-45bc-84d1-8cb00d26b9b0 in Status: SUCCESS [ 907.151977] env[65370]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e2790d7c-6d0c-45bc-84d1-8cb00d26b9b0 deletion is rescheduled due to dependency. [ 907.151977] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e2790d7c-6d0c-45bc-84d1-8cb00d26b9b0" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 907.384372] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 420136f3-91df-4669-b5e3-cee436aeacb9 in Status: SUCCESS [ 907.384372] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-420136f3-91df-4669-b5e3-cee436aeacb9" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 909.580258] env[65370]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 909.580258] env[65370]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 910.128847] env[65370]: INFO networking_nsxv3.common.synchronization [None req-2e567478-7837-44ac-9387-590e2c762131 tempest-AttachVolumeNegativeTest-719365731 tempest-AttachVolumeNegativeTest-719365731-project-member] Enqueued Resource ID: 8ea97aa8-b2b5-4fb2-ad6c-cbae92dacf23 with Priority: HIGHEST for action security_group_rules [ 910.130037] env[65370]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8ea97aa8-b2b5-4fb2-ad6c-cbae92dacf23 with Priority: HIGHEST for action security_group_rules [ 910.130037] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock rules-8ea97aa8-b2b5-4fb2-ad6c-cbae92dacf23 taken with stack trace [, , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 910.130037] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-8ea97aa8-b2b5-4fb2-ad6c-cbae92dacf23" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 910.130037] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-8ea97aa8-b2b5-4fb2-ad6c-cbae92dacf23" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 910.130368] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-8ea97aa8-b2b5-4fb2-ad6c-cbae92dacf23" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 910.130406] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('8ea97aa8-b2b5-4fb2-ad6c-cbae92dacf23',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 910.214849] env[65370]: INFO networking_nsxv3.common.synchronization [None req-e496a8e2-ca4d-4d3f-be30-bbee7845336f tempest-AttachVolumeNegativeTest-719365731 tempest-AttachVolumeNegativeTest-719365731-project-member] Enqueued Resource ID: 8ea97aa8-b2b5-4fb2-ad6c-cbae92dacf23 with Priority: HIGHEST for action security_group_rules [ 910.215458] env[65370]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8ea97aa8-b2b5-4fb2-ad6c-cbae92dacf23 with Priority: HIGHEST for action security_group_rules [ 910.216024] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock rules-8ea97aa8-b2b5-4fb2-ad6c-cbae92dacf23 taken with stack trace [, , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 910.216024] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-8ea97aa8-b2b5-4fb2-ad6c-cbae92dacf23" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 910.653036] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 910.653386] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 910.653386] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 910.655748] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 910.655748] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 910.655748] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 8ea97aa8-b2b5-4fb2-ad6c-cbae92dacf23 already deleted. [ 910.655748] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-8ea97aa8-b2b5-4fb2-ad6c-cbae92dacf23" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 910.655748] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-8ea97aa8-b2b5-4fb2-ad6c-cbae92dacf23" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 910.655748] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-8ea97aa8-b2b5-4fb2-ad6c-cbae92dacf23" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 910.655748] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('8ea97aa8-b2b5-4fb2-ad6c-cbae92dacf23',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 911.177105] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 911.177105] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 911.177105] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 911.177105] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 911.177105] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 911.177105] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 8ea97aa8-b2b5-4fb2-ad6c-cbae92dacf23 already deleted. [ 911.177105] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-8ea97aa8-b2b5-4fb2-ad6c-cbae92dacf23" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 911.480026] env[65370]: INFO networking_nsxv3.common.synchronization [req-54ca0ca6-d38d-4989-8a49-a9648f945ce3 req-d869bfab-3bb1-4f01-99aa-023dc54fcb38 tempest-InstanceActionsV221TestJSON-1893935899 tempest-InstanceActionsV221TestJSON-1893935899-project-member] Enqueued Resource ID: 1ba7c228-9a96-4f3b-9855-f84e883a5bfd with Priority: HIGHEST for action security_group_members [ 911.480309] env[65370]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1ba7c228-9a96-4f3b-9855-f84e883a5bfd with Priority: HIGHEST for action security_group_members [ 911.480644] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock member-1ba7c228-9a96-4f3b-9855-f84e883a5bfd taken with stack trace [, , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 911.480767] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1ba7c228-9a96-4f3b-9855-f84e883a5bfd" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 911.480827] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1ba7c228-9a96-4f3b-9855-f84e883a5bfd" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 911.481086] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1ba7c228-9a96-4f3b-9855-f84e883a5bfd" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 911.481241] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 911.481345] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 911.481403] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 911.481554] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 911.481635] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 911.481853] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1ba7c228-9a96-4f3b-9855-f84e883a5bfd',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 911.777131] env[65370]: DEBUG networking_nsxv3.common.locking [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Lock network-256 taken with stack trace [, , , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 911.777131] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquiring lock "network-256" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 911.778230] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquired lock "network-256" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 911.778581] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquired external semaphore "network-256" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 911.778836] env[65370]: DEBUG networking_nsxv3.common.locking [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 911.779136] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquiring lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 911.779266] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquired lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 911.779462] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquired external semaphore "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 911.779601] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Releasing lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 911.779803] env[65370]: DEBUG dogpile.cache.region [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] No value present for key: 'zone-id' {{(pid=65370) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 911.779913] env[65370]: DEBUG dogpile.lock [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] NeedRegenerationException {{(pid=65370) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 911.780029] env[65370]: DEBUG dogpile.lock [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] no value, waiting for create lock {{(pid=65370) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 911.780162] env[65370]: DEBUG dogpile.lock [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] value creation lock acquired {{(pid=65370) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 911.780242] env[65370]: DEBUG dogpile.cache.region [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] No value present for key: 'zone-id' {{(pid=65370) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 911.780341] env[65370]: DEBUG dogpile.lock [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Calling creation function for not-yet-present value {{(pid=65370) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 911.780468] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 911.800910] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 911.801100] env[65370]: DEBUG dogpile.cache.region [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=65370) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 911.801236] env[65370]: DEBUG dogpile.lock [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Released creation lock {{(pid=65370) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 911.801406] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Releasing lock "network-256" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 911.801713] env[65370]: DEBUG networking_nsxv3.common.locking [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Lock port-d02e77bb-7fd5-438a-ab2f-7294572560c0 taken with stack trace [, , , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 911.801876] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquiring lock "port-d02e77bb-7fd5-438a-ab2f-7294572560c0" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 911.801991] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquired lock "port-d02e77bb-7fd5-438a-ab2f-7294572560c0" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 911.802327] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquired external semaphore "port-d02e77bb-7fd5-438a-ab2f-7294572560c0" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 911.802504] env[65370]: DEBUG networking_nsxv3.api.rpc [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d02e77bb-7fd5-438a-ab2f-7294572560c0',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 911.983921] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 911.984124] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 911.984292] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 911.984600] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 911.985118] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 911.985322] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 911.985772] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 911.986052] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 911.986247] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 911.986800] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 911.986894] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1ba7c228-9a96-4f3b-9855-f84e883a5bfd already deleted. [ 911.987208] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1ba7c228-9a96-4f3b-9855-f84e883a5bfd" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 912.304505] env[65370]: DEBUG networking_nsxv3.common.locking [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 912.304505] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquiring lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 912.304722] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquired lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 912.304822] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquired external semaphore "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 912.305044] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Releasing lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 912.305216] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Segment Port d02e77bb-7fd5-438a-ab2f-7294572560c0 not found, creating... [ 912.305497] env[65370]: DEBUG networking_nsxv3.common.locking [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 912.305926] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquiring lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 912.305926] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquired lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 912.306031] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquired external semaphore "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 912.306115] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Releasing lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 912.306428] env[65370]: DEBUG networking_nsxv3.common.locking [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 912.306566] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquiring lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 912.306685] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquired lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 912.306880] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquired external semaphore "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 912.307012] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Releasing lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 912.307148] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Resource: SegmentPort with ID: d02e77bb-7fd5-438a-ab2f-7294572560c0 is going to be created. [ 912.327346] env[65370]: DEBUG networking_nsxv3.common.locking [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 912.327555] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquiring lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 912.327705] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquired lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 912.327924] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquired external semaphore "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 912.328159] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Releasing lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 912.328373] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Releasing lock "port-d02e77bb-7fd5-438a-ab2f-7294572560c0" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 913.050136] env[65370]: INFO networking_nsxv3.common.synchronization [req-54ca0ca6-d38d-4989-8a49-a9648f945ce3 req-d43786a3-7461-417e-95cd-3d8b5a982326 service nova] Enqueued Resource ID: 1ba7c228-9a96-4f3b-9855-f84e883a5bfd with Priority: HIGHEST for action security_group_rules [ 913.050136] env[65370]: INFO networking_nsxv3.common.synchronization [req-54ca0ca6-d38d-4989-8a49-a9648f945ce3 req-d43786a3-7461-417e-95cd-3d8b5a982326 service nova] Enqueued Resource ID: 1ba7c228-9a96-4f3b-9855-f84e883a5bfd with Priority: HIGHEST for action security_group_members [ 913.050418] env[65370]: INFO networking_nsxv3.common.synchronization [req-54ca0ca6-d38d-4989-8a49-a9648f945ce3 req-d43786a3-7461-417e-95cd-3d8b5a982326 service nova] Enqueued Resource ID: d02e77bb-7fd5-438a-ab2f-7294572560c0 with Priority: HIGHEST for action port [ 913.050827] env[65370]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1ba7c228-9a96-4f3b-9855-f84e883a5bfd with Priority: HIGHEST for action security_group_rules [ 913.050881] env[65370]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1ba7c228-9a96-4f3b-9855-f84e883a5bfd with Priority: HIGHEST for action security_group_members [ 913.050961] env[65370]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d02e77bb-7fd5-438a-ab2f-7294572560c0 with Priority: HIGHEST for action port [ 913.052035] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock rules-1ba7c228-9a96-4f3b-9855-f84e883a5bfd taken with stack trace [, , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 913.052035] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-1ba7c228-9a96-4f3b-9855-f84e883a5bfd" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 913.052035] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-1ba7c228-9a96-4f3b-9855-f84e883a5bfd" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 913.052261] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-1ba7c228-9a96-4f3b-9855-f84e883a5bfd" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 913.052261] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('1ba7c228-9a96-4f3b-9855-f84e883a5bfd',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 913.053099] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock member-1ba7c228-9a96-4f3b-9855-f84e883a5bfd taken with stack trace [, , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 913.053486] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1ba7c228-9a96-4f3b-9855-f84e883a5bfd" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 913.053529] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1ba7c228-9a96-4f3b-9855-f84e883a5bfd" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 913.053778] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1ba7c228-9a96-4f3b-9855-f84e883a5bfd" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 913.053841] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 913.053942] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 913.054019] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 913.054923] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 913.054923] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 913.054923] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1ba7c228-9a96-4f3b-9855-f84e883a5bfd',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 913.055302] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock port-d02e77bb-7fd5-438a-ab2f-7294572560c0 taken with stack trace [, , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 913.055369] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-d02e77bb-7fd5-438a-ab2f-7294572560c0" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 913.055369] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-d02e77bb-7fd5-438a-ab2f-7294572560c0" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 913.055534] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-d02e77bb-7fd5-438a-ab2f-7294572560c0" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 913.055635] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d02e77bb-7fd5-438a-ab2f-7294572560c0',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 913.557577] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock member-1ba7c228-9a96-4f3b-9855-f84e883a5bfd taken with stack trace [, , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 913.557741] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1ba7c228-9a96-4f3b-9855-f84e883a5bfd" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 913.557906] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('1ba7c228-9a96-4f3b-9855-f84e883a5bfd',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 913.558808] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port d02e77bb-7fd5-438a-ab2f-7294572560c0 with status ACTIVE [ 913.558995] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 913.559121] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 913.559177] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 913.559379] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 913.559466] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 913.559639] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 913.559734] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 913.559794] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 913.559954] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 913.560039] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 913.560214] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 913.560306] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 913.560365] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 913.560532] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 913.560611] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 913.560695] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: d02e77bb-7fd5-438a-ab2f-7294572560c0 is going to be updated. [ 913.589866] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 913.589866] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 913.589866] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 913.590142] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 913.590716] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 913.590716] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-d02e77bb-7fd5-438a-ab2f-7294572560c0" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 914.062827] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('1ba7c228-9a96-4f3b-9855-f84e883a5bfd',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 914.566434] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 914.566696] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 914.566696] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 914.566886] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 914.566972] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 914.567085] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1ba7c228-9a96-4f3b-9855-f84e883a5bfd is going to be created. [ 914.615645] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 914.616496] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 914.616496] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 914.616496] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 914.616496] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 914.640387] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1ba7c228-9a96-4f3b-9855-f84e883a5bfd in Status: UNINITIALIZED for 2s [ 916.650154] env[65370]: INFO networking_nsxv3.common.synchronization [req-e4e28c13-661c-4ab3-99e3-0b3540d1ba61 req-62f5df57-4677-4b97-9742-e58e208bc52f tempest-ServersTestMultiNic-1884782823 tempest-ServersTestMultiNic-1884782823-project-member] Enqueued Resource ID: 7960de7e-23b5-46db-b2ee-c5bd971f27a6 with Priority: HIGHEST for action security_group_members [ 916.650712] env[65370]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7960de7e-23b5-46db-b2ee-c5bd971f27a6 with Priority: HIGHEST for action security_group_members [ 916.651163] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock member-7960de7e-23b5-46db-b2ee-c5bd971f27a6 taken with stack trace [, , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 916.651323] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7960de7e-23b5-46db-b2ee-c5bd971f27a6" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 916.651359] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7960de7e-23b5-46db-b2ee-c5bd971f27a6" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 916.651866] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7960de7e-23b5-46db-b2ee-c5bd971f27a6" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 916.651866] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 916.651866] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 916.651866] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 916.652072] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 916.652072] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 916.652164] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7960de7e-23b5-46db-b2ee-c5bd971f27a6',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 916.658079] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1ba7c228-9a96-4f3b-9855-f84e883a5bfd in Status: SUCCESS [ 916.658283] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1ba7c228-9a96-4f3b-9855-f84e883a5bfd" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 916.658781] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1ba7c228-9a96-4f3b-9855-f84e883a5bfd" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 916.658937] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1ba7c228-9a96-4f3b-9855-f84e883a5bfd" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 916.659287] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 916.659287] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 916.659287] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 916.660225] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 916.660225] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 916.660225] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1ba7c228-9a96-4f3b-9855-f84e883a5bfd" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 916.660225] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('1ba7c228-9a96-4f3b-9855-f84e883a5bfd',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 916.928370] env[65370]: INFO networking_nsxv3.common.synchronization [req-e4e28c13-661c-4ab3-99e3-0b3540d1ba61 req-d373cd65-6dac-44a0-a0b1-873ba1eeb9e7 tempest-ServersTestMultiNic-1884782823 tempest-ServersTestMultiNic-1884782823-project-member] Enqueued Resource ID: 7960de7e-23b5-46db-b2ee-c5bd971f27a6 with Priority: HIGHEST for action security_group_members [ 916.930799] env[65370]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7960de7e-23b5-46db-b2ee-c5bd971f27a6 with Priority: HIGHEST for action security_group_members [ 916.931181] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock member-7960de7e-23b5-46db-b2ee-c5bd971f27a6 taken with stack trace [, , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 916.931299] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7960de7e-23b5-46db-b2ee-c5bd971f27a6" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 917.154891] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 917.155255] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 917.155456] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 917.155801] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 917.156126] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 917.156509] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 917.156780] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 917.156976] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 917.158839] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 917.159101] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 917.160020] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7960de7e-23b5-46db-b2ee-c5bd971f27a6 is going to be updated. [ 917.161407] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock member-1ba7c228-9a96-4f3b-9855-f84e883a5bfd taken with stack trace [, , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 917.161938] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1ba7c228-9a96-4f3b-9855-f84e883a5bfd" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 917.162133] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1ba7c228-9a96-4f3b-9855-f84e883a5bfd" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 917.162404] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1ba7c228-9a96-4f3b-9855-f84e883a5bfd" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 917.162654] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 917.162857] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 917.163066] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 917.163415] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 917.163795] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 917.164539] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1ba7c228-9a96-4f3b-9855-f84e883a5bfd" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 917.164539] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock member-1ba7c228-9a96-4f3b-9855-f84e883a5bfd taken with stack trace [, , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 917.164539] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1ba7c228-9a96-4f3b-9855-f84e883a5bfd" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 917.164539] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1ba7c228-9a96-4f3b-9855-f84e883a5bfd" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 917.164861] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1ba7c228-9a96-4f3b-9855-f84e883a5bfd" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 917.165196] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 917.165417] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 917.165565] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 917.167069] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 917.167069] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 917.167069] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1ba7c228-9a96-4f3b-9855-f84e883a5bfd" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 917.167069] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('1ba7c228-9a96-4f3b-9855-f84e883a5bfd',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 917.195787] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 917.196267] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 917.196267] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 917.196267] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 917.197031] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 917.208998] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7960de7e-23b5-46db-b2ee-c5bd971f27a6 in Status: IN_PROGRESS for 2s [ 917.385701] env[65370]: DEBUG networking_nsxv3.common.locking [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Lock network-761 taken with stack trace [, , , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 917.385901] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquiring lock "network-761" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 917.386262] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquired lock "network-761" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 917.386705] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquired external semaphore "network-761" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 917.386980] env[65370]: DEBUG networking_nsxv3.common.locking [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 917.387153] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquiring lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 917.387267] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquired lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 917.387536] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquired external semaphore "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 917.387703] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Releasing lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 917.387924] env[65370]: DEBUG dogpile.cache.region [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] No value present for key: 'zone-id' {{(pid=65370) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 917.388044] env[65370]: DEBUG dogpile.lock [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] NeedRegenerationException {{(pid=65370) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 917.388148] env[65370]: DEBUG dogpile.lock [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] no value, waiting for create lock {{(pid=65370) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 917.388331] env[65370]: DEBUG dogpile.lock [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] value creation lock acquired {{(pid=65370) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 917.388365] env[65370]: DEBUG dogpile.cache.region [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] No value present for key: 'zone-id' {{(pid=65370) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 917.388443] env[65370]: DEBUG dogpile.lock [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Calling creation function for not-yet-present value {{(pid=65370) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 917.388570] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 917.411713] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 917.411883] env[65370]: DEBUG dogpile.cache.region [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=65370) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 917.412023] env[65370]: DEBUG dogpile.lock [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Released creation lock {{(pid=65370) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 917.412201] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Releasing lock "network-761" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 917.412512] env[65370]: DEBUG networking_nsxv3.common.locking [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Lock port-e31275b0-6daa-433f-9707-9398686085a8 taken with stack trace [, , , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 917.412684] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquiring lock "port-e31275b0-6daa-433f-9707-9398686085a8" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 917.412800] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquired lock "port-e31275b0-6daa-433f-9707-9398686085a8" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 917.413169] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquired external semaphore "port-e31275b0-6daa-433f-9707-9398686085a8" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 917.413305] env[65370]: DEBUG networking_nsxv3.api.rpc [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e31275b0-6daa-433f-9707-9398686085a8',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 917.669033] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 1ba7c228-9a96-4f3b-9855-f84e883a5bfd: rpc.has_security_group_logging(os_id): False [ 917.692224] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 917.692374] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 917.692422] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 917.692637] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 917.692724] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 917.692932] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 917.693131] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 917.693227] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 917.693364] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 917.693489] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 917.693707] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 917.693900] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 917.693900] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 917.694092] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 917.694197] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 917.694390] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 917.694685] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 917.695536] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 917.695536] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 917.695536] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 917.695536] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 1ba7c228-9a96-4f3b-9855-f84e883a5bfd is going to be created. [ 917.759297] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 917.759469] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 917.759509] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 917.759710] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 917.759889] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 917.777812] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 1ba7c228-9a96-4f3b-9855-f84e883a5bfd in Status: IN_PROGRESS for 2s [ 917.919024] env[65370]: DEBUG networking_nsxv3.common.locking [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 917.919024] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquiring lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 917.919024] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquired lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 917.919024] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquired external semaphore "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 917.919024] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Releasing lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 917.919024] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Segment Port e31275b0-6daa-433f-9707-9398686085a8 not found, creating... [ 917.919024] env[65370]: DEBUG networking_nsxv3.common.locking [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 917.919024] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquiring lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 917.919024] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquired lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 917.919024] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquired external semaphore "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 917.919024] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Releasing lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 917.919492] env[65370]: DEBUG networking_nsxv3.common.locking [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 917.919492] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquiring lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 917.919492] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquired lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 917.920061] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquired external semaphore "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 917.920375] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Releasing lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 917.920672] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Resource: SegmentPort with ID: e31275b0-6daa-433f-9707-9398686085a8 is going to be created. [ 917.945608] env[65370]: DEBUG networking_nsxv3.common.locking [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 917.945608] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquiring lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 917.945608] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquired lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 917.945608] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquired external semaphore "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 917.945608] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Releasing lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 917.945608] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Releasing lock "port-e31275b0-6daa-433f-9707-9398686085a8" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 918.653276] env[65370]: INFO networking_nsxv3.common.synchronization [req-e4e28c13-661c-4ab3-99e3-0b3540d1ba61 req-708d19bd-dd98-4837-bef8-31f728351ea0 service nova] Enqueued Resource ID: 7960de7e-23b5-46db-b2ee-c5bd971f27a6 with Priority: HIGHEST for action security_group_rules [ 918.653455] env[65370]: INFO networking_nsxv3.common.synchronization [req-e4e28c13-661c-4ab3-99e3-0b3540d1ba61 req-708d19bd-dd98-4837-bef8-31f728351ea0 service nova] Enqueued Resource ID: 7960de7e-23b5-46db-b2ee-c5bd971f27a6 with Priority: HIGHEST for action security_group_members [ 918.653593] env[65370]: INFO networking_nsxv3.common.synchronization [req-e4e28c13-661c-4ab3-99e3-0b3540d1ba61 req-708d19bd-dd98-4837-bef8-31f728351ea0 service nova] Enqueued Resource ID: e31275b0-6daa-433f-9707-9398686085a8 with Priority: HIGHEST for action port [ 918.653821] env[65370]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7960de7e-23b5-46db-b2ee-c5bd971f27a6 with Priority: HIGHEST for action security_group_rules [ 918.653949] env[65370]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7960de7e-23b5-46db-b2ee-c5bd971f27a6 with Priority: HIGHEST for action security_group_members [ 918.654354] env[65370]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e31275b0-6daa-433f-9707-9398686085a8 with Priority: HIGHEST for action port [ 918.654606] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock rules-7960de7e-23b5-46db-b2ee-c5bd971f27a6 taken with stack trace [, , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 918.654736] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-7960de7e-23b5-46db-b2ee-c5bd971f27a6" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 918.654803] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-7960de7e-23b5-46db-b2ee-c5bd971f27a6" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 918.654998] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-7960de7e-23b5-46db-b2ee-c5bd971f27a6" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 918.655109] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('7960de7e-23b5-46db-b2ee-c5bd971f27a6',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 918.656186] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock member-7960de7e-23b5-46db-b2ee-c5bd971f27a6 taken with stack trace [, , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 918.656273] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7960de7e-23b5-46db-b2ee-c5bd971f27a6" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 918.656494] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock port-e31275b0-6daa-433f-9707-9398686085a8 taken with stack trace [, , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 918.656616] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-e31275b0-6daa-433f-9707-9398686085a8" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 918.656681] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-e31275b0-6daa-433f-9707-9398686085a8" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 918.656904] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-e31275b0-6daa-433f-9707-9398686085a8" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 918.656971] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e31275b0-6daa-433f-9707-9398686085a8',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 919.158245] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock member-7960de7e-23b5-46db-b2ee-c5bd971f27a6 taken with stack trace [, , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 919.158680] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7960de7e-23b5-46db-b2ee-c5bd971f27a6" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 919.159987] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port e31275b0-6daa-433f-9707-9398686085a8 with status ACTIVE [ 919.160236] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 919.160811] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 919.160811] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 919.162266] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 919.162266] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 919.162266] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 919.162266] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 919.162266] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 919.162266] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 919.162266] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 919.162266] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 919.162266] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 919.162266] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 919.162779] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 919.162779] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 919.162779] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: e31275b0-6daa-433f-9707-9398686085a8 is going to be updated. [ 919.186694] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 919.187024] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 919.187024] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 919.187171] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 919.187254] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 919.187406] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-e31275b0-6daa-433f-9707-9398686085a8" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 919.224994] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7960de7e-23b5-46db-b2ee-c5bd971f27a6 in Status: SUCCESS [ 919.224994] env[65370]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7960de7e-23b5-46db-b2ee-c5bd971f27a6 deletion is rescheduled due to dependency. [ 919.224994] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7960de7e-23b5-46db-b2ee-c5bd971f27a6" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 919.224994] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7960de7e-23b5-46db-b2ee-c5bd971f27a6" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 919.224994] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7960de7e-23b5-46db-b2ee-c5bd971f27a6" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 919.224994] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 919.224994] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 919.224994] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 919.224994] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 919.224994] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 919.225664] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7960de7e-23b5-46db-b2ee-c5bd971f27a6',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 919.412388] env[65370]: INFO networking_nsxv3.common.synchronization [req-d4929f9f-0eb8-4de2-95cb-19b29f203010 req-26c023eb-1611-4254-b271-43f6de256d12 tempest-ServersAdminTestJSON-387254877 tempest-ServersAdminTestJSON-387254877-project-member] Enqueued Resource ID: feaf18c3-295c-41df-89f1-309931cdeca1 with Priority: HIGHEST for action security_group_members [ 919.412388] env[65370]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: feaf18c3-295c-41df-89f1-309931cdeca1 with Priority: HIGHEST for action security_group_members [ 919.413070] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock member-feaf18c3-295c-41df-89f1-309931cdeca1 taken with stack trace [, , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 919.413206] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-feaf18c3-295c-41df-89f1-309931cdeca1" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 919.413260] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-feaf18c3-295c-41df-89f1-309931cdeca1" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 919.413979] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-feaf18c3-295c-41df-89f1-309931cdeca1" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 919.413979] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 919.413979] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 919.413979] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 919.413979] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 919.413979] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 919.414470] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('feaf18c3-295c-41df-89f1-309931cdeca1',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 919.729627] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('7960de7e-23b5-46db-b2ee-c5bd971f27a6',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 919.762760] env[65370]: DEBUG networking_nsxv3.common.locking [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Lock network-588 taken with stack trace [, , , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 919.762960] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquiring lock "network-588" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 919.763097] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquired lock "network-588" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 919.763429] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquired external semaphore "network-588" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 919.763684] env[65370]: DEBUG networking_nsxv3.common.locking [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 919.763837] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquiring lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 919.763952] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquired lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 919.764182] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquired external semaphore "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 919.764319] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Releasing lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 919.764545] env[65370]: DEBUG dogpile.cache.region [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] No value present for key: 'zone-id' {{(pid=65370) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 919.764659] env[65370]: DEBUG dogpile.lock [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] NeedRegenerationException {{(pid=65370) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 919.764766] env[65370]: DEBUG dogpile.lock [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] no value, waiting for create lock {{(pid=65370) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 919.764872] env[65370]: DEBUG dogpile.lock [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] value creation lock acquired {{(pid=65370) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 919.764980] env[65370]: DEBUG dogpile.cache.region [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] No value present for key: 'zone-id' {{(pid=65370) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 919.765096] env[65370]: DEBUG dogpile.lock [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Calling creation function for not-yet-present value {{(pid=65370) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 919.765225] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 919.784885] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 919.785095] env[65370]: DEBUG dogpile.cache.region [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=65370) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 919.785243] env[65370]: DEBUG dogpile.lock [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Released creation lock {{(pid=65370) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 919.785425] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Releasing lock "network-588" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 919.785728] env[65370]: DEBUG networking_nsxv3.common.locking [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Lock port-6e3c565f-f2af-4875-a9bd-71c89c19f75f taken with stack trace [, , , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 919.785900] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquiring lock "port-6e3c565f-f2af-4875-a9bd-71c89c19f75f" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 919.786020] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquired lock "port-6e3c565f-f2af-4875-a9bd-71c89c19f75f" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 919.786359] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquired external semaphore "port-6e3c565f-f2af-4875-a9bd-71c89c19f75f" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 919.786552] env[65370]: DEBUG networking_nsxv3.api.rpc [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6e3c565f-f2af-4875-a9bd-71c89c19f75f',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 919.801026] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 1ba7c228-9a96-4f3b-9855-f84e883a5bfd in Status: SUCCESS [ 919.801294] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-1ba7c228-9a96-4f3b-9855-f84e883a5bfd" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 919.917700] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('feaf18c3-295c-41df-89f1-309931cdeca1',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 920.232495] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('7960de7e-23b5-46db-b2ee-c5bd971f27a6',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 920.294026] env[65370]: DEBUG networking_nsxv3.common.locking [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 920.294026] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquiring lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 920.294026] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquired lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 920.294026] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquired external semaphore "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 920.294026] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Releasing lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 920.294026] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Segment Port 6e3c565f-f2af-4875-a9bd-71c89c19f75f not found, creating... [ 920.294026] env[65370]: DEBUG networking_nsxv3.common.locking [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 920.294026] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquiring lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 920.294026] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquired lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 920.294026] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquired external semaphore "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 920.294026] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Releasing lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 920.294531] env[65370]: DEBUG networking_nsxv3.common.locking [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 920.294531] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquiring lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 920.294531] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquired lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 920.294531] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquired external semaphore "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 920.294531] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Releasing lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 920.294531] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Resource: SegmentPort with ID: 6e3c565f-f2af-4875-a9bd-71c89c19f75f is going to be created. [ 920.314050] env[65370]: DEBUG networking_nsxv3.common.locking [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 920.314235] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquiring lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 920.314289] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquired lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 920.314613] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquired external semaphore "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 920.314842] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Releasing lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 920.315241] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Releasing lock "port-6e3c565f-f2af-4875-a9bd-71c89c19f75f" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 920.419804] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('feaf18c3-295c-41df-89f1-309931cdeca1',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 920.436573] env[65370]: INFO networking_nsxv3.common.synchronization [req-b8e23366-b8e0-4548-8b89-ead3a410d917 req-6a9c6586-0105-4c03-9a5a-a7cd2ed315c1 tempest-MultipleCreateTestJSON-1838347642 tempest-MultipleCreateTestJSON-1838347642-project-member] Enqueued Resource ID: 1bc5c407-ee61-45f3-a29e-c586a26bcaff with Priority: HIGHEST for action security_group_members [ 920.437240] env[65370]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1bc5c407-ee61-45f3-a29e-c586a26bcaff with Priority: HIGHEST for action security_group_members [ 920.437665] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock member-1bc5c407-ee61-45f3-a29e-c586a26bcaff taken with stack trace [, , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 920.437774] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1bc5c407-ee61-45f3-a29e-c586a26bcaff" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 920.437774] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1bc5c407-ee61-45f3-a29e-c586a26bcaff" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 920.438034] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1bc5c407-ee61-45f3-a29e-c586a26bcaff" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 920.438199] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 920.438303] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 920.438367] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 920.438523] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 920.438610] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 920.438706] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1bc5c407-ee61-45f3-a29e-c586a26bcaff',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 920.736026] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 920.737015] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 920.737128] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 920.737354] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 920.737601] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 920.737660] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7960de7e-23b5-46db-b2ee-c5bd971f27a6 is going to be updated. [ 920.776015] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 920.778270] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 920.778270] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 920.778270] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 920.778270] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 920.789385] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7960de7e-23b5-46db-b2ee-c5bd971f27a6 in Status: IN_PROGRESS for 2s [ 920.922203] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 920.922422] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 920.922493] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 920.922744] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 920.922848] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 920.922959] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: feaf18c3-295c-41df-89f1-309931cdeca1 is going to be updated. [ 920.940966] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 920.941267] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 920.941367] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 920.941765] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 920.941765] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 920.941950] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 920.942339] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 920.942339] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 920.942339] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 920.942339] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 920.942447] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1bc5c407-ee61-45f3-a29e-c586a26bcaff already deleted. [ 920.942504] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1bc5c407-ee61-45f3-a29e-c586a26bcaff" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 920.970194] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 920.970379] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 920.970421] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 920.970667] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 920.970820] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 920.983237] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: feaf18c3-295c-41df-89f1-309931cdeca1 in Status: IN_PROGRESS for 2s [ 921.111025] env[65370]: INFO networking_nsxv3.common.synchronization [req-e4e28c13-661c-4ab3-99e3-0b3540d1ba61 req-32cc035e-d9eb-4e8a-93a6-272be4bc2323 service nova] Enqueued Resource ID: 7960de7e-23b5-46db-b2ee-c5bd971f27a6 with Priority: HIGHEST for action security_group_rules [ 921.111025] env[65370]: INFO networking_nsxv3.common.synchronization [req-e4e28c13-661c-4ab3-99e3-0b3540d1ba61 req-32cc035e-d9eb-4e8a-93a6-272be4bc2323 service nova] Enqueued Resource ID: 7960de7e-23b5-46db-b2ee-c5bd971f27a6 with Priority: HIGHEST for action security_group_members [ 921.111025] env[65370]: INFO networking_nsxv3.common.synchronization [req-e4e28c13-661c-4ab3-99e3-0b3540d1ba61 req-32cc035e-d9eb-4e8a-93a6-272be4bc2323 service nova] Enqueued Resource ID: 6e3c565f-f2af-4875-a9bd-71c89c19f75f with Priority: HIGHEST for action port [ 921.111025] env[65370]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7960de7e-23b5-46db-b2ee-c5bd971f27a6 with Priority: HIGHEST for action security_group_rules [ 921.111025] env[65370]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7960de7e-23b5-46db-b2ee-c5bd971f27a6 with Priority: HIGHEST for action security_group_members [ 921.112329] env[65370]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6e3c565f-f2af-4875-a9bd-71c89c19f75f with Priority: HIGHEST for action port [ 921.113345] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock rules-7960de7e-23b5-46db-b2ee-c5bd971f27a6 taken with stack trace [, , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 921.113345] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-7960de7e-23b5-46db-b2ee-c5bd971f27a6" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 921.113345] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock member-7960de7e-23b5-46db-b2ee-c5bd971f27a6 taken with stack trace [, , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 921.113345] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7960de7e-23b5-46db-b2ee-c5bd971f27a6" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 921.113345] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock port-6e3c565f-f2af-4875-a9bd-71c89c19f75f taken with stack trace [, , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 921.113345] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-6e3c565f-f2af-4875-a9bd-71c89c19f75f" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 921.113840] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-6e3c565f-f2af-4875-a9bd-71c89c19f75f" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 921.113840] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-6e3c565f-f2af-4875-a9bd-71c89c19f75f" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 921.113840] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6e3c565f-f2af-4875-a9bd-71c89c19f75f',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 921.308838] env[65370]: DEBUG networking_nsxv3.common.locking [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Lock network-237 taken with stack trace [, , , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 921.309246] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquiring lock "network-237" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 921.309364] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquired lock "network-237" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 921.309740] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquired external semaphore "network-237" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 921.310124] env[65370]: DEBUG networking_nsxv3.common.locking [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 921.310386] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquiring lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 921.310557] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquired lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 921.310874] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquired external semaphore "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 921.311105] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Releasing lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 921.311403] env[65370]: DEBUG dogpile.cache.region [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] No value present for key: 'zone-id' {{(pid=65370) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 921.311640] env[65370]: DEBUG dogpile.lock [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] NeedRegenerationException {{(pid=65370) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 921.311773] env[65370]: DEBUG dogpile.lock [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] no value, waiting for create lock {{(pid=65370) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 921.311882] env[65370]: DEBUG dogpile.lock [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] value creation lock acquired {{(pid=65370) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 921.312039] env[65370]: DEBUG dogpile.cache.region [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] No value present for key: 'zone-id' {{(pid=65370) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 921.312237] env[65370]: DEBUG dogpile.lock [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Calling creation function for not-yet-present value {{(pid=65370) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 921.312405] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 921.338242] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 921.338416] env[65370]: DEBUG dogpile.cache.region [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Cache value generated in 0.026 seconds for key(s): 'zone-id' {{(pid=65370) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 921.338553] env[65370]: DEBUG dogpile.lock [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Released creation lock {{(pid=65370) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 921.338734] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Releasing lock "network-237" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 921.339138] env[65370]: DEBUG networking_nsxv3.common.locking [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Lock port-40d129f9-c951-4327-9d03-538045f586cf taken with stack trace [, , , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 921.339319] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquiring lock "port-40d129f9-c951-4327-9d03-538045f586cf" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 921.339437] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquired lock "port-40d129f9-c951-4327-9d03-538045f586cf" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 921.339770] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquired external semaphore "port-40d129f9-c951-4327-9d03-538045f586cf" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 921.339909] env[65370]: DEBUG networking_nsxv3.api.rpc [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('40d129f9-c951-4327-9d03-538045f586cf',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 921.616885] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 6e3c565f-f2af-4875-a9bd-71c89c19f75f with status ACTIVE [ 921.617254] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 921.617403] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 921.617530] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 921.617743] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 921.617855] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 921.618048] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 921.618151] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 921.618210] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 921.618400] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 921.618505] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 921.618690] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 921.618789] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 921.618863] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 921.619026] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 921.619090] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 921.619178] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 6e3c565f-f2af-4875-a9bd-71c89c19f75f is going to be updated. [ 921.639938] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 921.640144] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 921.640249] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 921.640363] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 921.640497] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 921.640654] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-6e3c565f-f2af-4875-a9bd-71c89c19f75f" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 921.842625] env[65370]: DEBUG networking_nsxv3.common.locking [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 921.842756] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquiring lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 921.842791] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquired lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 921.843084] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquired external semaphore "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 921.843238] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Releasing lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 921.843389] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Segment Port 40d129f9-c951-4327-9d03-538045f586cf not found, creating... [ 921.843712] env[65370]: DEBUG networking_nsxv3.common.locking [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 921.843830] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquiring lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 921.843921] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquired lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 921.844127] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquired external semaphore "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 921.844258] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Releasing lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 921.844787] env[65370]: DEBUG networking_nsxv3.common.locking [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 921.844930] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquiring lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 921.845087] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquired lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 921.845314] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquired external semaphore "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 921.845452] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Releasing lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 921.845598] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Resource: SegmentPort with ID: 40d129f9-c951-4327-9d03-538045f586cf is going to be created. [ 921.866803] env[65370]: DEBUG networking_nsxv3.common.locking [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 921.867022] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquiring lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 921.867145] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquired lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 921.867588] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquired external semaphore "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 921.868210] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Releasing lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 921.868462] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Releasing lock "port-40d129f9-c951-4327-9d03-538045f586cf" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 922.011264] env[65370]: INFO networking_nsxv3.common.synchronization [req-93cfe61c-1381-4983-b69c-855588b959b9 req-71a2e04a-9c93-4c9b-9363-b2267c476cff tempest-MigrationsAdminTest-1653527346 tempest-MigrationsAdminTest-1653527346-project-member] Enqueued Resource ID: 00a251e9-7a00-4293-9092-9556bc8b91c2 with Priority: HIGHEST for action security_group_members [ 922.011820] env[65370]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 00a251e9-7a00-4293-9092-9556bc8b91c2 with Priority: HIGHEST for action security_group_members [ 922.012161] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock member-00a251e9-7a00-4293-9092-9556bc8b91c2 taken with stack trace [, , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 922.012368] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-00a251e9-7a00-4293-9092-9556bc8b91c2" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 922.012368] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-00a251e9-7a00-4293-9092-9556bc8b91c2" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 922.012565] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-00a251e9-7a00-4293-9092-9556bc8b91c2" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 922.012754] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 922.012839] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 922.012883] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 922.013064] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 922.013154] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 922.013307] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('00a251e9-7a00-4293-9092-9556bc8b91c2',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 922.431555] env[65370]: INFO networking_nsxv3.common.synchronization [req-b8e23366-b8e0-4548-8b89-ead3a410d917 req-33e387fd-143a-42aa-87ff-ef67a6d06376 tempest-MultipleCreateTestJSON-1838347642 tempest-MultipleCreateTestJSON-1838347642-project-member] Enqueued Resource ID: 1bc5c407-ee61-45f3-a29e-c586a26bcaff with Priority: HIGHEST for action security_group_members [ 922.432730] env[65370]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1bc5c407-ee61-45f3-a29e-c586a26bcaff with Priority: HIGHEST for action security_group_members [ 922.433067] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock member-1bc5c407-ee61-45f3-a29e-c586a26bcaff taken with stack trace [, , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 922.435287] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1bc5c407-ee61-45f3-a29e-c586a26bcaff" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 922.435287] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1bc5c407-ee61-45f3-a29e-c586a26bcaff" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 922.435287] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1bc5c407-ee61-45f3-a29e-c586a26bcaff" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 922.435287] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 922.435287] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 922.435287] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 922.435287] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 922.435287] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 922.435287] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1bc5c407-ee61-45f3-a29e-c586a26bcaff',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 922.517772] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 922.517772] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 922.517772] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 922.517772] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 922.541562] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 922.541827] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 922.541965] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 922.542047] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 922.542253] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 922.542335] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 922.542425] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 00a251e9-7a00-4293-9092-9556bc8b91c2 is going to be updated. [ 922.552618] env[65370]: INFO networking_nsxv3.common.synchronization [req-b8e23366-b8e0-4548-8b89-ead3a410d917 req-5fc0317b-df36-4cb4-8d95-c40543845955 service nova] Enqueued Resource ID: 1bc5c407-ee61-45f3-a29e-c586a26bcaff with Priority: HIGHEST for action security_group_rules [ 922.552618] env[65370]: INFO networking_nsxv3.common.synchronization [req-b8e23366-b8e0-4548-8b89-ead3a410d917 req-5fc0317b-df36-4cb4-8d95-c40543845955 service nova] Enqueued Resource ID: 1bc5c407-ee61-45f3-a29e-c586a26bcaff with Priority: HIGHEST for action security_group_members [ 922.553407] env[65370]: INFO networking_nsxv3.common.synchronization [req-b8e23366-b8e0-4548-8b89-ead3a410d917 req-5fc0317b-df36-4cb4-8d95-c40543845955 service nova] Enqueued Resource ID: 40d129f9-c951-4327-9d03-538045f586cf with Priority: HIGHEST for action port [ 922.553407] env[65370]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1bc5c407-ee61-45f3-a29e-c586a26bcaff with Priority: HIGHEST for action security_group_rules [ 922.553407] env[65370]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1bc5c407-ee61-45f3-a29e-c586a26bcaff with Priority: HIGHEST for action security_group_members [ 922.553407] env[65370]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 40d129f9-c951-4327-9d03-538045f586cf with Priority: HIGHEST for action port [ 922.553757] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock rules-1bc5c407-ee61-45f3-a29e-c586a26bcaff taken with stack trace [, , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 922.553757] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-1bc5c407-ee61-45f3-a29e-c586a26bcaff" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 922.553914] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-1bc5c407-ee61-45f3-a29e-c586a26bcaff" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 922.554217] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-1bc5c407-ee61-45f3-a29e-c586a26bcaff" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 922.554297] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('1bc5c407-ee61-45f3-a29e-c586a26bcaff',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 922.555598] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock member-1bc5c407-ee61-45f3-a29e-c586a26bcaff taken with stack trace [, , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 922.555598] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1bc5c407-ee61-45f3-a29e-c586a26bcaff" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 922.555822] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock port-40d129f9-c951-4327-9d03-538045f586cf taken with stack trace [, , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 922.555989] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-40d129f9-c951-4327-9d03-538045f586cf" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 922.556193] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-40d129f9-c951-4327-9d03-538045f586cf" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 922.556279] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-40d129f9-c951-4327-9d03-538045f586cf" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 922.556374] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('40d129f9-c951-4327-9d03-538045f586cf',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 922.570227] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 922.570227] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 922.570227] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 922.570446] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 922.570446] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 922.579577] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 00a251e9-7a00-4293-9092-9556bc8b91c2 in Status: IN_PROGRESS for 2s [ 922.799335] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7960de7e-23b5-46db-b2ee-c5bd971f27a6 in Status: SUCCESS [ 922.799550] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7960de7e-23b5-46db-b2ee-c5bd971f27a6" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 922.799717] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7960de7e-23b5-46db-b2ee-c5bd971f27a6" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 922.799923] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7960de7e-23b5-46db-b2ee-c5bd971f27a6" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 922.801246] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 922.801380] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 922.801444] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 922.801613] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 922.801712] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 922.801777] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7960de7e-23b5-46db-b2ee-c5bd971f27a6',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 922.904237] env[65370]: DEBUG networking_nsxv3.common.locking [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Lock network-237 taken with stack trace [, , , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 922.904516] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquiring lock "network-237" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 922.904663] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquired lock "network-237" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 922.904918] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquired external semaphore "network-237" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 922.905229] env[65370]: DEBUG networking_nsxv3.common.locking [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 922.905388] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquiring lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 922.905505] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquired lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 922.905715] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquired external semaphore "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 922.905855] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Releasing lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 922.906076] env[65370]: DEBUG dogpile.cache.region [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] No value present for key: 'zone-id' {{(pid=65370) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 922.906190] env[65370]: DEBUG dogpile.lock [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] NeedRegenerationException {{(pid=65370) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 922.906295] env[65370]: DEBUG dogpile.lock [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] no value, waiting for create lock {{(pid=65370) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 922.906402] env[65370]: DEBUG dogpile.lock [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] value creation lock acquired {{(pid=65370) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 922.906621] env[65370]: DEBUG dogpile.cache.region [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] No value present for key: 'zone-id' {{(pid=65370) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 922.906757] env[65370]: DEBUG dogpile.lock [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Calling creation function for not-yet-present value {{(pid=65370) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 922.906891] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 922.927236] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 922.927460] env[65370]: DEBUG dogpile.cache.region [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=65370) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 922.927605] env[65370]: DEBUG dogpile.lock [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Released creation lock {{(pid=65370) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 922.927800] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Releasing lock "network-237" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 922.928125] env[65370]: DEBUG networking_nsxv3.common.locking [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Lock port-3e8b458f-db8c-42eb-91fb-b78017514d2b taken with stack trace [, , , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 922.928296] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquiring lock "port-3e8b458f-db8c-42eb-91fb-b78017514d2b" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 922.928413] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquired lock "port-3e8b458f-db8c-42eb-91fb-b78017514d2b" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 922.928732] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquired external semaphore "port-3e8b458f-db8c-42eb-91fb-b78017514d2b" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 922.928888] env[65370]: DEBUG networking_nsxv3.api.rpc [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3e8b458f-db8c-42eb-91fb-b78017514d2b',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 922.937717] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('1bc5c407-ee61-45f3-a29e-c586a26bcaff',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 922.992575] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: feaf18c3-295c-41df-89f1-309931cdeca1 in Status: SUCCESS [ 922.992860] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-feaf18c3-295c-41df-89f1-309931cdeca1" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 923.056551] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock member-1bc5c407-ee61-45f3-a29e-c586a26bcaff taken with stack trace [, , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 923.058013] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1bc5c407-ee61-45f3-a29e-c586a26bcaff" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 923.061951] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 40d129f9-c951-4327-9d03-538045f586cf with status ACTIVE [ 923.061951] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 923.061951] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 923.061951] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 923.062261] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 923.062355] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 923.062571] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 923.062683] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 923.062749] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 923.062925] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 923.063009] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 923.063211] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 923.063346] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 923.063394] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 923.063527] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 923.063622] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 923.063715] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 40d129f9-c951-4327-9d03-538045f586cf is going to be updated. [ 923.087401] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 923.087549] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 923.087622] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 923.087842] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 923.087977] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 923.088154] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-40d129f9-c951-4327-9d03-538045f586cf" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 923.305978] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('7960de7e-23b5-46db-b2ee-c5bd971f27a6',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 923.431201] env[65370]: DEBUG networking_nsxv3.common.locking [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 923.431413] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquiring lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 923.431531] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquired lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 923.431808] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquired external semaphore "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 923.432071] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Releasing lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 923.432109] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Segment Port 3e8b458f-db8c-42eb-91fb-b78017514d2b not found, creating... [ 923.432344] env[65370]: DEBUG networking_nsxv3.common.locking [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 923.432499] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquiring lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 923.432606] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquired lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 923.432821] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquired external semaphore "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 923.432942] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Releasing lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 923.434986] env[65370]: DEBUG networking_nsxv3.common.locking [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 923.434986] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquiring lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 923.434986] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquired lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 923.434986] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquired external semaphore "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 923.434986] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Releasing lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 923.434986] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Resource: SegmentPort with ID: 3e8b458f-db8c-42eb-91fb-b78017514d2b is going to be created. [ 923.439314] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('1bc5c407-ee61-45f3-a29e-c586a26bcaff',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 923.458406] env[65370]: DEBUG networking_nsxv3.common.locking [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 923.458578] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquiring lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 923.458578] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquired lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 923.458987] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquired external semaphore "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 923.459568] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Releasing lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 923.459568] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Releasing lock "port-3e8b458f-db8c-42eb-91fb-b78017514d2b" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 923.808153] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('7960de7e-23b5-46db-b2ee-c5bd971f27a6',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 923.941614] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 923.941802] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 923.941871] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 923.945103] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 923.945103] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 923.945103] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1bc5c407-ee61-45f3-a29e-c586a26bcaff is going to be created. [ 923.993850] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 923.995189] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 923.995318] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 923.995709] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 923.995872] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 924.014866] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1bc5c407-ee61-45f3-a29e-c586a26bcaff in Status: UNINITIALIZED for 2s [ 924.282167] env[65370]: INFO networking_nsxv3.common.synchronization [req-b8e23366-b8e0-4548-8b89-ead3a410d917 req-d9eadd5f-830b-4849-b2ab-914a824d3343 service nova] Enqueued Resource ID: 1bc5c407-ee61-45f3-a29e-c586a26bcaff with Priority: HIGHEST for action security_group_rules [ 924.282167] env[65370]: INFO networking_nsxv3.common.synchronization [req-b8e23366-b8e0-4548-8b89-ead3a410d917 req-d9eadd5f-830b-4849-b2ab-914a824d3343 service nova] Enqueued Resource ID: 1bc5c407-ee61-45f3-a29e-c586a26bcaff with Priority: HIGHEST for action security_group_members [ 924.282167] env[65370]: INFO networking_nsxv3.common.synchronization [req-b8e23366-b8e0-4548-8b89-ead3a410d917 req-d9eadd5f-830b-4849-b2ab-914a824d3343 service nova] Enqueued Resource ID: 3e8b458f-db8c-42eb-91fb-b78017514d2b with Priority: HIGHEST for action port [ 924.282697] env[65370]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1bc5c407-ee61-45f3-a29e-c586a26bcaff with Priority: HIGHEST for action security_group_rules [ 924.282868] env[65370]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1bc5c407-ee61-45f3-a29e-c586a26bcaff with Priority: HIGHEST for action security_group_members [ 924.283094] env[65370]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3e8b458f-db8c-42eb-91fb-b78017514d2b with Priority: HIGHEST for action port [ 924.283803] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock rules-1bc5c407-ee61-45f3-a29e-c586a26bcaff taken with stack trace [, , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 924.283803] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-1bc5c407-ee61-45f3-a29e-c586a26bcaff" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 924.283803] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock member-1bc5c407-ee61-45f3-a29e-c586a26bcaff taken with stack trace [, , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 924.283803] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1bc5c407-ee61-45f3-a29e-c586a26bcaff" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 924.284054] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock port-3e8b458f-db8c-42eb-91fb-b78017514d2b taken with stack trace [, , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 924.284054] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-3e8b458f-db8c-42eb-91fb-b78017514d2b" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 924.284138] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-3e8b458f-db8c-42eb-91fb-b78017514d2b" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 924.284584] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-3e8b458f-db8c-42eb-91fb-b78017514d2b" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 924.284584] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3e8b458f-db8c-42eb-91fb-b78017514d2b',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 924.312058] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 924.312265] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 924.312301] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 924.312497] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 924.312593] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 924.312675] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7960de7e-23b5-46db-b2ee-c5bd971f27a6 is going to be updated. [ 924.342325] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 924.342480] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 924.342552] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 924.342770] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 924.342923] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 924.352904] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7960de7e-23b5-46db-b2ee-c5bd971f27a6 in Status: IN_PROGRESS for 2s [ 924.591435] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 00a251e9-7a00-4293-9092-9556bc8b91c2 in Status: SUCCESS [ 924.591834] env[65370]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 00a251e9-7a00-4293-9092-9556bc8b91c2 deletion is rescheduled due to dependency. [ 924.591834] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-00a251e9-7a00-4293-9092-9556bc8b91c2" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 924.788441] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 3e8b458f-db8c-42eb-91fb-b78017514d2b with status ACTIVE [ 924.788441] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 924.788441] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 924.788441] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 924.788441] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 924.788976] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 924.788976] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 924.788976] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 924.788976] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 924.788976] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 924.789183] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 924.789255] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 924.789353] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 924.789411] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 924.789575] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 924.789677] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 924.789776] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 3e8b458f-db8c-42eb-91fb-b78017514d2b is going to be updated. [ 924.816057] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 924.816224] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 924.816290] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 924.816470] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 924.817316] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 924.817316] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-3e8b458f-db8c-42eb-91fb-b78017514d2b" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 925.932223] env[65370]: INFO networking_nsxv3.common.synchronization [req-9d55ea66-6ec5-46f6-b16d-db0affe29b16 req-f29ce8f0-d26e-4e7f-9886-64571f6b68fe tempest-InstanceActionsV221TestJSON-1893935899 tempest-InstanceActionsV221TestJSON-1893935899-project-member] Enqueued Resource ID: 1ba7c228-9a96-4f3b-9855-f84e883a5bfd with Priority: HIGHEST for action security_group_members [ 925.932806] env[65370]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1ba7c228-9a96-4f3b-9855-f84e883a5bfd with Priority: HIGHEST for action security_group_members [ 925.933237] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock member-1ba7c228-9a96-4f3b-9855-f84e883a5bfd taken with stack trace [, , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 925.933411] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1ba7c228-9a96-4f3b-9855-f84e883a5bfd" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 925.933509] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1ba7c228-9a96-4f3b-9855-f84e883a5bfd" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 925.933767] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1ba7c228-9a96-4f3b-9855-f84e883a5bfd" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 925.933977] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 925.934134] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 925.934230] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 925.934440] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 925.934624] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 925.934696] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1ba7c228-9a96-4f3b-9855-f84e883a5bfd',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 926.025568] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1bc5c407-ee61-45f3-a29e-c586a26bcaff in Status: SUCCESS [ 926.025902] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1bc5c407-ee61-45f3-a29e-c586a26bcaff" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 926.026096] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1bc5c407-ee61-45f3-a29e-c586a26bcaff" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 926.026381] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1bc5c407-ee61-45f3-a29e-c586a26bcaff" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 926.026640] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 926.026751] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 926.026830] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 926.027025] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 926.027110] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 926.027221] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1bc5c407-ee61-45f3-a29e-c586a26bcaff',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 926.364182] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7960de7e-23b5-46db-b2ee-c5bd971f27a6 in Status: SUCCESS [ 926.364182] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7960de7e-23b5-46db-b2ee-c5bd971f27a6" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 926.364182] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7960de7e-23b5-46db-b2ee-c5bd971f27a6" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 926.364319] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7960de7e-23b5-46db-b2ee-c5bd971f27a6" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 926.364445] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 926.364611] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 926.364677] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 926.364831] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 926.364910] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 926.364998] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7960de7e-23b5-46db-b2ee-c5bd971f27a6" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 926.365110] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('7960de7e-23b5-46db-b2ee-c5bd971f27a6',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 926.366437] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7960de7e-23b5-46db-b2ee-c5bd971f27a6" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 926.366437] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7960de7e-23b5-46db-b2ee-c5bd971f27a6" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 926.366437] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 926.366437] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 926.366437] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 926.366854] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 926.366854] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 926.366854] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7960de7e-23b5-46db-b2ee-c5bd971f27a6',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 926.436613] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 926.436779] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 926.436838] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 926.437116] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 926.437208] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 926.437412] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 926.437534] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 926.437589] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 926.437752] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 926.437829] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 926.437913] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1ba7c228-9a96-4f3b-9855-f84e883a5bfd is going to be updated. [ 926.467154] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 926.467309] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 926.467374] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 926.468034] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 926.468034] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 926.478447] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1ba7c228-9a96-4f3b-9855-f84e883a5bfd in Status: IN_PROGRESS for 2s [ 926.531182] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('1bc5c407-ee61-45f3-a29e-c586a26bcaff',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 926.631260] env[65370]: INFO networking_nsxv3.common.synchronization [req-1d6e0891-838f-4e74-a7fd-0c4be8fc0eae req-072406fb-0254-4cb1-98c3-c8e61b099c50 tempest-ServersAdminNegativeTestJSON-2075318315 tempest-ServersAdminNegativeTestJSON-2075318315-project-member] Enqueued Resource ID: ae63a79d-837f-4a55-a83c-bcd245828917 with Priority: HIGHEST for action security_group_members [ 926.631854] env[65370]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ae63a79d-837f-4a55-a83c-bcd245828917 with Priority: HIGHEST for action security_group_members [ 926.632160] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock member-ae63a79d-837f-4a55-a83c-bcd245828917 taken with stack trace [, , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 926.632290] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ae63a79d-837f-4a55-a83c-bcd245828917" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 926.632358] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ae63a79d-837f-4a55-a83c-bcd245828917" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 926.632560] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ae63a79d-837f-4a55-a83c-bcd245828917" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 926.632714] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 926.632814] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 926.632909] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 926.635495] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 926.635630] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 926.635699] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ae63a79d-837f-4a55-a83c-bcd245828917',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 926.868961] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock member-7960de7e-23b5-46db-b2ee-c5bd971f27a6 taken with stack trace [, , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 926.869609] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7960de7e-23b5-46db-b2ee-c5bd971f27a6" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 926.871427] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('7960de7e-23b5-46db-b2ee-c5bd971f27a6',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 926.978381] env[65370]: INFO networking_nsxv3.common.synchronization [req-209fb281-f832-48d8-885b-5c120ade92da req-83b1f60d-7981-471c-b8d1-94ec74fec402 tempest-ImagesTestJSON-246049254 tempest-ImagesTestJSON-246049254-project-member] Enqueued Resource ID: 67f4a0c1-3a3c-4ed8-9358-3a9645aba154 with Priority: HIGHEST for action security_group_members [ 926.979044] env[65370]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 67f4a0c1-3a3c-4ed8-9358-3a9645aba154 with Priority: HIGHEST for action security_group_members [ 926.979262] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock member-67f4a0c1-3a3c-4ed8-9358-3a9645aba154 taken with stack trace [, , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 926.979387] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-67f4a0c1-3a3c-4ed8-9358-3a9645aba154" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 926.979452] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-67f4a0c1-3a3c-4ed8-9358-3a9645aba154" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 926.979651] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-67f4a0c1-3a3c-4ed8-9358-3a9645aba154" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 926.979820] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 926.979903] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 926.979963] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 926.980123] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 926.980208] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 926.980301] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('67f4a0c1-3a3c-4ed8-9358-3a9645aba154',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 927.034045] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('1bc5c407-ee61-45f3-a29e-c586a26bcaff',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 927.138128] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 927.138284] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 927.138411] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 927.139045] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 927.139045] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 927.139045] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 927.139045] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 927.139341] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 927.139341] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 927.139341] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 927.139467] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ae63a79d-837f-4a55-a83c-bcd245828917 is going to be updated. [ 927.171144] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 927.171144] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 927.171144] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 927.171144] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 927.171144] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 927.179967] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ae63a79d-837f-4a55-a83c-bcd245828917 in Status: IN_PROGRESS for 2s [ 927.288616] env[65370]: INFO networking_nsxv3.common.synchronization [req-0f4d0843-4cf7-4503-bf8f-172ae608b691 req-d014b7e0-ff3b-47e6-b060-ac5e5a24da61 tempest-FloatingIPsAssociationTestJSON-1189544841 tempest-FloatingIPsAssociationTestJSON-1189544841-project-member] Enqueued Resource ID: de5a6b9b-a5a9-4ccc-b897-0244548cc5fd with Priority: HIGHEST for action security_group_members [ 927.289216] env[65370]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: de5a6b9b-a5a9-4ccc-b897-0244548cc5fd with Priority: HIGHEST for action security_group_members [ 927.289520] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock member-de5a6b9b-a5a9-4ccc-b897-0244548cc5fd taken with stack trace [, , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 927.289643] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-de5a6b9b-a5a9-4ccc-b897-0244548cc5fd" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 927.289708] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-de5a6b9b-a5a9-4ccc-b897-0244548cc5fd" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 927.290419] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-de5a6b9b-a5a9-4ccc-b897-0244548cc5fd" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 927.290663] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 927.290812] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 927.290906] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 927.291121] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 927.291241] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 927.291365] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('de5a6b9b-a5a9-4ccc-b897-0244548cc5fd',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 927.374223] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('7960de7e-23b5-46db-b2ee-c5bd971f27a6',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 927.482761] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 927.482964] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 927.483058] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 927.484226] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 927.484333] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 927.484557] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 927.484668] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 927.484732] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 927.484885] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 927.485033] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 927.485085] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 67f4a0c1-3a3c-4ed8-9358-3a9645aba154 is going to be updated. [ 927.513766] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 927.513901] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 927.513968] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 927.514182] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 927.514317] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 927.524056] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 67f4a0c1-3a3c-4ed8-9358-3a9645aba154 in Status: IN_PROGRESS for 2s [ 927.538049] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 927.538049] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 927.538049] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 927.538049] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 927.538049] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 927.538049] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1bc5c407-ee61-45f3-a29e-c586a26bcaff is going to be updated. [ 927.570219] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 927.570360] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 927.570450] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 927.571308] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 927.571308] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 927.584526] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1bc5c407-ee61-45f3-a29e-c586a26bcaff in Status: IN_PROGRESS for 2s [ 927.646172] env[65370]: DEBUG networking_nsxv3.common.locking [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Lock network-161 taken with stack trace [, , , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 927.646340] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquiring lock "network-161" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 927.646527] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquired lock "network-161" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 927.646837] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquired external semaphore "network-161" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 927.647167] env[65370]: DEBUG networking_nsxv3.common.locking [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 927.647367] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquiring lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 927.647521] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquired lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 927.647857] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquired external semaphore "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 927.648041] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Releasing lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 927.648314] env[65370]: DEBUG dogpile.cache.region [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] No value present for key: 'zone-id' {{(pid=65370) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 927.648411] env[65370]: DEBUG dogpile.lock [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] NeedRegenerationException {{(pid=65370) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 927.648485] env[65370]: DEBUG dogpile.lock [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] no value, waiting for create lock {{(pid=65370) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 927.648575] env[65370]: DEBUG dogpile.lock [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] value creation lock acquired {{(pid=65370) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 927.648683] env[65370]: DEBUG dogpile.cache.region [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] No value present for key: 'zone-id' {{(pid=65370) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 927.648785] env[65370]: DEBUG dogpile.lock [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Calling creation function for not-yet-present value {{(pid=65370) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 927.648914] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 927.669556] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 927.669783] env[65370]: DEBUG dogpile.cache.region [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=65370) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 927.669879] env[65370]: DEBUG dogpile.lock [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Released creation lock {{(pid=65370) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 927.670062] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Releasing lock "network-161" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 927.670381] env[65370]: DEBUG networking_nsxv3.common.locking [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Lock port-e1cc699e-e6c8-4970-9472-376498adff47 taken with stack trace [, , , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 927.670550] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquiring lock "port-e1cc699e-e6c8-4970-9472-376498adff47" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 927.670669] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquired lock "port-e1cc699e-e6c8-4970-9472-376498adff47" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 927.670999] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquired external semaphore "port-e1cc699e-e6c8-4970-9472-376498adff47" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 927.671150] env[65370]: DEBUG networking_nsxv3.api.rpc [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e1cc699e-e6c8-4970-9472-376498adff47',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 927.794014] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('de5a6b9b-a5a9-4ccc-b897-0244548cc5fd',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 927.878540] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 927.878718] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 927.878768] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 927.878983] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 927.879095] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 927.879181] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7960de7e-23b5-46db-b2ee-c5bd971f27a6 is going to be updated. [ 927.916017] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 927.916194] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 927.916275] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 927.916489] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 927.916702] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 927.925649] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7960de7e-23b5-46db-b2ee-c5bd971f27a6 in Status: IN_PROGRESS for 2s [ 928.174237] env[65370]: DEBUG networking_nsxv3.common.locking [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 928.174237] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquiring lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 928.174237] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquired lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 928.174769] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquired external semaphore "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 928.174769] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Releasing lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 928.174838] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Segment Port e1cc699e-e6c8-4970-9472-376498adff47 not found, creating... [ 928.175054] env[65370]: DEBUG networking_nsxv3.common.locking [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 928.175529] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquiring lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 928.175664] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquired lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 928.176362] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquired external semaphore "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 928.176362] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Releasing lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 928.176362] env[65370]: DEBUG networking_nsxv3.common.locking [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 928.176700] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquiring lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 928.176700] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquired lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 928.176878] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquired external semaphore "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 928.177011] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Releasing lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 928.177153] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Resource: SegmentPort with ID: e1cc699e-e6c8-4970-9472-376498adff47 is going to be created. [ 928.200177] env[65370]: DEBUG networking_nsxv3.common.locking [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 928.200349] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquiring lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 928.201983] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquired lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 928.201983] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquired external semaphore "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 928.201983] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Releasing lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 928.201983] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Releasing lock "port-e1cc699e-e6c8-4970-9472-376498adff47" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 928.297319] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('de5a6b9b-a5a9-4ccc-b897-0244548cc5fd',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 928.494016] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1ba7c228-9a96-4f3b-9855-f84e883a5bfd in Status: SUCCESS [ 928.494016] env[65370]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1ba7c228-9a96-4f3b-9855-f84e883a5bfd deletion is rescheduled due to dependency. [ 928.494016] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1ba7c228-9a96-4f3b-9855-f84e883a5bfd" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 928.799648] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 928.800391] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 928.800391] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 928.800391] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 928.800391] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 928.800586] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: de5a6b9b-a5a9-4ccc-b897-0244548cc5fd is going to be updated. [ 928.907793] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 928.908695] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 928.908695] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 928.908695] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 928.910018] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 928.920211] env[65370]: INFO networking_nsxv3.common.synchronization [req-0f4d0843-4cf7-4503-bf8f-172ae608b691 req-5ebcefd8-7615-46f1-ac01-052acc768bff service nova] Enqueued Resource ID: de5a6b9b-a5a9-4ccc-b897-0244548cc5fd with Priority: HIGHEST for action security_group_rules [ 928.920942] env[65370]: INFO networking_nsxv3.common.synchronization [req-0f4d0843-4cf7-4503-bf8f-172ae608b691 req-5ebcefd8-7615-46f1-ac01-052acc768bff service nova] Enqueued Resource ID: de5a6b9b-a5a9-4ccc-b897-0244548cc5fd with Priority: HIGHEST for action security_group_members [ 928.920942] env[65370]: INFO networking_nsxv3.common.synchronization [req-0f4d0843-4cf7-4503-bf8f-172ae608b691 req-5ebcefd8-7615-46f1-ac01-052acc768bff service nova] Enqueued Resource ID: e1cc699e-e6c8-4970-9472-376498adff47 with Priority: HIGHEST for action port [ 928.921176] env[65370]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: de5a6b9b-a5a9-4ccc-b897-0244548cc5fd with Priority: HIGHEST for action security_group_rules [ 928.921176] env[65370]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: de5a6b9b-a5a9-4ccc-b897-0244548cc5fd with Priority: HIGHEST for action security_group_members [ 928.921292] env[65370]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e1cc699e-e6c8-4970-9472-376498adff47 with Priority: HIGHEST for action port [ 928.921501] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock rules-de5a6b9b-a5a9-4ccc-b897-0244548cc5fd taken with stack trace [, , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 928.921694] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-de5a6b9b-a5a9-4ccc-b897-0244548cc5fd" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 928.921694] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-de5a6b9b-a5a9-4ccc-b897-0244548cc5fd" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 928.921894] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-de5a6b9b-a5a9-4ccc-b897-0244548cc5fd" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 928.921996] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('de5a6b9b-a5a9-4ccc-b897-0244548cc5fd',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 928.923815] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock member-de5a6b9b-a5a9-4ccc-b897-0244548cc5fd taken with stack trace [, , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 928.923897] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-de5a6b9b-a5a9-4ccc-b897-0244548cc5fd" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 928.924078] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock port-e1cc699e-e6c8-4970-9472-376498adff47 taken with stack trace [, , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 928.924230] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-e1cc699e-e6c8-4970-9472-376498adff47" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 928.924325] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-e1cc699e-e6c8-4970-9472-376498adff47" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 928.924614] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-e1cc699e-e6c8-4970-9472-376498adff47" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 928.924704] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e1cc699e-e6c8-4970-9472-376498adff47',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 928.926395] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: de5a6b9b-a5a9-4ccc-b897-0244548cc5fd in Status: IN_PROGRESS for 2s [ 929.192835] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ae63a79d-837f-4a55-a83c-bcd245828917 in Status: SUCCESS [ 929.192835] env[65370]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ae63a79d-837f-4a55-a83c-bcd245828917 deletion is rescheduled due to dependency. [ 929.192835] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ae63a79d-837f-4a55-a83c-bcd245828917" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 929.427470] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock member-de5a6b9b-a5a9-4ccc-b897-0244548cc5fd taken with stack trace [, , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 929.427684] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-de5a6b9b-a5a9-4ccc-b897-0244548cc5fd" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 929.427948] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port e1cc699e-e6c8-4970-9472-376498adff47 with status ACTIVE [ 929.428313] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 929.428313] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 929.428443] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 929.428614] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 929.428734] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 929.428974] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 929.429147] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 929.429210] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 929.429407] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 929.429530] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 929.429671] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 929.429767] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 929.429802] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 929.429939] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 929.430039] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 929.430145] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: e1cc699e-e6c8-4970-9472-376498adff47 is going to be updated. [ 929.460061] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 929.460061] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 929.460061] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 929.460061] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 929.460061] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 929.460061] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-e1cc699e-e6c8-4970-9472-376498adff47" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 929.539641] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 67f4a0c1-3a3c-4ed8-9358-3a9645aba154 in Status: SUCCESS [ 929.539844] env[65370]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 67f4a0c1-3a3c-4ed8-9358-3a9645aba154 deletion is rescheduled due to dependency. [ 929.539936] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-67f4a0c1-3a3c-4ed8-9358-3a9645aba154" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 929.595500] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1bc5c407-ee61-45f3-a29e-c586a26bcaff in Status: SUCCESS [ 929.595645] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1bc5c407-ee61-45f3-a29e-c586a26bcaff" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 929.595913] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1bc5c407-ee61-45f3-a29e-c586a26bcaff" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 929.595989] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1bc5c407-ee61-45f3-a29e-c586a26bcaff" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 929.596320] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 929.596320] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 929.596500] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 929.596500] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 929.596648] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 929.596717] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1bc5c407-ee61-45f3-a29e-c586a26bcaff" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 929.596800] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('1bc5c407-ee61-45f3-a29e-c586a26bcaff',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 929.597803] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1bc5c407-ee61-45f3-a29e-c586a26bcaff" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 929.597927] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1bc5c407-ee61-45f3-a29e-c586a26bcaff" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 929.597998] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 929.598119] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 929.598176] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 929.598407] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 929.598407] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 929.598579] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1bc5c407-ee61-45f3-a29e-c586a26bcaff',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 929.801405] env[65370]: INFO networking_nsxv3.common.synchronization [req-c78c696a-86ee-4240-85a1-e4e88699f34f req-c7a5bd46-8ea4-4067-b1a8-5f4f3ca6d77a tempest-ServersV294TestFqdnHostnames-48421139 tempest-ServersV294TestFqdnHostnames-48421139-project-member] Enqueued Resource ID: 002e5341-7a4b-4a54-ad04-59531e87f867 with Priority: HIGHEST for action security_group_members [ 929.802311] env[65370]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 002e5341-7a4b-4a54-ad04-59531e87f867 with Priority: HIGHEST for action security_group_members [ 929.802826] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock member-002e5341-7a4b-4a54-ad04-59531e87f867 taken with stack trace [, , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 929.802970] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-002e5341-7a4b-4a54-ad04-59531e87f867" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 929.803091] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-002e5341-7a4b-4a54-ad04-59531e87f867" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 929.803456] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-002e5341-7a4b-4a54-ad04-59531e87f867" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 929.803706] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 929.803879] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 929.803995] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 929.804274] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 929.804520] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 929.804581] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('002e5341-7a4b-4a54-ad04-59531e87f867',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 929.936297] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7960de7e-23b5-46db-b2ee-c5bd971f27a6 in Status: SUCCESS [ 929.936542] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7960de7e-23b5-46db-b2ee-c5bd971f27a6" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 929.936743] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7960de7e-23b5-46db-b2ee-c5bd971f27a6" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 929.937015] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7960de7e-23b5-46db-b2ee-c5bd971f27a6" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 929.937218] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 929.937344] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 929.937462] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 929.937655] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 929.937749] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 929.937818] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7960de7e-23b5-46db-b2ee-c5bd971f27a6" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 929.937993] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock member-7960de7e-23b5-46db-b2ee-c5bd971f27a6 taken with stack trace [, , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 929.938114] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7960de7e-23b5-46db-b2ee-c5bd971f27a6" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 929.938172] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7960de7e-23b5-46db-b2ee-c5bd971f27a6" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 929.938309] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7960de7e-23b5-46db-b2ee-c5bd971f27a6" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 929.938461] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 929.938572] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 929.938637] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 929.938876] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 929.938876] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 929.938989] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7960de7e-23b5-46db-b2ee-c5bd971f27a6" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 929.940702] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('7960de7e-23b5-46db-b2ee-c5bd971f27a6',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 930.100305] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock member-1bc5c407-ee61-45f3-a29e-c586a26bcaff taken with stack trace [, , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 930.101569] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1bc5c407-ee61-45f3-a29e-c586a26bcaff" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 930.101569] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('1bc5c407-ee61-45f3-a29e-c586a26bcaff',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 930.245563] env[65370]: DEBUG networking_nsxv3.common.locking [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Lock network-593 taken with stack trace [, , , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 930.245915] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquiring lock "network-593" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 930.245915] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquired lock "network-593" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 930.246283] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquired external semaphore "network-593" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 930.246605] env[65370]: DEBUG networking_nsxv3.common.locking [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 930.246786] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquiring lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 930.247049] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquired lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 930.247169] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquired external semaphore "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 930.247335] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Releasing lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 930.247584] env[65370]: DEBUG dogpile.cache.region [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] No value present for key: 'zone-id' {{(pid=65370) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 930.247722] env[65370]: DEBUG dogpile.lock [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] NeedRegenerationException {{(pid=65370) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 930.247841] env[65370]: DEBUG dogpile.lock [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] no value, waiting for create lock {{(pid=65370) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 930.247968] env[65370]: DEBUG dogpile.lock [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] value creation lock acquired {{(pid=65370) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 930.248091] env[65370]: DEBUG dogpile.cache.region [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] No value present for key: 'zone-id' {{(pid=65370) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 930.248258] env[65370]: DEBUG dogpile.lock [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Calling creation function for not-yet-present value {{(pid=65370) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 930.248456] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 930.270680] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 930.270680] env[65370]: DEBUG dogpile.cache.region [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=65370) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 930.270680] env[65370]: DEBUG dogpile.lock [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Released creation lock {{(pid=65370) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 930.270680] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Releasing lock "network-593" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 930.270887] env[65370]: DEBUG networking_nsxv3.common.locking [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Lock port-b0e30f4f-e181-4a01-93a2-2a3ba52801c3 taken with stack trace [, , , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 930.270976] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquiring lock "port-b0e30f4f-e181-4a01-93a2-2a3ba52801c3" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 930.271035] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquired lock "port-b0e30f4f-e181-4a01-93a2-2a3ba52801c3" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 930.271375] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquired external semaphore "port-b0e30f4f-e181-4a01-93a2-2a3ba52801c3" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 930.271512] env[65370]: DEBUG networking_nsxv3.api.rpc [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b0e30f4f-e181-4a01-93a2-2a3ba52801c3',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 930.307555] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 930.307732] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 930.307861] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 930.308161] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 930.308320] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 930.308577] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 930.308843] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 930.308961] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 930.309170] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 930.309444] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 930.309563] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 002e5341-7a4b-4a54-ad04-59531e87f867 already deleted. [ 930.309676] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-002e5341-7a4b-4a54-ad04-59531e87f867" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 930.442614] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 7960de7e-23b5-46db-b2ee-c5bd971f27a6: rpc.has_security_group_logging(os_id): False [ 930.471326] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 930.471641] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 930.471770] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 930.472178] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 930.472500] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 930.472964] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 930.473703] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 930.473703] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 930.473703] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 930.474372] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 930.474372] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 930.475603] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 930.475603] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 930.475603] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 930.475603] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 930.475796] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 930.475882] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 930.476020] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 930.476630] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 930.476630] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 930.476630] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 7960de7e-23b5-46db-b2ee-c5bd971f27a6 is going to be updated. [ 930.562620] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 930.562920] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 930.562920] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 930.563128] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 930.563486] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 930.586286] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7960de7e-23b5-46db-b2ee-c5bd971f27a6 in Status: IN_PROGRESS for 2s [ 930.604787] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('1bc5c407-ee61-45f3-a29e-c586a26bcaff',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 930.776088] env[65370]: DEBUG networking_nsxv3.common.locking [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 930.776088] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquiring lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 930.776088] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquired lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 930.776088] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquired external semaphore "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 930.776088] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Releasing lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 930.776088] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Segment Port b0e30f4f-e181-4a01-93a2-2a3ba52801c3 not found, creating... [ 930.776472] env[65370]: DEBUG networking_nsxv3.common.locking [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 930.776472] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquiring lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 930.776472] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquired lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 930.776665] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquired external semaphore "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 930.778076] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Releasing lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 930.778076] env[65370]: DEBUG networking_nsxv3.common.locking [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 930.778076] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquiring lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 930.778076] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquired lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 930.778706] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquired external semaphore "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 930.779197] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Releasing lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 930.779197] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Resource: SegmentPort with ID: b0e30f4f-e181-4a01-93a2-2a3ba52801c3 is going to be created. [ 930.803906] env[65370]: DEBUG networking_nsxv3.common.locking [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 930.804148] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquiring lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 930.804259] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquired lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 930.804572] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquired external semaphore "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 930.804848] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Releasing lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 930.805163] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Releasing lock "port-b0e30f4f-e181-4a01-93a2-2a3ba52801c3" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 930.939352] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: de5a6b9b-a5a9-4ccc-b897-0244548cc5fd in Status: SUCCESS [ 930.939604] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-de5a6b9b-a5a9-4ccc-b897-0244548cc5fd" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 930.939782] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-de5a6b9b-a5a9-4ccc-b897-0244548cc5fd" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 930.940016] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-de5a6b9b-a5a9-4ccc-b897-0244548cc5fd" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 930.940221] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 930.940368] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 930.940435] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 930.940786] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 930.940996] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 930.941188] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('de5a6b9b-a5a9-4ccc-b897-0244548cc5fd',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 931.107469] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 931.108024] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 931.108024] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 931.108406] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 931.108406] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 931.108406] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1bc5c407-ee61-45f3-a29e-c586a26bcaff is going to be updated. [ 931.164815] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 931.165017] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 931.165089] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 931.165337] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 931.165501] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 931.177676] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1bc5c407-ee61-45f3-a29e-c586a26bcaff in Status: IN_PROGRESS for 2s [ 931.443325] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('de5a6b9b-a5a9-4ccc-b897-0244548cc5fd',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 931.535372] env[65370]: INFO networking_nsxv3.common.synchronization [req-c78c696a-86ee-4240-85a1-e4e88699f34f req-3a8cd705-35ba-4344-85e1-53440c9d88b5 service nova] Enqueued Resource ID: 002e5341-7a4b-4a54-ad04-59531e87f867 with Priority: HIGHEST for action security_group_rules [ 931.535659] env[65370]: INFO networking_nsxv3.common.synchronization [req-c78c696a-86ee-4240-85a1-e4e88699f34f req-3a8cd705-35ba-4344-85e1-53440c9d88b5 service nova] Enqueued Resource ID: 002e5341-7a4b-4a54-ad04-59531e87f867 with Priority: HIGHEST for action security_group_members [ 931.535856] env[65370]: INFO networking_nsxv3.common.synchronization [req-c78c696a-86ee-4240-85a1-e4e88699f34f req-3a8cd705-35ba-4344-85e1-53440c9d88b5 service nova] Enqueued Resource ID: b0e30f4f-e181-4a01-93a2-2a3ba52801c3 with Priority: HIGHEST for action port [ 931.536439] env[65370]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 002e5341-7a4b-4a54-ad04-59531e87f867 with Priority: HIGHEST for action security_group_rules [ 931.536665] env[65370]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 002e5341-7a4b-4a54-ad04-59531e87f867 with Priority: HIGHEST for action security_group_members [ 931.536800] env[65370]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b0e30f4f-e181-4a01-93a2-2a3ba52801c3 with Priority: HIGHEST for action port [ 931.537202] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock rules-002e5341-7a4b-4a54-ad04-59531e87f867 taken with stack trace [, , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 931.537346] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-002e5341-7a4b-4a54-ad04-59531e87f867" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 931.537425] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-002e5341-7a4b-4a54-ad04-59531e87f867" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 931.537692] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-002e5341-7a4b-4a54-ad04-59531e87f867" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 931.537733] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('002e5341-7a4b-4a54-ad04-59531e87f867',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 931.538611] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock member-002e5341-7a4b-4a54-ad04-59531e87f867 taken with stack trace [, , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 931.538755] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-002e5341-7a4b-4a54-ad04-59531e87f867" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 931.538814] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-002e5341-7a4b-4a54-ad04-59531e87f867" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 931.538989] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-002e5341-7a4b-4a54-ad04-59531e87f867" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 931.539197] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 931.539279] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 931.539333] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 931.539483] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 931.539569] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 931.539662] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('002e5341-7a4b-4a54-ad04-59531e87f867',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 931.540518] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock port-b0e30f4f-e181-4a01-93a2-2a3ba52801c3 taken with stack trace [, , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 931.540663] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b0e30f4f-e181-4a01-93a2-2a3ba52801c3" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 931.540721] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b0e30f4f-e181-4a01-93a2-2a3ba52801c3" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 931.540860] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b0e30f4f-e181-4a01-93a2-2a3ba52801c3" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 931.540904] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b0e30f4f-e181-4a01-93a2-2a3ba52801c3',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 931.945600] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('de5a6b9b-a5a9-4ccc-b897-0244548cc5fd',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 932.042308] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock member-002e5341-7a4b-4a54-ad04-59531e87f867 taken with stack trace [, , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 932.042799] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-002e5341-7a4b-4a54-ad04-59531e87f867" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 932.043173] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('002e5341-7a4b-4a54-ad04-59531e87f867',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 932.044553] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port b0e30f4f-e181-4a01-93a2-2a3ba52801c3 with status ACTIVE [ 932.044698] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 932.044831] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 932.044938] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 932.045245] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 932.045401] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 932.046483] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 932.046483] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 932.046483] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 932.046483] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 932.046483] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 932.046483] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 932.046483] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 932.047329] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 932.047329] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 932.047329] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 932.047329] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: b0e30f4f-e181-4a01-93a2-2a3ba52801c3 is going to be updated. [ 932.068884] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 932.069021] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 932.069102] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 932.069271] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 932.069407] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 932.069564] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b0e30f4f-e181-4a01-93a2-2a3ba52801c3" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 932.357196] env[65370]: INFO networking_nsxv3.common.synchronization [req-eccbed0c-bb53-4db4-957f-e56f288377b4 req-d4ff26a8-0093-4094-918f-9b9ce730f9be tempest-ServersTestMultiNic-1884782823 tempest-ServersTestMultiNic-1884782823-project-member] Enqueued Resource ID: 7960de7e-23b5-46db-b2ee-c5bd971f27a6 with Priority: HIGHEST for action security_group_members [ 932.359130] env[65370]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7960de7e-23b5-46db-b2ee-c5bd971f27a6 with Priority: HIGHEST for action security_group_members [ 932.359458] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock member-7960de7e-23b5-46db-b2ee-c5bd971f27a6 taken with stack trace [, , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 932.359711] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7960de7e-23b5-46db-b2ee-c5bd971f27a6" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 932.359789] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7960de7e-23b5-46db-b2ee-c5bd971f27a6" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 932.359995] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7960de7e-23b5-46db-b2ee-c5bd971f27a6" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 932.360165] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 932.360265] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 932.360331] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 932.360504] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 932.360614] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 932.360762] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7960de7e-23b5-46db-b2ee-c5bd971f27a6',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 932.448034] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 932.448359] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 932.448359] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 932.448580] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 932.448580] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 932.448712] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: de5a6b9b-a5a9-4ccc-b897-0244548cc5fd is going to be updated. [ 932.483585] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 932.483585] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 932.483585] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 932.483585] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 932.483585] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 932.495273] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: de5a6b9b-a5a9-4ccc-b897-0244548cc5fd in Status: IN_PROGRESS for 2s [ 932.550047] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('002e5341-7a4b-4a54-ad04-59531e87f867',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 932.561281] env[65370]: INFO networking_nsxv3.common.synchronization [req-eccbed0c-bb53-4db4-957f-e56f288377b4 req-3a78fb4b-ffa4-4c26-ac07-06045d53aa6f tempest-ServersTestMultiNic-1884782823 tempest-ServersTestMultiNic-1884782823-project-member] Enqueued Resource ID: 7960de7e-23b5-46db-b2ee-c5bd971f27a6 with Priority: HIGHEST for action security_group_members [ 932.562047] env[65370]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7960de7e-23b5-46db-b2ee-c5bd971f27a6 with Priority: HIGHEST for action security_group_members [ 932.562370] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock member-7960de7e-23b5-46db-b2ee-c5bd971f27a6 taken with stack trace [, , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 932.562469] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7960de7e-23b5-46db-b2ee-c5bd971f27a6" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 932.599802] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7960de7e-23b5-46db-b2ee-c5bd971f27a6 in Status: SUCCESS [ 932.599980] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-7960de7e-23b5-46db-b2ee-c5bd971f27a6" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 932.600165] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-7960de7e-23b5-46db-b2ee-c5bd971f27a6" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 932.600388] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-7960de7e-23b5-46db-b2ee-c5bd971f27a6" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 932.600478] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('7960de7e-23b5-46db-b2ee-c5bd971f27a6',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 932.614897] env[65370]: INFO networking_nsxv3.common.synchronization [req-066234d5-7388-44a0-b886-b1d6f7a67296 req-a9d4b158-f061-4d4e-8d03-309bd4fd8ebc tempest-AttachInterfacesTestJSON-315686657 tempest-AttachInterfacesTestJSON-315686657-project-member] Enqueued Resource ID: 47d8b360-5d90-42ea-b9c3-ed76fddd03a3 with Priority: HIGHEST for action security_group_members [ 932.615548] env[65370]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 47d8b360-5d90-42ea-b9c3-ed76fddd03a3 with Priority: HIGHEST for action security_group_members [ 932.615852] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock member-47d8b360-5d90-42ea-b9c3-ed76fddd03a3 taken with stack trace [, , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 932.615975] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-47d8b360-5d90-42ea-b9c3-ed76fddd03a3" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 932.616053] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-47d8b360-5d90-42ea-b9c3-ed76fddd03a3" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 932.616383] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-47d8b360-5d90-42ea-b9c3-ed76fddd03a3" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 932.616579] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 932.616689] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 932.616752] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 932.616907] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 932.616987] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 932.617089] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('47d8b360-5d90-42ea-b9c3-ed76fddd03a3',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 932.863197] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('7960de7e-23b5-46db-b2ee-c5bd971f27a6',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 932.952309] env[65370]: DEBUG networking_nsxv3.common.locking [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Lock network-309 taken with stack trace [, , , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 932.952566] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquiring lock "network-309" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 932.952744] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquired lock "network-309" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 932.953093] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquired external semaphore "network-309" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 932.953386] env[65370]: DEBUG networking_nsxv3.common.locking [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 932.953580] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquiring lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 932.953664] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquired lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 932.953894] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquired external semaphore "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 932.954090] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Releasing lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 932.954288] env[65370]: DEBUG dogpile.cache.region [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] No value present for key: 'zone-id' {{(pid=65370) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 932.954421] env[65370]: DEBUG dogpile.lock [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] NeedRegenerationException {{(pid=65370) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 932.954544] env[65370]: DEBUG dogpile.lock [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] no value, waiting for create lock {{(pid=65370) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 932.954669] env[65370]: DEBUG dogpile.lock [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] value creation lock acquired {{(pid=65370) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 932.954789] env[65370]: DEBUG dogpile.cache.region [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] No value present for key: 'zone-id' {{(pid=65370) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 932.954892] env[65370]: DEBUG dogpile.lock [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Calling creation function for not-yet-present value {{(pid=65370) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 932.955059] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 932.977635] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 932.977824] env[65370]: DEBUG dogpile.cache.region [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=65370) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 932.977980] env[65370]: DEBUG dogpile.lock [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Released creation lock {{(pid=65370) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 932.978221] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Releasing lock "network-309" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 932.978565] env[65370]: DEBUG networking_nsxv3.common.locking [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Lock port-7eb31245-ff27-481b-bc20-9b3a846240cf taken with stack trace [, , , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 932.978799] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquiring lock "port-7eb31245-ff27-481b-bc20-9b3a846240cf" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 932.978916] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquired lock "port-7eb31245-ff27-481b-bc20-9b3a846240cf" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 932.979337] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquired external semaphore "port-7eb31245-ff27-481b-bc20-9b3a846240cf" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 932.979489] env[65370]: DEBUG networking_nsxv3.api.rpc [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7eb31245-ff27-481b-bc20-9b3a846240cf',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 933.010540] env[65370]: INFO networking_nsxv3.common.synchronization [req-f730080e-f027-4f0a-b354-b5421569c5f5 req-263b9560-6ec2-42b3-90cb-d0c26c292a49 tempest-ServerActionsTestOtherB-1099767447 tempest-ServerActionsTestOtherB-1099767447-project-member] Enqueued Resource ID: 2011abd7-ba10-4aae-84fb-1b1bfbd238fa with Priority: HIGHEST for action security_group_members [ 933.013592] env[65370]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2011abd7-ba10-4aae-84fb-1b1bfbd238fa with Priority: HIGHEST for action security_group_members [ 933.015247] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock member-2011abd7-ba10-4aae-84fb-1b1bfbd238fa taken with stack trace [, , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 933.015491] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2011abd7-ba10-4aae-84fb-1b1bfbd238fa" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 933.016113] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2011abd7-ba10-4aae-84fb-1b1bfbd238fa" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 933.016693] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2011abd7-ba10-4aae-84fb-1b1bfbd238fa" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 933.017100] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 933.017308] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 933.017635] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 933.018041] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 933.018215] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 933.018598] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2011abd7-ba10-4aae-84fb-1b1bfbd238fa',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 933.053497] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 933.053756] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 933.053884] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 933.054197] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 933.054323] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 933.054592] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 002e5341-7a4b-4a54-ad04-59531e87f867 is going to be created. [ 933.090394] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 933.090617] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 933.090697] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 933.090946] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 933.091169] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 933.103446] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 002e5341-7a4b-4a54-ad04-59531e87f867 in Status: UNINITIALIZED for 2s [ 933.119611] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 933.119791] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 933.119859] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 933.120048] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 933.120141] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 933.120333] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 933.120427] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 933.120487] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 933.120652] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 933.120761] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 933.122031] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 47d8b360-5d90-42ea-b9c3-ed76fddd03a3 already deleted. [ 933.122031] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-47d8b360-5d90-42ea-b9c3-ed76fddd03a3" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 933.124173] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 933.124286] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 933.124347] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 933.124588] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 933.124673] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 933.124761] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 7960de7e-23b5-46db-b2ee-c5bd971f27a6 is going to be deleted. [ 933.194233] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1bc5c407-ee61-45f3-a29e-c586a26bcaff in Status: SUCCESS [ 933.194827] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1bc5c407-ee61-45f3-a29e-c586a26bcaff" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 933.195386] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1bc5c407-ee61-45f3-a29e-c586a26bcaff" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 933.195729] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1bc5c407-ee61-45f3-a29e-c586a26bcaff" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 933.195960] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 933.197291] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 933.197291] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 933.197291] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 933.197291] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 933.197291] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1bc5c407-ee61-45f3-a29e-c586a26bcaff" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 933.197291] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock member-1bc5c407-ee61-45f3-a29e-c586a26bcaff taken with stack trace [, , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 933.197291] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1bc5c407-ee61-45f3-a29e-c586a26bcaff" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 933.197291] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1bc5c407-ee61-45f3-a29e-c586a26bcaff" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 933.197746] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1bc5c407-ee61-45f3-a29e-c586a26bcaff" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 933.197746] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 933.197746] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 933.197746] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 933.197871] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 933.197901] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 933.197983] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1bc5c407-ee61-45f3-a29e-c586a26bcaff" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 933.198112] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('1bc5c407-ee61-45f3-a29e-c586a26bcaff',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 933.225092] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 933.225092] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 933.225092] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 933.225243] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 933.225289] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 933.225407] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-7960de7e-23b5-46db-b2ee-c5bd971f27a6" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 933.365807] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('7960de7e-23b5-46db-b2ee-c5bd971f27a6',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 933.485266] env[65370]: DEBUG networking_nsxv3.common.locking [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 933.485266] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquiring lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 933.485266] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquired lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 933.485266] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquired external semaphore "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 933.485266] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Releasing lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 933.485266] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Segment Port 7eb31245-ff27-481b-bc20-9b3a846240cf not found, creating... [ 933.485266] env[65370]: DEBUG networking_nsxv3.common.locking [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 933.485266] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquiring lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 933.485266] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquired lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 933.485266] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquired external semaphore "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 933.485266] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Releasing lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 933.485933] env[65370]: DEBUG networking_nsxv3.common.locking [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 933.485933] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquiring lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 933.485933] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquired lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 933.485933] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquired external semaphore "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 933.485933] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Releasing lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 933.485933] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Resource: SegmentPort with ID: 7eb31245-ff27-481b-bc20-9b3a846240cf is going to be created. [ 933.513807] env[65370]: DEBUG networking_nsxv3.common.locking [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 933.513807] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquiring lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 933.513969] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquired lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 933.514929] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquired external semaphore "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 933.515245] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Releasing lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 933.515712] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Releasing lock "port-7eb31245-ff27-481b-bc20-9b3a846240cf" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 933.522315] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 933.522464] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 933.522537] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 933.522754] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 933.549475] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 933.550125] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 933.550318] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 933.550401] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 933.550650] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 933.550764] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 933.550876] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2011abd7-ba10-4aae-84fb-1b1bfbd238fa is going to be updated. [ 933.612095] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 933.612263] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 933.612329] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 933.612543] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 933.612681] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 933.632598] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2011abd7-ba10-4aae-84fb-1b1bfbd238fa in Status: IN_PROGRESS for 2s [ 933.703338] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 1bc5c407-ee61-45f3-a29e-c586a26bcaff: rpc.has_security_group_logging(os_id): False [ 933.725780] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 933.725780] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 933.725780] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 933.725780] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 933.725780] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 933.725780] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 933.725780] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 933.725780] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 933.726307] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 933.726307] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 933.726307] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 933.726307] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 933.726307] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 933.726915] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 933.726915] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 933.726915] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 933.726915] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 933.726915] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 933.727100] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 933.727129] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 933.727237] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 1bc5c407-ee61-45f3-a29e-c586a26bcaff is going to be created. [ 933.856730] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 933.856730] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 933.856730] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 933.856730] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 933.856730] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 933.870070] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 933.870070] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 933.870070] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 933.870070] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 933.870443] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 933.870877] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7960de7e-23b5-46db-b2ee-c5bd971f27a6 is going to be updated. [ 933.876657] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 1bc5c407-ee61-45f3-a29e-c586a26bcaff in Status: IN_PROGRESS for 2s [ 933.915742] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 933.915919] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 933.915965] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 933.916200] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 933.916347] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 933.931450] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7960de7e-23b5-46db-b2ee-c5bd971f27a6 in Status: IN_PROGRESS for 2s [ 934.507946] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: de5a6b9b-a5a9-4ccc-b897-0244548cc5fd in Status: SUCCESS [ 934.508232] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-de5a6b9b-a5a9-4ccc-b897-0244548cc5fd" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 934.508362] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-de5a6b9b-a5a9-4ccc-b897-0244548cc5fd" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 934.508639] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-de5a6b9b-a5a9-4ccc-b897-0244548cc5fd" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 934.508828] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 934.508954] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 934.509030] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 934.509186] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 934.509265] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 934.509352] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-de5a6b9b-a5a9-4ccc-b897-0244548cc5fd" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 934.509441] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('de5a6b9b-a5a9-4ccc-b897-0244548cc5fd',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 934.597658] env[65370]: INFO networking_nsxv3.common.synchronization [req-066234d5-7388-44a0-b886-b1d6f7a67296 req-85accb5c-2cf9-4c66-869a-d9548971eea0 service nova] Enqueued Resource ID: 47d8b360-5d90-42ea-b9c3-ed76fddd03a3 with Priority: HIGHEST for action security_group_rules [ 934.597959] env[65370]: INFO networking_nsxv3.common.synchronization [req-066234d5-7388-44a0-b886-b1d6f7a67296 req-85accb5c-2cf9-4c66-869a-d9548971eea0 service nova] Enqueued Resource ID: 47d8b360-5d90-42ea-b9c3-ed76fddd03a3 with Priority: HIGHEST for action security_group_members [ 934.598204] env[65370]: INFO networking_nsxv3.common.synchronization [req-066234d5-7388-44a0-b886-b1d6f7a67296 req-85accb5c-2cf9-4c66-869a-d9548971eea0 service nova] Enqueued Resource ID: 7eb31245-ff27-481b-bc20-9b3a846240cf with Priority: HIGHEST for action port [ 934.598908] env[65370]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 47d8b360-5d90-42ea-b9c3-ed76fddd03a3 with Priority: HIGHEST for action security_group_rules [ 934.599118] env[65370]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 47d8b360-5d90-42ea-b9c3-ed76fddd03a3 with Priority: HIGHEST for action security_group_members [ 934.599476] env[65370]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7eb31245-ff27-481b-bc20-9b3a846240cf with Priority: HIGHEST for action port [ 934.599701] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock rules-47d8b360-5d90-42ea-b9c3-ed76fddd03a3 taken with stack trace [, , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 934.599881] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-47d8b360-5d90-42ea-b9c3-ed76fddd03a3" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 934.599992] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-47d8b360-5d90-42ea-b9c3-ed76fddd03a3" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 934.600302] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-47d8b360-5d90-42ea-b9c3-ed76fddd03a3" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 934.600422] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('47d8b360-5d90-42ea-b9c3-ed76fddd03a3',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 934.604401] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock member-47d8b360-5d90-42ea-b9c3-ed76fddd03a3 taken with stack trace [, , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 934.604401] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-47d8b360-5d90-42ea-b9c3-ed76fddd03a3" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 934.604401] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-47d8b360-5d90-42ea-b9c3-ed76fddd03a3" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 934.604401] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-47d8b360-5d90-42ea-b9c3-ed76fddd03a3" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 934.604401] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 934.604401] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 934.604401] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 934.604401] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 934.604401] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 934.604401] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('47d8b360-5d90-42ea-b9c3-ed76fddd03a3',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 934.604401] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock port-7eb31245-ff27-481b-bc20-9b3a846240cf taken with stack trace [, , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 934.604967] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-7eb31245-ff27-481b-bc20-9b3a846240cf" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 934.604967] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-7eb31245-ff27-481b-bc20-9b3a846240cf" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 934.604967] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-7eb31245-ff27-481b-bc20-9b3a846240cf" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 934.604967] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7eb31245-ff27-481b-bc20-9b3a846240cf',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 935.011963] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock member-de5a6b9b-a5a9-4ccc-b897-0244548cc5fd taken with stack trace [, , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 935.012269] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-de5a6b9b-a5a9-4ccc-b897-0244548cc5fd" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 935.012400] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-de5a6b9b-a5a9-4ccc-b897-0244548cc5fd" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 935.012676] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-de5a6b9b-a5a9-4ccc-b897-0244548cc5fd" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 935.012910] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 935.013079] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 935.013181] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 935.013410] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 935.013548] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 935.013682] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-de5a6b9b-a5a9-4ccc-b897-0244548cc5fd" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 935.013879] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock member-de5a6b9b-a5a9-4ccc-b897-0244548cc5fd taken with stack trace [, , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 935.014280] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-de5a6b9b-a5a9-4ccc-b897-0244548cc5fd" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 935.014280] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-de5a6b9b-a5a9-4ccc-b897-0244548cc5fd" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 935.014374] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-de5a6b9b-a5a9-4ccc-b897-0244548cc5fd" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 935.015288] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 935.015288] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 935.015288] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 935.015288] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 935.015288] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 935.015288] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-de5a6b9b-a5a9-4ccc-b897-0244548cc5fd" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 935.015288] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('de5a6b9b-a5a9-4ccc-b897-0244548cc5fd',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 935.106809] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock member-47d8b360-5d90-42ea-b9c3-ed76fddd03a3 taken with stack trace [, , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 935.107055] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-47d8b360-5d90-42ea-b9c3-ed76fddd03a3" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 935.107207] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('47d8b360-5d90-42ea-b9c3-ed76fddd03a3',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 935.108755] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 7eb31245-ff27-481b-bc20-9b3a846240cf with status ACTIVE [ 935.108755] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 935.108755] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 935.109797] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 935.109797] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 935.109797] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 935.111847] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 935.111982] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 935.111982] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 935.114865] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 935.114865] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 935.114865] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 935.114865] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 935.114865] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 935.114865] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 935.114865] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 935.114865] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 7eb31245-ff27-481b-bc20-9b3a846240cf is going to be updated. [ 935.129369] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 002e5341-7a4b-4a54-ad04-59531e87f867 in Status: SUCCESS [ 935.129596] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-002e5341-7a4b-4a54-ad04-59531e87f867" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 935.130535] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-002e5341-7a4b-4a54-ad04-59531e87f867" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 935.130734] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-002e5341-7a4b-4a54-ad04-59531e87f867" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 935.131000] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 935.131201] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 935.131252] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 935.131420] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 935.131519] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 935.131746] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-002e5341-7a4b-4a54-ad04-59531e87f867" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 935.131746] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('002e5341-7a4b-4a54-ad04-59531e87f867',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 935.137951] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 935.139907] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 935.139907] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 935.139907] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 935.139907] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 935.139907] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-7eb31245-ff27-481b-bc20-9b3a846240cf" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 935.517886] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for de5a6b9b-a5a9-4ccc-b897-0244548cc5fd: rpc.has_security_group_logging(os_id): False [ 935.539210] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 935.539454] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 935.539604] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 935.539886] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 935.539984] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 935.540734] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 935.540734] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 935.540734] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 935.540734] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 935.540734] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 935.541228] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 935.541228] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 935.541228] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 935.541228] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 935.541228] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 935.541409] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 935.541409] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 935.541481] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 935.541590] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 935.541665] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 935.541747] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: de5a6b9b-a5a9-4ccc-b897-0244548cc5fd is going to be updated. [ 935.617348] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('47d8b360-5d90-42ea-b9c3-ed76fddd03a3',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 935.630985] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 935.631275] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 935.631440] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 935.631635] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 935.631884] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 935.635027] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('002e5341-7a4b-4a54-ad04-59531e87f867',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 935.652134] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2011abd7-ba10-4aae-84fb-1b1bfbd238fa in Status: SUCCESS [ 935.652505] env[65370]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2011abd7-ba10-4aae-84fb-1b1bfbd238fa deletion is rescheduled due to dependency. [ 935.652705] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2011abd7-ba10-4aae-84fb-1b1bfbd238fa" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 935.683708] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: de5a6b9b-a5a9-4ccc-b897-0244548cc5fd in Status: IN_PROGRESS for 2s [ 935.892147] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 1bc5c407-ee61-45f3-a29e-c586a26bcaff in Status: SUCCESS [ 935.892474] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-1bc5c407-ee61-45f3-a29e-c586a26bcaff" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 935.892706] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-1bc5c407-ee61-45f3-a29e-c586a26bcaff" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 935.892960] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-1bc5c407-ee61-45f3-a29e-c586a26bcaff" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 935.893087] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('1bc5c407-ee61-45f3-a29e-c586a26bcaff',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 935.944251] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7960de7e-23b5-46db-b2ee-c5bd971f27a6 in Status: SUCCESS [ 935.944467] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7960de7e-23b5-46db-b2ee-c5bd971f27a6" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 935.944646] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7960de7e-23b5-46db-b2ee-c5bd971f27a6" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 935.944903] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7960de7e-23b5-46db-b2ee-c5bd971f27a6" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 935.945069] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 935.945191] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 935.945257] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 935.945403] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 935.945482] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 935.945591] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7960de7e-23b5-46db-b2ee-c5bd971f27a6',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 936.121038] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 936.121250] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 936.121986] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 936.121986] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 936.121986] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 936.121986] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 47d8b360-5d90-42ea-b9c3-ed76fddd03a3 is going to be created. [ 936.138199] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 002e5341-7a4b-4a54-ad04-59531e87f867: rpc.has_security_group_logging(os_id): False [ 936.173957] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 936.174051] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 936.174085] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 936.174370] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 936.174463] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 936.174859] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 936.175068] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 936.175068] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 936.175302] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 936.175378] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 936.175465] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 002e5341-7a4b-4a54-ad04-59531e87f867 is going to be created. [ 936.184439] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 936.184712] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 936.184807] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 936.185106] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 936.185330] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 936.229533] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 47d8b360-5d90-42ea-b9c3-ed76fddd03a3 in Status: UNINITIALIZED for 2s [ 936.314372] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 936.314594] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 936.314693] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 936.314919] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 936.315488] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 936.329157] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 002e5341-7a4b-4a54-ad04-59531e87f867 in Status: IN_PROGRESS for 2s [ 936.395951] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock member-1bc5c407-ee61-45f3-a29e-c586a26bcaff taken with stack trace [, , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 936.396278] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1bc5c407-ee61-45f3-a29e-c586a26bcaff" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 936.396379] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1bc5c407-ee61-45f3-a29e-c586a26bcaff" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 936.396695] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1bc5c407-ee61-45f3-a29e-c586a26bcaff" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 936.396905] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 936.397051] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 936.397129] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 936.397991] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 936.398143] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 936.398288] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1bc5c407-ee61-45f3-a29e-c586a26bcaff" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 936.398727] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('1bc5c407-ee61-45f3-a29e-c586a26bcaff',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 936.448287] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 936.448441] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 936.448487] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 936.448697] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 936.448791] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 936.449012] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 936.449135] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 936.449181] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 936.449337] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 936.449410] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 936.449498] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7960de7e-23b5-46db-b2ee-c5bd971f27a6 is going to be deleted. [ 936.508597] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 936.508808] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 936.508854] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 936.509134] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 936.509257] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 936.509392] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7960de7e-23b5-46db-b2ee-c5bd971f27a6" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 936.902178] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock member-1bc5c407-ee61-45f3-a29e-c586a26bcaff taken with stack trace [, , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 936.902751] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1bc5c407-ee61-45f3-a29e-c586a26bcaff" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 936.902751] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1bc5c407-ee61-45f3-a29e-c586a26bcaff" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 936.903174] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1bc5c407-ee61-45f3-a29e-c586a26bcaff" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 936.903174] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 936.903174] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 936.903174] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 936.903383] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 936.903474] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 936.903549] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1bc5c407-ee61-45f3-a29e-c586a26bcaff" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 936.903701] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock member-1bc5c407-ee61-45f3-a29e-c586a26bcaff taken with stack trace [, , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 936.903799] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1bc5c407-ee61-45f3-a29e-c586a26bcaff" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 936.903850] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1bc5c407-ee61-45f3-a29e-c586a26bcaff" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 936.904053] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1bc5c407-ee61-45f3-a29e-c586a26bcaff" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 936.904159] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 936.904238] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 936.904344] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 936.904574] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 936.904765] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 936.904765] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1bc5c407-ee61-45f3-a29e-c586a26bcaff" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 936.904765] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('1bc5c407-ee61-45f3-a29e-c586a26bcaff',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 937.014745] env[65370]: INFO networking_nsxv3.common.synchronization [req-d8e2bae2-e4fd-4f78-a13d-21a49f941a74 req-11abc54f-759c-4ab6-a837-f896798106af tempest-MultipleCreateTestJSON-1838347642 tempest-MultipleCreateTestJSON-1838347642-project-member] Enqueued Resource ID: 1bc5c407-ee61-45f3-a29e-c586a26bcaff with Priority: HIGHEST for action security_group_members [ 937.015444] env[65370]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1bc5c407-ee61-45f3-a29e-c586a26bcaff with Priority: HIGHEST for action security_group_members [ 937.015784] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock member-1bc5c407-ee61-45f3-a29e-c586a26bcaff taken with stack trace [, , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 937.015912] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1bc5c407-ee61-45f3-a29e-c586a26bcaff" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 937.015979] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1bc5c407-ee61-45f3-a29e-c586a26bcaff" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 937.017387] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1bc5c407-ee61-45f3-a29e-c586a26bcaff" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 937.017530] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 937.017701] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 937.017794] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 937.018021] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 937.018165] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 937.018304] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1bc5c407-ee61-45f3-a29e-c586a26bcaff',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 937.409450] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 1bc5c407-ee61-45f3-a29e-c586a26bcaff: rpc.has_security_group_logging(os_id): False [ 937.428873] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 937.429982] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 937.430246] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 937.430569] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 937.432026] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 937.432026] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 937.432026] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 937.432026] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 937.432026] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 937.432026] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 937.432026] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 937.432026] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 937.432026] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 937.432026] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 937.432026] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 937.433534] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 937.433534] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 937.433534] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 937.433534] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 937.433534] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 937.433534] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 1bc5c407-ee61-45f3-a29e-c586a26bcaff is going to be updated. [ 937.504106] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 937.504531] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 937.504531] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 937.504934] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 937.505468] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 937.521449] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('1bc5c407-ee61-45f3-a29e-c586a26bcaff',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 937.523134] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 1bc5c407-ee61-45f3-a29e-c586a26bcaff in Status: IN_PROGRESS for 2s [ 937.678053] env[65370]: INFO networking_nsxv3.common.synchronization [req-52349a85-9079-406d-8b71-4e4a0dc5a38b req-9961fe23-5f43-43a4-bc96-b537404da320 tempest-MultipleCreateTestJSON-1838347642 tempest-MultipleCreateTestJSON-1838347642-project-member] Enqueued Resource ID: 1bc5c407-ee61-45f3-a29e-c586a26bcaff with Priority: HIGHEST for action security_group_members [ 937.679102] env[65370]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1bc5c407-ee61-45f3-a29e-c586a26bcaff with Priority: HIGHEST for action security_group_members [ 937.679749] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock member-1bc5c407-ee61-45f3-a29e-c586a26bcaff taken with stack trace [, , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 937.680098] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1bc5c407-ee61-45f3-a29e-c586a26bcaff" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 937.701328] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: de5a6b9b-a5a9-4ccc-b897-0244548cc5fd in Status: SUCCESS [ 937.701328] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-de5a6b9b-a5a9-4ccc-b897-0244548cc5fd" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 938.023966] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('1bc5c407-ee61-45f3-a29e-c586a26bcaff',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 938.241611] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 47d8b360-5d90-42ea-b9c3-ed76fddd03a3 in Status: SUCCESS [ 938.242260] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-47d8b360-5d90-42ea-b9c3-ed76fddd03a3" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 938.242561] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-47d8b360-5d90-42ea-b9c3-ed76fddd03a3" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 938.242875] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-47d8b360-5d90-42ea-b9c3-ed76fddd03a3" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 938.243124] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 938.245040] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 938.245040] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 938.245040] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 938.245040] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 938.245040] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-47d8b360-5d90-42ea-b9c3-ed76fddd03a3" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 938.245040] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('47d8b360-5d90-42ea-b9c3-ed76fddd03a3',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 938.356128] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 002e5341-7a4b-4a54-ad04-59531e87f867 in Status: SUCCESS [ 938.356279] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-002e5341-7a4b-4a54-ad04-59531e87f867" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 938.527155] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 938.527155] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 938.527155] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 938.527350] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 938.527425] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 938.527653] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1bc5c407-ee61-45f3-a29e-c586a26bcaff is going to be updated. [ 938.562203] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 938.562362] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 938.562439] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 938.562754] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 938.562942] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 938.574357] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1bc5c407-ee61-45f3-a29e-c586a26bcaff in Status: IN_PROGRESS for 2s [ 938.748788] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('47d8b360-5d90-42ea-b9c3-ed76fddd03a3',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 939.255117] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 47d8b360-5d90-42ea-b9c3-ed76fddd03a3: rpc.has_security_group_logging(os_id): False [ 939.277713] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 939.277944] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 939.278065] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 939.278381] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 939.278519] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 939.278863] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 939.278982] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 939.279093] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 939.279338] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 939.279451] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 939.279949] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 47d8b360-5d90-42ea-b9c3-ed76fddd03a3 is going to be created. [ 939.367271] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 939.367554] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 939.367622] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 939.367862] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 939.368092] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 939.383814] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 47d8b360-5d90-42ea-b9c3-ed76fddd03a3 in Status: IN_PROGRESS for 2s [ 939.537466] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 1bc5c407-ee61-45f3-a29e-c586a26bcaff in Status: SUCCESS [ 939.537466] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-1bc5c407-ee61-45f3-a29e-c586a26bcaff" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 940.583932] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1bc5c407-ee61-45f3-a29e-c586a26bcaff in Status: SUCCESS [ 940.584209] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1bc5c407-ee61-45f3-a29e-c586a26bcaff" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 940.584335] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1bc5c407-ee61-45f3-a29e-c586a26bcaff" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 940.584775] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1bc5c407-ee61-45f3-a29e-c586a26bcaff" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 940.584981] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 940.585123] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 940.585190] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 940.585369] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 940.585452] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 940.585548] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1bc5c407-ee61-45f3-a29e-c586a26bcaff',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 941.088551] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 941.089020] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 941.091457] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 941.091457] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 941.091457] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 941.091457] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 941.091457] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 941.091457] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 941.091457] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 941.091457] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 941.091457] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1bc5c407-ee61-45f3-a29e-c586a26bcaff is going to be updated. [ 941.137338] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 941.137338] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 941.137338] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 941.137338] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 941.137338] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 941.150332] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1bc5c407-ee61-45f3-a29e-c586a26bcaff in Status: IN_PROGRESS for 2s [ 941.396480] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 47d8b360-5d90-42ea-b9c3-ed76fddd03a3 in Status: SUCCESS [ 941.396480] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-47d8b360-5d90-42ea-b9c3-ed76fddd03a3" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 941.419429] env[65370]: INFO networking_nsxv3.common.synchronization [None req-1aba83a8-c142-4340-901f-d74392c72936 None None] Enqueued Resource ID: 11827df5-ab51-49b5-a376-6a31387e8973 with Priority: HIGHEST for action port [ 941.420448] env[65370]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 11827df5-ab51-49b5-a376-6a31387e8973 with Priority: HIGHEST for action port [ 941.420914] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock port-11827df5-ab51-49b5-a376-6a31387e8973 taken with stack trace [, , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 941.421178] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-11827df5-ab51-49b5-a376-6a31387e8973" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 941.421335] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-11827df5-ab51-49b5-a376-6a31387e8973" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 941.421652] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-11827df5-ab51-49b5-a376-6a31387e8973" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 941.421825] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('11827df5-ab51-49b5-a376-6a31387e8973',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 941.923493] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 11827df5-ab51-49b5-a376-6a31387e8973 [ 941.923915] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 941.924087] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 941.924158] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 941.924369] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 941.924454] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 941.924561] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:11827df5-ab51-49b5-a376-6a31387e8973 already deleted. [ 941.924643] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-11827df5-ab51-49b5-a376-6a31387e8973" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 942.383642] env[65370]: INFO networking_nsxv3.common.synchronization [req-6902bfd0-a7aa-4be0-840e-b651b31d28b5 req-b83fa191-3646-4c6b-ac78-e493a4d5e31f tempest-AttachVolumeNegativeTest-719365731 tempest-AttachVolumeNegativeTest-719365731-project-member] Enqueued Resource ID: 8ea97aa8-b2b5-4fb2-ad6c-cbae92dacf23 with Priority: HIGHEST for action security_group_members [ 942.384229] env[65370]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8ea97aa8-b2b5-4fb2-ad6c-cbae92dacf23 with Priority: HIGHEST for action security_group_members [ 942.384941] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock member-8ea97aa8-b2b5-4fb2-ad6c-cbae92dacf23 taken with stack trace [, , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 942.384941] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8ea97aa8-b2b5-4fb2-ad6c-cbae92dacf23" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 942.384941] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8ea97aa8-b2b5-4fb2-ad6c-cbae92dacf23" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 942.385906] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8ea97aa8-b2b5-4fb2-ad6c-cbae92dacf23" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 942.387469] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 942.387695] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 942.387813] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 942.388983] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 942.388983] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 942.388983] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('8ea97aa8-b2b5-4fb2-ad6c-cbae92dacf23',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 942.813656] env[65370]: DEBUG networking_nsxv3.common.locking [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Lock network-600 taken with stack trace [, , , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 942.813864] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquiring lock "network-600" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 942.814210] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquired lock "network-600" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 942.814273] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquired external semaphore "network-600" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 942.814872] env[65370]: DEBUG networking_nsxv3.common.locking [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 942.815187] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquiring lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 942.815459] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquired lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 942.815680] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquired external semaphore "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 942.815878] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Releasing lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 942.816151] env[65370]: DEBUG dogpile.cache.region [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] No value present for key: 'zone-id' {{(pid=65370) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 942.816315] env[65370]: DEBUG dogpile.lock [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] NeedRegenerationException {{(pid=65370) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 942.816645] env[65370]: DEBUG dogpile.lock [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] no value, waiting for create lock {{(pid=65370) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 942.816645] env[65370]: DEBUG dogpile.lock [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] value creation lock acquired {{(pid=65370) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 942.816898] env[65370]: DEBUG dogpile.cache.region [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] No value present for key: 'zone-id' {{(pid=65370) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 942.817081] env[65370]: DEBUG dogpile.lock [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Calling creation function for not-yet-present value {{(pid=65370) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 942.817309] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 942.838970] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 942.838970] env[65370]: DEBUG dogpile.cache.region [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=65370) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 942.838970] env[65370]: DEBUG dogpile.lock [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Released creation lock {{(pid=65370) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 942.838970] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Releasing lock "network-600" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 942.838970] env[65370]: DEBUG networking_nsxv3.common.locking [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Lock port-9b7ddad2-eca0-405a-ae3c-d465bd24d243 taken with stack trace [, , , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 942.838970] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquiring lock "port-9b7ddad2-eca0-405a-ae3c-d465bd24d243" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 942.838970] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquired lock "port-9b7ddad2-eca0-405a-ae3c-d465bd24d243" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 942.838970] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquired external semaphore "port-9b7ddad2-eca0-405a-ae3c-d465bd24d243" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 942.838970] env[65370]: DEBUG networking_nsxv3.api.rpc [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9b7ddad2-eca0-405a-ae3c-d465bd24d243',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 942.892695] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 942.892695] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 942.892695] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 942.892695] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 942.892695] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 942.892695] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 942.893721] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 942.893863] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 942.894086] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 942.894086] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 942.894208] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8ea97aa8-b2b5-4fb2-ad6c-cbae92dacf23 already deleted. [ 942.894245] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8ea97aa8-b2b5-4fb2-ad6c-cbae92dacf23" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 943.159942] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1bc5c407-ee61-45f3-a29e-c586a26bcaff in Status: SUCCESS [ 943.161582] env[65370]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1bc5c407-ee61-45f3-a29e-c586a26bcaff deletion is rescheduled due to dependency. [ 943.161582] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1bc5c407-ee61-45f3-a29e-c586a26bcaff" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 943.344150] env[65370]: DEBUG networking_nsxv3.common.locking [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 943.344150] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquiring lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 943.344150] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquired lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 943.344150] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquired external semaphore "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 943.344150] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Releasing lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 943.344150] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Segment Port 9b7ddad2-eca0-405a-ae3c-d465bd24d243 not found, creating... [ 943.344150] env[65370]: DEBUG networking_nsxv3.common.locking [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 943.344150] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquiring lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 943.344150] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquired lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 943.344150] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquired external semaphore "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 943.344150] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Releasing lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 943.344657] env[65370]: DEBUG networking_nsxv3.common.locking [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 943.344657] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquiring lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 943.344657] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquired lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 943.345051] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquired external semaphore "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 943.345301] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Releasing lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 943.345535] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Resource: SegmentPort with ID: 9b7ddad2-eca0-405a-ae3c-d465bd24d243 is going to be created. [ 943.370470] env[65370]: DEBUG networking_nsxv3.common.locking [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 943.370470] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquiring lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 943.370470] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquired lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 943.370470] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquired external semaphore "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 943.371392] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Releasing lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 943.373163] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Releasing lock "port-9b7ddad2-eca0-405a-ae3c-d465bd24d243" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 943.710873] env[65370]: INFO networking_nsxv3.common.synchronization [None req-9407d6d3-2c58-4fb1-a77b-e9a23acd089c None None] Enqueued Resource ID: 806978c0-fd28-4b28-a390-5b4df077ce3f with Priority: HIGHEST for action port [ 943.711015] env[65370]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 806978c0-fd28-4b28-a390-5b4df077ce3f with Priority: HIGHEST for action port [ 943.711646] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock port-806978c0-fd28-4b28-a390-5b4df077ce3f taken with stack trace [, , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 943.711646] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-806978c0-fd28-4b28-a390-5b4df077ce3f" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 943.711646] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-806978c0-fd28-4b28-a390-5b4df077ce3f" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 943.711942] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-806978c0-fd28-4b28-a390-5b4df077ce3f" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 943.711942] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('806978c0-fd28-4b28-a390-5b4df077ce3f',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 944.144066] env[65370]: INFO networking_nsxv3.common.synchronization [req-6902bfd0-a7aa-4be0-840e-b651b31d28b5 req-b0eb4378-bc44-4941-9ed4-f3b4f72bcdf0 service nova] Enqueued Resource ID: 8ea97aa8-b2b5-4fb2-ad6c-cbae92dacf23 with Priority: HIGHEST for action security_group_rules [ 944.144323] env[65370]: INFO networking_nsxv3.common.synchronization [req-6902bfd0-a7aa-4be0-840e-b651b31d28b5 req-b0eb4378-bc44-4941-9ed4-f3b4f72bcdf0 service nova] Enqueued Resource ID: 8ea97aa8-b2b5-4fb2-ad6c-cbae92dacf23 with Priority: HIGHEST for action security_group_members [ 944.144611] env[65370]: INFO networking_nsxv3.common.synchronization [req-6902bfd0-a7aa-4be0-840e-b651b31d28b5 req-b0eb4378-bc44-4941-9ed4-f3b4f72bcdf0 service nova] Enqueued Resource ID: 9b7ddad2-eca0-405a-ae3c-d465bd24d243 with Priority: HIGHEST for action port [ 944.145355] env[65370]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8ea97aa8-b2b5-4fb2-ad6c-cbae92dacf23 with Priority: HIGHEST for action security_group_rules [ 944.145632] env[65370]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8ea97aa8-b2b5-4fb2-ad6c-cbae92dacf23 with Priority: HIGHEST for action security_group_members [ 944.145716] env[65370]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9b7ddad2-eca0-405a-ae3c-d465bd24d243 with Priority: HIGHEST for action port [ 944.146133] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock rules-8ea97aa8-b2b5-4fb2-ad6c-cbae92dacf23 taken with stack trace [, , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 944.146292] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-8ea97aa8-b2b5-4fb2-ad6c-cbae92dacf23" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 944.146396] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-8ea97aa8-b2b5-4fb2-ad6c-cbae92dacf23" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 944.146724] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-8ea97aa8-b2b5-4fb2-ad6c-cbae92dacf23" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 944.146849] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('8ea97aa8-b2b5-4fb2-ad6c-cbae92dacf23',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 944.147984] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock member-8ea97aa8-b2b5-4fb2-ad6c-cbae92dacf23 taken with stack trace [, , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 944.148179] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8ea97aa8-b2b5-4fb2-ad6c-cbae92dacf23" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 944.148282] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8ea97aa8-b2b5-4fb2-ad6c-cbae92dacf23" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 944.148531] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8ea97aa8-b2b5-4fb2-ad6c-cbae92dacf23" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 944.148765] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 944.148917] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 944.149029] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 944.149254] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 944.149386] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 944.149670] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('8ea97aa8-b2b5-4fb2-ad6c-cbae92dacf23',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 944.150688] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock port-9b7ddad2-eca0-405a-ae3c-d465bd24d243 taken with stack trace [, , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 944.151153] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-9b7ddad2-eca0-405a-ae3c-d465bd24d243" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 944.151153] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-9b7ddad2-eca0-405a-ae3c-d465bd24d243" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 944.151311] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-9b7ddad2-eca0-405a-ae3c-d465bd24d243" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 944.151570] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9b7ddad2-eca0-405a-ae3c-d465bd24d243',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 944.216204] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 806978c0-fd28-4b28-a390-5b4df077ce3f [ 944.216499] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 944.216565] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 944.216600] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 944.217173] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 944.217173] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 944.217173] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:806978c0-fd28-4b28-a390-5b4df077ce3f already deleted. [ 944.217173] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-806978c0-fd28-4b28-a390-5b4df077ce3f" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 944.654161] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('8ea97aa8-b2b5-4fb2-ad6c-cbae92dacf23',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 944.656559] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock member-8ea97aa8-b2b5-4fb2-ad6c-cbae92dacf23 taken with stack trace [, , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 944.656559] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8ea97aa8-b2b5-4fb2-ad6c-cbae92dacf23" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 944.656559] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 9b7ddad2-eca0-405a-ae3c-d465bd24d243 with status ACTIVE [ 944.656559] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 944.656559] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 944.656559] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 944.656559] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 944.657345] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 944.657345] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 944.657345] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 944.657345] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 944.658079] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 944.658214] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 944.658614] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 944.658768] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 944.658842] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 944.659048] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 944.659174] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 944.659283] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 9b7ddad2-eca0-405a-ae3c-d465bd24d243 is going to be updated. [ 944.682534] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 944.682676] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 944.682748] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 944.682952] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 944.683102] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 944.683470] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-9b7ddad2-eca0-405a-ae3c-d465bd24d243" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 945.161330] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('8ea97aa8-b2b5-4fb2-ad6c-cbae92dacf23',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 945.664719] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 945.665012] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 945.665012] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 945.665085] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 945.665151] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 945.665245] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8ea97aa8-b2b5-4fb2-ad6c-cbae92dacf23 is going to be created. [ 945.712275] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 945.712421] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 945.712497] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 945.712713] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 945.712890] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 945.730067] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8ea97aa8-b2b5-4fb2-ad6c-cbae92dacf23 in Status: UNINITIALIZED for 2s [ 947.745137] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8ea97aa8-b2b5-4fb2-ad6c-cbae92dacf23 in Status: SUCCESS [ 947.745137] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8ea97aa8-b2b5-4fb2-ad6c-cbae92dacf23" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 947.745137] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8ea97aa8-b2b5-4fb2-ad6c-cbae92dacf23" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 947.745137] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8ea97aa8-b2b5-4fb2-ad6c-cbae92dacf23" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 947.745137] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 947.745137] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 947.745137] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 947.745137] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 947.745137] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 947.745137] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8ea97aa8-b2b5-4fb2-ad6c-cbae92dacf23" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 947.745137] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('8ea97aa8-b2b5-4fb2-ad6c-cbae92dacf23',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 947.800771] env[65370]: INFO networking_nsxv3.common.synchronization [req-d6008049-5a26-49e6-bf31-2554352c89f9 req-e892df33-bee6-44b3-8996-2aa8ee690486 tempest-ServersAdminTestJSON-387254877 tempest-ServersAdminTestJSON-387254877-project-member] Enqueued Resource ID: feaf18c3-295c-41df-89f1-309931cdeca1 with Priority: HIGHEST for action security_group_members [ 947.801468] env[65370]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: feaf18c3-295c-41df-89f1-309931cdeca1 with Priority: HIGHEST for action security_group_members [ 947.805028] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock member-feaf18c3-295c-41df-89f1-309931cdeca1 taken with stack trace [, , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 947.805028] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-feaf18c3-295c-41df-89f1-309931cdeca1" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 947.805028] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-feaf18c3-295c-41df-89f1-309931cdeca1" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 947.805028] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-feaf18c3-295c-41df-89f1-309931cdeca1" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 947.805386] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 947.805435] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 947.805515] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 947.805755] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 947.806839] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 947.806839] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('feaf18c3-295c-41df-89f1-309931cdeca1',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 948.049782] env[65370]: INFO networking_nsxv3.common.synchronization [req-d870cca9-0226-4dbf-9f2a-cb9de078dd38 req-5a2a9fe7-449f-40e3-81bd-9dbf2b82cf2c tempest-FloatingIPsAssociationTestJSON-1189544841 tempest-FloatingIPsAssociationTestJSON-1189544841-project-member] Enqueued Resource ID: de5a6b9b-a5a9-4ccc-b897-0244548cc5fd with Priority: HIGHEST for action security_group_members [ 948.050283] env[65370]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: de5a6b9b-a5a9-4ccc-b897-0244548cc5fd with Priority: HIGHEST for action security_group_members [ 948.050710] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock member-de5a6b9b-a5a9-4ccc-b897-0244548cc5fd taken with stack trace [, , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 948.050829] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-de5a6b9b-a5a9-4ccc-b897-0244548cc5fd" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 948.050829] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-de5a6b9b-a5a9-4ccc-b897-0244548cc5fd" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 948.052046] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-de5a6b9b-a5a9-4ccc-b897-0244548cc5fd" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 948.053204] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 948.055115] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 948.055115] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 948.055115] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 948.055115] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 948.055115] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('de5a6b9b-a5a9-4ccc-b897-0244548cc5fd',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 948.248279] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('8ea97aa8-b2b5-4fb2-ad6c-cbae92dacf23',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 948.308953] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 948.309139] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 948.309213] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 948.309435] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 948.333034] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 948.333197] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 948.333329] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 948.333397] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 948.333601] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 948.333694] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 948.333780] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: feaf18c3-295c-41df-89f1-309931cdeca1 is going to be updated. [ 948.362501] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 948.362789] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 948.362789] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 948.363543] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 948.363543] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 948.373081] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: feaf18c3-295c-41df-89f1-309931cdeca1 in Status: IN_PROGRESS for 2s [ 948.557614] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('de5a6b9b-a5a9-4ccc-b897-0244548cc5fd',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 948.750896] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 8ea97aa8-b2b5-4fb2-ad6c-cbae92dacf23: rpc.has_security_group_logging(os_id): False [ 948.775715] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 948.775715] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 948.775825] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 948.775998] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 948.776108] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 948.776385] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 948.776496] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 948.776560] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 948.776776] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 948.776879] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 948.776951] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 8ea97aa8-b2b5-4fb2-ad6c-cbae92dacf23 is going to be created. [ 948.859532] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 948.859754] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 948.859754] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 948.860273] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 948.860273] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 948.890057] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 8ea97aa8-b2b5-4fb2-ad6c-cbae92dacf23 in Status: IN_PROGRESS for 2s [ 949.061435] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('de5a6b9b-a5a9-4ccc-b897-0244548cc5fd',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 949.102116] env[65370]: INFO networking_nsxv3.common.synchronization [req-d8e29a9f-1121-4695-a004-9a3b9d81291d req-2bf48075-5ca1-4288-9c97-b7859342deb5 tempest-ImagesTestJSON-246049254 tempest-ImagesTestJSON-246049254-project-member] Enqueued Resource ID: 67f4a0c1-3a3c-4ed8-9358-3a9645aba154 with Priority: HIGHEST for action security_group_members [ 949.103323] env[65370]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 67f4a0c1-3a3c-4ed8-9358-3a9645aba154 with Priority: HIGHEST for action security_group_members [ 949.103323] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock member-67f4a0c1-3a3c-4ed8-9358-3a9645aba154 taken with stack trace [, , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 949.103323] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-67f4a0c1-3a3c-4ed8-9358-3a9645aba154" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 949.103323] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-67f4a0c1-3a3c-4ed8-9358-3a9645aba154" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 949.103578] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-67f4a0c1-3a3c-4ed8-9358-3a9645aba154" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 949.103902] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 949.103902] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 949.103902] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 949.104854] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 949.104854] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 949.104854] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('67f4a0c1-3a3c-4ed8-9358-3a9645aba154',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 949.511019] env[65370]: DEBUG networking_nsxv3.common.locking [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Lock network-955 taken with stack trace [, , , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 949.511019] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquiring lock "network-955" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 949.511019] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquired lock "network-955" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 949.511019] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquired external semaphore "network-955" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 949.511019] env[65370]: DEBUG networking_nsxv3.common.locking [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 949.511019] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquiring lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 949.511552] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquired lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 949.511987] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquired external semaphore "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 949.512804] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Releasing lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 949.513140] env[65370]: DEBUG dogpile.cache.region [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] No value present for key: 'zone-id' {{(pid=65370) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 949.516097] env[65370]: DEBUG dogpile.lock [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] NeedRegenerationException {{(pid=65370) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 949.516097] env[65370]: DEBUG dogpile.lock [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] no value, waiting for create lock {{(pid=65370) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 949.516097] env[65370]: DEBUG dogpile.lock [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] value creation lock acquired {{(pid=65370) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 949.516248] env[65370]: DEBUG dogpile.cache.region [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] No value present for key: 'zone-id' {{(pid=65370) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 949.516248] env[65370]: DEBUG dogpile.lock [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Calling creation function for not-yet-present value {{(pid=65370) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 949.516374] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 949.534411] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 949.534531] env[65370]: DEBUG dogpile.cache.region [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Cache value generated in 0.018 seconds for key(s): 'zone-id' {{(pid=65370) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 949.534713] env[65370]: DEBUG dogpile.lock [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Released creation lock {{(pid=65370) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 949.534961] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Releasing lock "network-955" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 949.535368] env[65370]: DEBUG networking_nsxv3.common.locking [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Lock port-e971a6e9-a261-4d99-a150-3db60a52cb50 taken with stack trace [, , , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 949.535521] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquiring lock "port-e971a6e9-a261-4d99-a150-3db60a52cb50" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 949.535792] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquired lock "port-e971a6e9-a261-4d99-a150-3db60a52cb50" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 949.535988] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquired external semaphore "port-e971a6e9-a261-4d99-a150-3db60a52cb50" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 949.536153] env[65370]: DEBUG networking_nsxv3.api.rpc [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e971a6e9-a261-4d99-a150-3db60a52cb50',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 949.563006] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 949.563178] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 949.563274] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 949.565476] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 949.565598] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 949.566131] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: de5a6b9b-a5a9-4ccc-b897-0244548cc5fd is going to be updated. [ 949.599065] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 949.599238] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 949.599307] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 949.599518] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 949.599665] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 949.609439] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 949.609597] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 949.609666] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 949.609939] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 949.610016] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 949.610268] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 949.610334] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 949.610371] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 949.610518] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 949.610593] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 949.610674] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 67f4a0c1-3a3c-4ed8-9358-3a9645aba154 is going to be updated. [ 949.612374] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: de5a6b9b-a5a9-4ccc-b897-0244548cc5fd in Status: IN_PROGRESS for 2s [ 949.636211] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 949.636397] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 949.636397] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 949.636614] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 949.636809] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 949.646035] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 67f4a0c1-3a3c-4ed8-9358-3a9645aba154 in Status: IN_PROGRESS for 2s [ 950.038880] env[65370]: DEBUG networking_nsxv3.common.locking [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 950.039232] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquiring lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 950.039384] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquired lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 950.039638] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquired external semaphore "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 950.039789] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Releasing lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 950.039941] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Segment Port e971a6e9-a261-4d99-a150-3db60a52cb50 not found, creating... [ 950.040222] env[65370]: DEBUG networking_nsxv3.common.locking [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 950.040380] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquiring lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 950.040490] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquired lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 950.040804] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquired external semaphore "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 950.040929] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Releasing lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 950.042030] env[65370]: DEBUG networking_nsxv3.common.locking [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 950.042030] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquiring lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 950.042170] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquired lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 950.042261] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquired external semaphore "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 950.042392] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Releasing lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 950.042527] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Resource: SegmentPort with ID: e971a6e9-a261-4d99-a150-3db60a52cb50 is going to be created. [ 950.062150] env[65370]: DEBUG networking_nsxv3.common.locking [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 950.062368] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquiring lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 950.062481] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquired lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 950.062765] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquired external semaphore "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 950.062993] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Releasing lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 950.063232] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Releasing lock "port-e971a6e9-a261-4d99-a150-3db60a52cb50" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 950.384076] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: feaf18c3-295c-41df-89f1-309931cdeca1 in Status: SUCCESS [ 950.384275] env[65370]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: feaf18c3-295c-41df-89f1-309931cdeca1 deletion is rescheduled due to dependency. [ 950.384398] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-feaf18c3-295c-41df-89f1-309931cdeca1" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 950.780192] env[65370]: INFO networking_nsxv3.common.synchronization [req-d8e29a9f-1121-4695-a004-9a3b9d81291d req-ce631538-c65c-4997-a90c-3ebf83838d4a service nova] Enqueued Resource ID: 67f4a0c1-3a3c-4ed8-9358-3a9645aba154 with Priority: HIGHEST for action security_group_rules [ 950.780192] env[65370]: INFO networking_nsxv3.common.synchronization [req-d8e29a9f-1121-4695-a004-9a3b9d81291d req-ce631538-c65c-4997-a90c-3ebf83838d4a service nova] Enqueued Resource ID: 67f4a0c1-3a3c-4ed8-9358-3a9645aba154 with Priority: HIGHEST for action security_group_members [ 950.780192] env[65370]: INFO networking_nsxv3.common.synchronization [req-d8e29a9f-1121-4695-a004-9a3b9d81291d req-ce631538-c65c-4997-a90c-3ebf83838d4a service nova] Enqueued Resource ID: e971a6e9-a261-4d99-a150-3db60a52cb50 with Priority: HIGHEST for action port [ 950.780192] env[65370]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 67f4a0c1-3a3c-4ed8-9358-3a9645aba154 with Priority: HIGHEST for action security_group_rules [ 950.780192] env[65370]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 67f4a0c1-3a3c-4ed8-9358-3a9645aba154 with Priority: HIGHEST for action security_group_members [ 950.780981] env[65370]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e971a6e9-a261-4d99-a150-3db60a52cb50 with Priority: HIGHEST for action port [ 950.781608] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock rules-67f4a0c1-3a3c-4ed8-9358-3a9645aba154 taken with stack trace [, , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 950.781983] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-67f4a0c1-3a3c-4ed8-9358-3a9645aba154" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 950.782169] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-67f4a0c1-3a3c-4ed8-9358-3a9645aba154" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 950.782454] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-67f4a0c1-3a3c-4ed8-9358-3a9645aba154" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 950.782624] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('67f4a0c1-3a3c-4ed8-9358-3a9645aba154',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 950.785023] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock member-67f4a0c1-3a3c-4ed8-9358-3a9645aba154 taken with stack trace [, , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 950.785023] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-67f4a0c1-3a3c-4ed8-9358-3a9645aba154" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 950.785023] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock port-e971a6e9-a261-4d99-a150-3db60a52cb50 taken with stack trace [, , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 950.785023] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-e971a6e9-a261-4d99-a150-3db60a52cb50" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 950.785023] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-e971a6e9-a261-4d99-a150-3db60a52cb50" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 950.785023] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-e971a6e9-a261-4d99-a150-3db60a52cb50" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 950.785587] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e971a6e9-a261-4d99-a150-3db60a52cb50',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 950.904338] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 8ea97aa8-b2b5-4fb2-ad6c-cbae92dacf23 in Status: SUCCESS [ 950.904624] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-8ea97aa8-b2b5-4fb2-ad6c-cbae92dacf23" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 951.285569] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock member-67f4a0c1-3a3c-4ed8-9358-3a9645aba154 taken with stack trace [, , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 951.285569] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-67f4a0c1-3a3c-4ed8-9358-3a9645aba154" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 951.288476] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port e971a6e9-a261-4d99-a150-3db60a52cb50 with status ACTIVE [ 951.289440] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 951.289440] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 951.289440] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 951.289440] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 951.289440] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 951.289669] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 951.289669] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 951.289669] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 951.289776] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 951.289837] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 951.290017] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 951.290741] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 951.290741] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 951.290741] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 951.290741] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 951.290741] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: e971a6e9-a261-4d99-a150-3db60a52cb50 is going to be updated. [ 951.312642] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 951.312642] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 951.312642] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 951.312642] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 951.312642] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 951.312642] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-e971a6e9-a261-4d99-a150-3db60a52cb50" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 951.623393] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: de5a6b9b-a5a9-4ccc-b897-0244548cc5fd in Status: SUCCESS [ 951.623629] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-de5a6b9b-a5a9-4ccc-b897-0244548cc5fd" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 951.655441] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 67f4a0c1-3a3c-4ed8-9358-3a9645aba154 in Status: IN_PROGRESS for 4s [ 953.668137] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 67f4a0c1-3a3c-4ed8-9358-3a9645aba154 in Status: SUCCESS [ 953.668641] env[65370]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 67f4a0c1-3a3c-4ed8-9358-3a9645aba154 deletion is rescheduled due to dependency. [ 953.668769] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-67f4a0c1-3a3c-4ed8-9358-3a9645aba154" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 953.670034] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-67f4a0c1-3a3c-4ed8-9358-3a9645aba154" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 953.670034] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-67f4a0c1-3a3c-4ed8-9358-3a9645aba154" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 953.670034] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 953.670034] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 953.670034] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 953.670034] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 953.670034] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 953.670034] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('67f4a0c1-3a3c-4ed8-9358-3a9645aba154',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 954.173406] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('67f4a0c1-3a3c-4ed8-9358-3a9645aba154',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 954.677550] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('67f4a0c1-3a3c-4ed8-9358-3a9645aba154',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 955.180821] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 955.180989] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 955.180989] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 955.183801] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 955.183801] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 955.183801] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 67f4a0c1-3a3c-4ed8-9358-3a9645aba154 is going to be updated. [ 955.214340] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 955.214534] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 955.214582] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 955.214813] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 955.214977] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 955.227074] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 67f4a0c1-3a3c-4ed8-9358-3a9645aba154 in Status: IN_PROGRESS for 2s [ 955.782404] env[65370]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 955.782663] env[65370]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=2 [ 955.833541] env[65370]: INFO networking_nsxv3.common.synchronization [None req-2420f58c-cfd4-4259-83cb-5b3c710793ee tempest-ServerActionsTestJSON-720598601 tempest-ServerActionsTestJSON-720598601-project-member] Enqueued Resource ID: 23fa7df4-0993-48e9-9080-1087f76da31c with Priority: HIGHEST for action security_group_rules [ 955.834581] env[65370]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 23fa7df4-0993-48e9-9080-1087f76da31c with Priority: HIGHEST for action security_group_rules [ 955.837381] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock rules-23fa7df4-0993-48e9-9080-1087f76da31c taken with stack trace [, , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 955.837516] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-23fa7df4-0993-48e9-9080-1087f76da31c" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 955.837584] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-23fa7df4-0993-48e9-9080-1087f76da31c" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 955.837837] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-23fa7df4-0993-48e9-9080-1087f76da31c" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 955.837924] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('23fa7df4-0993-48e9-9080-1087f76da31c',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 955.963179] env[65370]: INFO networking_nsxv3.common.synchronization [None req-dc0cc3e1-0d3a-4de6-a040-e0f2d5fbe8ae None None] Enqueued Resource ID: 22276e77-fd6f-4870-bec3-65081b2d81b1 with Priority: HIGHEST for action port [ 955.964042] env[65370]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 22276e77-fd6f-4870-bec3-65081b2d81b1 with Priority: HIGHEST for action port [ 955.964042] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock port-22276e77-fd6f-4870-bec3-65081b2d81b1 taken with stack trace [, , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 955.964201] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-22276e77-fd6f-4870-bec3-65081b2d81b1" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 955.964201] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-22276e77-fd6f-4870-bec3-65081b2d81b1" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 955.964439] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-22276e77-fd6f-4870-bec3-65081b2d81b1" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 955.964513] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('22276e77-fd6f-4870-bec3-65081b2d81b1',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 956.089602] env[65370]: INFO networking_nsxv3.common.synchronization [None req-01c9bc11-a11d-416c-aa42-4ddb38971299 tempest-ServerActionsTestJSON-720598601 tempest-ServerActionsTestJSON-720598601-project-member] Enqueued Resource ID: 23fa7df4-0993-48e9-9080-1087f76da31c with Priority: HIGHEST for action security_group_rules [ 956.089602] env[65370]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 23fa7df4-0993-48e9-9080-1087f76da31c with Priority: HIGHEST for action security_group_rules [ 956.089684] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock rules-23fa7df4-0993-48e9-9080-1087f76da31c taken with stack trace [, , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 956.089777] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-23fa7df4-0993-48e9-9080-1087f76da31c" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 956.363965] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 956.363965] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 956.363965] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 956.363965] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 956.363965] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 956.364770] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 23fa7df4-0993-48e9-9080-1087f76da31c already deleted. [ 956.364917] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-23fa7df4-0993-48e9-9080-1087f76da31c" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 956.365137] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-23fa7df4-0993-48e9-9080-1087f76da31c" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 956.365329] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-23fa7df4-0993-48e9-9080-1087f76da31c" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 956.365417] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('23fa7df4-0993-48e9-9080-1087f76da31c',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 956.467439] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 22276e77-fd6f-4870-bec3-65081b2d81b1 [ 956.467678] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 956.467890] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 956.467890] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 956.468389] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 956.468510] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 956.468610] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:22276e77-fd6f-4870-bec3-65081b2d81b1 already deleted. [ 956.468693] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-22276e77-fd6f-4870-bec3-65081b2d81b1" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 956.896393] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 956.896668] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 956.896668] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 956.899666] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 956.899666] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 956.899666] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 23fa7df4-0993-48e9-9080-1087f76da31c already deleted. [ 956.899666] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-23fa7df4-0993-48e9-9080-1087f76da31c" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 956.908637] env[65370]: INFO networking_nsxv3.common.synchronization [None req-900c1417-9993-4074-86f7-699ffa93fd9c tempest-ServerActionsV293TestJSON-2044734182 tempest-ServerActionsV293TestJSON-2044734182-project-member] Enqueued Resource ID: 5b5e0c25-5d4e-4e13-9670-be19b4122c73 with Priority: HIGHEST for action security_group_rules [ 956.909362] env[65370]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5b5e0c25-5d4e-4e13-9670-be19b4122c73 with Priority: HIGHEST for action security_group_rules [ 956.909764] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock rules-5b5e0c25-5d4e-4e13-9670-be19b4122c73 taken with stack trace [, , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 956.909764] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-5b5e0c25-5d4e-4e13-9670-be19b4122c73" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 956.909764] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-5b5e0c25-5d4e-4e13-9670-be19b4122c73" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 956.909896] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-5b5e0c25-5d4e-4e13-9670-be19b4122c73" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 956.909992] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('5b5e0c25-5d4e-4e13-9670-be19b4122c73',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 957.011125] env[65370]: INFO networking_nsxv3.common.synchronization [None req-6e34366d-a7d6-462f-b2dc-a0d2ad13a730 tempest-ServerActionsV293TestJSON-2044734182 tempest-ServerActionsV293TestJSON-2044734182-project-member] Enqueued Resource ID: 5b5e0c25-5d4e-4e13-9670-be19b4122c73 with Priority: HIGHEST for action security_group_rules [ 957.011661] env[65370]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5b5e0c25-5d4e-4e13-9670-be19b4122c73 with Priority: HIGHEST for action security_group_rules [ 957.011962] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock rules-5b5e0c25-5d4e-4e13-9670-be19b4122c73 taken with stack trace [, , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 957.012079] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-5b5e0c25-5d4e-4e13-9670-be19b4122c73" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 957.240145] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 67f4a0c1-3a3c-4ed8-9358-3a9645aba154 in Status: SUCCESS [ 957.240381] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-67f4a0c1-3a3c-4ed8-9358-3a9645aba154" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 957.240586] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-67f4a0c1-3a3c-4ed8-9358-3a9645aba154" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 957.240836] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-67f4a0c1-3a3c-4ed8-9358-3a9645aba154" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 957.240973] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 957.241136] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 957.241186] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 957.241321] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 957.241430] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 957.241472] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-67f4a0c1-3a3c-4ed8-9358-3a9645aba154" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 957.243052] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('67f4a0c1-3a3c-4ed8-9358-3a9645aba154',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 957.431467] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 957.432167] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 957.432167] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 957.432167] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 957.432167] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 957.432167] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 5b5e0c25-5d4e-4e13-9670-be19b4122c73 already deleted. [ 957.432338] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-5b5e0c25-5d4e-4e13-9670-be19b4122c73" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 957.432420] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-5b5e0c25-5d4e-4e13-9670-be19b4122c73" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 957.432578] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-5b5e0c25-5d4e-4e13-9670-be19b4122c73" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 957.432662] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('5b5e0c25-5d4e-4e13-9670-be19b4122c73',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 957.746834] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock member-67f4a0c1-3a3c-4ed8-9358-3a9645aba154 taken with stack trace [, , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 957.746989] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-67f4a0c1-3a3c-4ed8-9358-3a9645aba154" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 957.747092] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-67f4a0c1-3a3c-4ed8-9358-3a9645aba154" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 957.747310] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-67f4a0c1-3a3c-4ed8-9358-3a9645aba154" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 957.747486] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 957.747597] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 957.747664] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 957.747851] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 957.747941] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 957.748081] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-67f4a0c1-3a3c-4ed8-9358-3a9645aba154" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 957.748433] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock member-67f4a0c1-3a3c-4ed8-9358-3a9645aba154 taken with stack trace [, , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 957.748433] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-67f4a0c1-3a3c-4ed8-9358-3a9645aba154" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 957.748433] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-67f4a0c1-3a3c-4ed8-9358-3a9645aba154" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 957.748651] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-67f4a0c1-3a3c-4ed8-9358-3a9645aba154" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 957.748651] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 957.748737] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 957.748797] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 957.748930] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 957.749013] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 957.749172] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-67f4a0c1-3a3c-4ed8-9358-3a9645aba154" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 957.749267] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('67f4a0c1-3a3c-4ed8-9358-3a9645aba154',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 957.963144] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 957.963144] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 957.963144] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 957.963144] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 957.963144] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 957.963144] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 5b5e0c25-5d4e-4e13-9670-be19b4122c73 already deleted. [ 957.963144] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-5b5e0c25-5d4e-4e13-9670-be19b4122c73" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 958.251607] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 67f4a0c1-3a3c-4ed8-9358-3a9645aba154: rpc.has_security_group_logging(os_id): False [ 958.270531] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 958.270702] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 958.270702] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 958.270916] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 958.271009] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 958.271366] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 958.271695] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 958.271752] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 958.272140] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 958.272226] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 958.272660] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 958.272660] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 958.272660] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 958.272842] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 958.272842] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 958.273308] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 958.274927] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 958.274927] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 958.274927] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 958.274927] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 958.274927] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 67f4a0c1-3a3c-4ed8-9358-3a9645aba154 is going to be updated. [ 958.351542] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 958.351704] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 958.352091] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 958.352091] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 958.352271] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 958.370870] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 67f4a0c1-3a3c-4ed8-9358-3a9645aba154 in Status: IN_PROGRESS for 2s [ 958.493953] env[65370]: INFO networking_nsxv3.common.synchronization [None req-0d166cbe-f63c-403a-a7f5-9fa89a475482 None None] Enqueued Resource ID: 74b206c9-7dac-4596-895a-7eb8cba25cb6 with Priority: HIGHEST for action port [ 958.494553] env[65370]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 74b206c9-7dac-4596-895a-7eb8cba25cb6 with Priority: HIGHEST for action port [ 958.494867] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock port-74b206c9-7dac-4596-895a-7eb8cba25cb6 taken with stack trace [, , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 958.494999] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-74b206c9-7dac-4596-895a-7eb8cba25cb6" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 958.495412] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-74b206c9-7dac-4596-895a-7eb8cba25cb6" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 958.495694] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-74b206c9-7dac-4596-895a-7eb8cba25cb6" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 958.495783] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('74b206c9-7dac-4596-895a-7eb8cba25cb6',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 958.998110] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 74b206c9-7dac-4596-895a-7eb8cba25cb6 [ 958.998526] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 958.998648] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 958.998648] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 958.998921] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 958.999065] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 958.999212] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:74b206c9-7dac-4596-895a-7eb8cba25cb6 already deleted. [ 958.999265] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-74b206c9-7dac-4596-895a-7eb8cba25cb6" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 960.390269] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 67f4a0c1-3a3c-4ed8-9358-3a9645aba154 in Status: SUCCESS [ 960.390269] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-67f4a0c1-3a3c-4ed8-9358-3a9645aba154" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 963.496039] env[65370]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 963.496039] env[65370]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 967.775948] env[65370]: INFO networking_nsxv3.common.synchronization [req-9bef9bd0-2804-4a8d-bc27-dcc2808cb433 req-d3a05106-1aa1-4b22-b36c-053edfd4064b tempest-AttachInterfacesV270Test-2119411272 tempest-AttachInterfacesV270Test-2119411272-project-member] Enqueued Resource ID: 361130b7-6514-4c56-97c2-909bb5c1a95f with Priority: HIGHEST for action security_group_members [ 967.775948] env[65370]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 361130b7-6514-4c56-97c2-909bb5c1a95f with Priority: HIGHEST for action security_group_members [ 967.775948] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock member-361130b7-6514-4c56-97c2-909bb5c1a95f taken with stack trace [, , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 967.775948] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-361130b7-6514-4c56-97c2-909bb5c1a95f" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 967.775948] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-361130b7-6514-4c56-97c2-909bb5c1a95f" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 967.775948] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-361130b7-6514-4c56-97c2-909bb5c1a95f" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 967.775948] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 967.775948] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 967.775948] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 967.776538] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 967.776538] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 967.776538] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('361130b7-6514-4c56-97c2-909bb5c1a95f',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 968.167428] env[65370]: DEBUG networking_nsxv3.common.locking [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Lock network-401 taken with stack trace [, , , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 968.167666] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquiring lock "network-401" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 968.167803] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquired lock "network-401" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 968.168185] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquired external semaphore "network-401" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 968.168538] env[65370]: DEBUG networking_nsxv3.common.locking [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 968.168726] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquiring lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 968.168958] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquired lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 968.169354] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquired external semaphore "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 968.169509] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Releasing lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 968.169752] env[65370]: DEBUG dogpile.cache.region [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] No value present for key: 'zone-id' {{(pid=65370) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 968.169836] env[65370]: DEBUG dogpile.lock [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] NeedRegenerationException {{(pid=65370) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 968.169942] env[65370]: DEBUG dogpile.lock [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] no value, waiting for create lock {{(pid=65370) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 968.170059] env[65370]: DEBUG dogpile.lock [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] value creation lock acquired {{(pid=65370) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 968.170163] env[65370]: DEBUG dogpile.cache.region [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] No value present for key: 'zone-id' {{(pid=65370) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 968.170264] env[65370]: DEBUG dogpile.lock [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Calling creation function for not-yet-present value {{(pid=65370) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 968.170405] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 968.194624] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 968.194840] env[65370]: DEBUG dogpile.cache.region [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Cache value generated in 0.024 seconds for key(s): 'zone-id' {{(pid=65370) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 968.195024] env[65370]: DEBUG dogpile.lock [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Released creation lock {{(pid=65370) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 968.195221] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Releasing lock "network-401" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 968.195618] env[65370]: DEBUG networking_nsxv3.common.locking [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Lock port-954e45eb-e38d-4f76-9fa7-00dc9c6d68fb taken with stack trace [, , , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 968.197523] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquiring lock "port-954e45eb-e38d-4f76-9fa7-00dc9c6d68fb" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 968.197523] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquired lock "port-954e45eb-e38d-4f76-9fa7-00dc9c6d68fb" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 968.197523] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquired external semaphore "port-954e45eb-e38d-4f76-9fa7-00dc9c6d68fb" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 968.197523] env[65370]: DEBUG networking_nsxv3.api.rpc [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('954e45eb-e38d-4f76-9fa7-00dc9c6d68fb',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 968.279706] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 968.279970] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 968.280319] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 968.280770] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 968.280967] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 968.281259] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 968.281390] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 968.281456] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 968.281722] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 968.281967] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 968.281967] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 361130b7-6514-4c56-97c2-909bb5c1a95f already deleted. [ 968.282466] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-361130b7-6514-4c56-97c2-909bb5c1a95f" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 968.701068] env[65370]: DEBUG networking_nsxv3.common.locking [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 968.701068] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquiring lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 968.701068] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquired lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 968.701068] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquired external semaphore "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 968.701068] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Releasing lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 968.701068] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Segment Port 954e45eb-e38d-4f76-9fa7-00dc9c6d68fb not found, creating... [ 968.701564] env[65370]: DEBUG networking_nsxv3.common.locking [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 968.701564] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquiring lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 968.701564] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquired lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 968.701774] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquired external semaphore "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 968.701937] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Releasing lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 968.702643] env[65370]: DEBUG networking_nsxv3.common.locking [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 968.702820] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquiring lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 968.702941] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquired lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 968.703170] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquired external semaphore "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 968.703406] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Releasing lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 968.703566] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Resource: SegmentPort with ID: 954e45eb-e38d-4f76-9fa7-00dc9c6d68fb is going to be created. [ 968.725487] env[65370]: DEBUG networking_nsxv3.common.locking [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 968.725716] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquiring lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 968.725817] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquired lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 968.726087] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquired external semaphore "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 968.726323] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Releasing lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 968.726604] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Releasing lock "port-954e45eb-e38d-4f76-9fa7-00dc9c6d68fb" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 969.528986] env[65370]: INFO networking_nsxv3.common.synchronization [req-9bef9bd0-2804-4a8d-bc27-dcc2808cb433 req-a4ccb745-d9de-4cbe-9242-dbd0f867531a service nova] Enqueued Resource ID: 361130b7-6514-4c56-97c2-909bb5c1a95f with Priority: HIGHEST for action security_group_rules [ 969.529376] env[65370]: INFO networking_nsxv3.common.synchronization [req-9bef9bd0-2804-4a8d-bc27-dcc2808cb433 req-a4ccb745-d9de-4cbe-9242-dbd0f867531a service nova] Enqueued Resource ID: 361130b7-6514-4c56-97c2-909bb5c1a95f with Priority: HIGHEST for action security_group_members [ 969.529376] env[65370]: INFO networking_nsxv3.common.synchronization [req-9bef9bd0-2804-4a8d-bc27-dcc2808cb433 req-a4ccb745-d9de-4cbe-9242-dbd0f867531a service nova] Enqueued Resource ID: 954e45eb-e38d-4f76-9fa7-00dc9c6d68fb with Priority: HIGHEST for action port [ 969.529907] env[65370]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 361130b7-6514-4c56-97c2-909bb5c1a95f with Priority: HIGHEST for action security_group_rules [ 969.530777] env[65370]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 361130b7-6514-4c56-97c2-909bb5c1a95f with Priority: HIGHEST for action security_group_members [ 969.531010] env[65370]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 954e45eb-e38d-4f76-9fa7-00dc9c6d68fb with Priority: HIGHEST for action port [ 969.531365] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock rules-361130b7-6514-4c56-97c2-909bb5c1a95f taken with stack trace [, , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 969.531563] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-361130b7-6514-4c56-97c2-909bb5c1a95f" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 969.531657] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-361130b7-6514-4c56-97c2-909bb5c1a95f" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 969.531984] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-361130b7-6514-4c56-97c2-909bb5c1a95f" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 969.532167] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('361130b7-6514-4c56-97c2-909bb5c1a95f',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 969.533844] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock member-361130b7-6514-4c56-97c2-909bb5c1a95f taken with stack trace [, , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 969.534010] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-361130b7-6514-4c56-97c2-909bb5c1a95f" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 969.534432] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-361130b7-6514-4c56-97c2-909bb5c1a95f" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 969.534432] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-361130b7-6514-4c56-97c2-909bb5c1a95f" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 969.534595] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 969.534736] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 969.534803] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 969.534988] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 969.535122] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 969.535314] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('361130b7-6514-4c56-97c2-909bb5c1a95f',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 969.540582] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock port-954e45eb-e38d-4f76-9fa7-00dc9c6d68fb taken with stack trace [, , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 969.540784] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-954e45eb-e38d-4f76-9fa7-00dc9c6d68fb" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 969.540892] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-954e45eb-e38d-4f76-9fa7-00dc9c6d68fb" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 969.541364] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-954e45eb-e38d-4f76-9fa7-00dc9c6d68fb" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 969.542246] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('954e45eb-e38d-4f76-9fa7-00dc9c6d68fb',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 970.035147] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock member-361130b7-6514-4c56-97c2-909bb5c1a95f taken with stack trace [, , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 970.035147] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-361130b7-6514-4c56-97c2-909bb5c1a95f" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 970.044587] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('361130b7-6514-4c56-97c2-909bb5c1a95f',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 970.045663] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 954e45eb-e38d-4f76-9fa7-00dc9c6d68fb with status ACTIVE [ 970.046417] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 970.046417] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 970.046417] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 970.046417] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 970.046417] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 970.046697] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 970.046754] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 970.048069] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 970.048069] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 970.048069] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 970.048069] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 970.048069] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 970.048069] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 970.048069] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 970.048069] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 970.048069] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 954e45eb-e38d-4f76-9fa7-00dc9c6d68fb is going to be updated. [ 970.072446] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 970.072681] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 970.072681] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 970.072974] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 970.073154] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 970.073363] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-954e45eb-e38d-4f76-9fa7-00dc9c6d68fb" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 970.550782] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('361130b7-6514-4c56-97c2-909bb5c1a95f',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 971.056209] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 971.056209] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 971.056209] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 971.056209] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 971.056209] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 971.056209] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 361130b7-6514-4c56-97c2-909bb5c1a95f is going to be created. [ 971.084045] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 971.084237] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 971.084282] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 971.088040] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 971.088040] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 971.097049] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 361130b7-6514-4c56-97c2-909bb5c1a95f in Status: UNINITIALIZED for 2s [ 973.109540] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 361130b7-6514-4c56-97c2-909bb5c1a95f in Status: SUCCESS [ 973.109834] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-361130b7-6514-4c56-97c2-909bb5c1a95f" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 973.109942] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-361130b7-6514-4c56-97c2-909bb5c1a95f" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 973.110252] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-361130b7-6514-4c56-97c2-909bb5c1a95f" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 973.110874] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 973.110874] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 973.110874] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 973.110874] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 973.110874] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 973.111249] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-361130b7-6514-4c56-97c2-909bb5c1a95f" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 973.111249] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('361130b7-6514-4c56-97c2-909bb5c1a95f',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 973.614367] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock member-361130b7-6514-4c56-97c2-909bb5c1a95f taken with stack trace [, , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 973.614536] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-361130b7-6514-4c56-97c2-909bb5c1a95f" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 973.614609] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-361130b7-6514-4c56-97c2-909bb5c1a95f" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 973.614854] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-361130b7-6514-4c56-97c2-909bb5c1a95f" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 973.615048] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 973.615161] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 973.615226] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 973.615451] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 973.615574] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 973.615671] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-361130b7-6514-4c56-97c2-909bb5c1a95f" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 973.615860] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock member-361130b7-6514-4c56-97c2-909bb5c1a95f taken with stack trace [, , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 973.615921] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-361130b7-6514-4c56-97c2-909bb5c1a95f" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 973.615989] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-361130b7-6514-4c56-97c2-909bb5c1a95f" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 973.616217] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-361130b7-6514-4c56-97c2-909bb5c1a95f" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 973.616293] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 973.616446] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 973.616509] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 973.616652] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 973.616726] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 973.616814] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-361130b7-6514-4c56-97c2-909bb5c1a95f" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 973.617018] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('361130b7-6514-4c56-97c2-909bb5c1a95f',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 974.052651] env[65370]: INFO networking_nsxv3.common.synchronization [req-cc21fb16-1671-4e60-89f4-f843100a700b req-dbba0688-3706-447d-a949-32ad716ffd3a tempest-ImagesTestJSON-246049254 tempest-ImagesTestJSON-246049254-project-member] Enqueued Resource ID: 67f4a0c1-3a3c-4ed8-9358-3a9645aba154 with Priority: HIGHEST for action security_group_members [ 974.053183] env[65370]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 67f4a0c1-3a3c-4ed8-9358-3a9645aba154 with Priority: HIGHEST for action security_group_members [ 974.053783] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock member-67f4a0c1-3a3c-4ed8-9358-3a9645aba154 taken with stack trace [, , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 974.053911] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-67f4a0c1-3a3c-4ed8-9358-3a9645aba154" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 974.053991] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-67f4a0c1-3a3c-4ed8-9358-3a9645aba154" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 974.054220] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-67f4a0c1-3a3c-4ed8-9358-3a9645aba154" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 974.054388] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 974.054484] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 974.054550] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 974.055129] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 974.055129] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 974.055129] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('67f4a0c1-3a3c-4ed8-9358-3a9645aba154',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 974.119386] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 361130b7-6514-4c56-97c2-909bb5c1a95f: rpc.has_security_group_logging(os_id): False [ 974.145338] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 974.145338] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 974.145338] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 974.145833] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 974.145833] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 974.145944] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 974.145944] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 974.146036] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 974.146198] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 974.146284] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 974.146485] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 974.146600] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 974.146669] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 974.146798] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 974.146884] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 974.150360] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 974.150360] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 974.150520] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 974.150744] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 974.150859] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 974.151030] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 361130b7-6514-4c56-97c2-909bb5c1a95f is going to be created. [ 974.225480] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 974.225757] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 974.225757] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 974.225942] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 974.226143] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 974.239383] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 361130b7-6514-4c56-97c2-909bb5c1a95f in Status: IN_PROGRESS for 2s [ 974.492263] env[65370]: INFO networking_nsxv3.common.synchronization [req-57161a05-7ec8-426c-9486-3f13628882ef req-3c5f2ce9-838f-4d6e-b1f0-f0be84512ab3 tempest-FloatingIPsAssociationTestJSON-1189544841 tempest-FloatingIPsAssociationTestJSON-1189544841-project-member] Enqueued Resource ID: de5a6b9b-a5a9-4ccc-b897-0244548cc5fd with Priority: HIGHEST for action security_group_members [ 974.492811] env[65370]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: de5a6b9b-a5a9-4ccc-b897-0244548cc5fd with Priority: HIGHEST for action security_group_members [ 974.493134] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock member-de5a6b9b-a5a9-4ccc-b897-0244548cc5fd taken with stack trace [, , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 974.493258] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-de5a6b9b-a5a9-4ccc-b897-0244548cc5fd" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 974.493325] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-de5a6b9b-a5a9-4ccc-b897-0244548cc5fd" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 974.493515] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-de5a6b9b-a5a9-4ccc-b897-0244548cc5fd" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 974.493665] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 974.493760] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 974.493820] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 974.493965] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 974.494068] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 974.494159] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('de5a6b9b-a5a9-4ccc-b897-0244548cc5fd',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 974.557328] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 974.557498] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 974.557579] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 974.558137] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 974.558137] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 974.558348] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 974.558348] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 974.558453] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 974.560149] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 974.560149] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 974.560149] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 67f4a0c1-3a3c-4ed8-9358-3a9645aba154 is going to be updated. [ 974.594636] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 974.594783] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 974.594855] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 974.595089] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 974.595238] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 974.606547] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 67f4a0c1-3a3c-4ed8-9358-3a9645aba154 in Status: IN_PROGRESS for 2s [ 974.830623] env[65370]: INFO networking_nsxv3.common.synchronization [req-0286a7c5-abf7-4874-ba17-8d2560c31ae6 req-d12608b7-b374-4e1e-9e01-a56b92cc53c0 tempest-ServerDiagnosticsTest-1182163202 tempest-ServerDiagnosticsTest-1182163202-project-member] Enqueued Resource ID: 5b2126a9-5b17-4e9d-9c36-75348e49bbe8 with Priority: HIGHEST for action security_group_members [ 974.831226] env[65370]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5b2126a9-5b17-4e9d-9c36-75348e49bbe8 with Priority: HIGHEST for action security_group_members [ 974.831551] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock member-5b2126a9-5b17-4e9d-9c36-75348e49bbe8 taken with stack trace [, , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 974.832021] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5b2126a9-5b17-4e9d-9c36-75348e49bbe8" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 974.832294] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5b2126a9-5b17-4e9d-9c36-75348e49bbe8" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 974.832588] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5b2126a9-5b17-4e9d-9c36-75348e49bbe8" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 974.832724] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 974.832831] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 974.832887] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 974.834508] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 974.834682] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 974.834798] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5b2126a9-5b17-4e9d-9c36-75348e49bbe8',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 974.997539] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 974.997539] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 974.997539] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 974.997539] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 974.997539] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 974.997539] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 974.997539] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 974.997539] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 974.997539] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 974.997539] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 974.998082] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: de5a6b9b-a5a9-4ccc-b897-0244548cc5fd is going to be updated. [ 975.031854] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 975.032041] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 975.032111] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 975.032270] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 975.032415] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 975.044740] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: de5a6b9b-a5a9-4ccc-b897-0244548cc5fd in Status: IN_PROGRESS for 2s [ 975.249223] env[65370]: DEBUG networking_nsxv3.common.locking [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Lock network-449 taken with stack trace [, , , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 975.249706] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquiring lock "network-449" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 975.249834] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquired lock "network-449" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 975.250307] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquired external semaphore "network-449" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 975.251058] env[65370]: DEBUG networking_nsxv3.common.locking [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 975.251263] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquiring lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 975.251386] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquired lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 975.251639] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquired external semaphore "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 975.251782] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Releasing lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 975.252029] env[65370]: DEBUG dogpile.cache.region [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] No value present for key: 'zone-id' {{(pid=65370) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 975.252160] env[65370]: DEBUG dogpile.lock [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] NeedRegenerationException {{(pid=65370) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 975.252288] env[65370]: DEBUG dogpile.lock [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] no value, waiting for create lock {{(pid=65370) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 975.252404] env[65370]: DEBUG dogpile.lock [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] value creation lock acquired {{(pid=65370) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 975.252535] env[65370]: DEBUG dogpile.cache.region [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] No value present for key: 'zone-id' {{(pid=65370) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 975.252656] env[65370]: DEBUG dogpile.lock [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Calling creation function for not-yet-present value {{(pid=65370) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 975.252801] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 975.275414] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 975.275615] env[65370]: DEBUG dogpile.cache.region [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=65370) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 975.275741] env[65370]: DEBUG dogpile.lock [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Released creation lock {{(pid=65370) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 975.276060] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Releasing lock "network-449" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 975.276358] env[65370]: DEBUG networking_nsxv3.common.locking [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Lock port-4dcd5f61-eaf3-4485-bbfb-19905919f789 taken with stack trace [, , , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 975.276551] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquiring lock "port-4dcd5f61-eaf3-4485-bbfb-19905919f789" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 975.276687] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquired lock "port-4dcd5f61-eaf3-4485-bbfb-19905919f789" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 975.277151] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquired external semaphore "port-4dcd5f61-eaf3-4485-bbfb-19905919f789" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 975.277313] env[65370]: DEBUG networking_nsxv3.api.rpc [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4dcd5f61-eaf3-4485-bbfb-19905919f789',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 975.337532] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 975.337752] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 975.337839] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 975.338153] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 975.338289] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 975.338539] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 975.338647] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 975.338710] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 975.338884] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 975.338983] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 975.339106] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5b2126a9-5b17-4e9d-9c36-75348e49bbe8 already deleted. [ 975.339209] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5b2126a9-5b17-4e9d-9c36-75348e49bbe8" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 975.779866] env[65370]: DEBUG networking_nsxv3.common.locking [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 975.780210] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquiring lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 975.780368] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquired lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 975.780691] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquired external semaphore "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 975.780863] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Releasing lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 975.781055] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Segment Port 4dcd5f61-eaf3-4485-bbfb-19905919f789 not found, creating... [ 975.781356] env[65370]: DEBUG networking_nsxv3.common.locking [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 975.781542] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquiring lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 975.781700] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquired lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 975.782085] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquired external semaphore "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 975.782282] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Releasing lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 975.782607] env[65370]: DEBUG networking_nsxv3.common.locking [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 975.782786] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquiring lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 975.782949] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquired lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 975.783207] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquired external semaphore "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 975.783352] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Releasing lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 975.783519] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Resource: SegmentPort with ID: 4dcd5f61-eaf3-4485-bbfb-19905919f789 is going to be created. [ 975.809735] env[65370]: DEBUG networking_nsxv3.common.locking [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 975.809944] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquiring lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 975.810113] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquired lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 975.810423] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquired external semaphore "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 975.810683] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Releasing lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 975.810940] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Releasing lock "port-4dcd5f61-eaf3-4485-bbfb-19905919f789" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 975.875638] env[65370]: INFO networking_nsxv3.common.synchronization [None req-77098553-6f0a-4c81-b871-70ef67f9c55a None None] Enqueued Resource ID: e259f6dd-4e17-4058-9061-b605b562ce06 with Priority: HIGHEST for action port [ 975.876508] env[65370]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e259f6dd-4e17-4058-9061-b605b562ce06 with Priority: HIGHEST for action port [ 975.877035] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock port-e259f6dd-4e17-4058-9061-b605b562ce06 taken with stack trace [, , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 975.877155] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-e259f6dd-4e17-4058-9061-b605b562ce06" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 975.877219] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-e259f6dd-4e17-4058-9061-b605b562ce06" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 975.877480] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-e259f6dd-4e17-4058-9061-b605b562ce06" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 975.877553] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e259f6dd-4e17-4058-9061-b605b562ce06',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 976.253215] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 361130b7-6514-4c56-97c2-909bb5c1a95f in Status: SUCCESS [ 976.253682] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-361130b7-6514-4c56-97c2-909bb5c1a95f" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 976.379972] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port e259f6dd-4e17-4058-9061-b605b562ce06 [ 976.379972] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 976.379972] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 976.379972] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 976.380262] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 976.380577] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 976.380577] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:e259f6dd-4e17-4058-9061-b605b562ce06 already deleted. [ 976.380577] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-e259f6dd-4e17-4058-9061-b605b562ce06" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 976.580569] env[65370]: INFO networking_nsxv3.common.synchronization [req-0286a7c5-abf7-4874-ba17-8d2560c31ae6 req-8a9a1db7-e49f-4096-9ecb-6c9f48896613 service nova] Enqueued Resource ID: 5b2126a9-5b17-4e9d-9c36-75348e49bbe8 with Priority: HIGHEST for action security_group_rules [ 976.580569] env[65370]: INFO networking_nsxv3.common.synchronization [req-0286a7c5-abf7-4874-ba17-8d2560c31ae6 req-8a9a1db7-e49f-4096-9ecb-6c9f48896613 service nova] Enqueued Resource ID: 5b2126a9-5b17-4e9d-9c36-75348e49bbe8 with Priority: HIGHEST for action security_group_members [ 976.580569] env[65370]: INFO networking_nsxv3.common.synchronization [req-0286a7c5-abf7-4874-ba17-8d2560c31ae6 req-8a9a1db7-e49f-4096-9ecb-6c9f48896613 service nova] Enqueued Resource ID: 4dcd5f61-eaf3-4485-bbfb-19905919f789 with Priority: HIGHEST for action port [ 976.580569] env[65370]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5b2126a9-5b17-4e9d-9c36-75348e49bbe8 with Priority: HIGHEST for action security_group_rules [ 976.580569] env[65370]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5b2126a9-5b17-4e9d-9c36-75348e49bbe8 with Priority: HIGHEST for action security_group_members [ 976.580569] env[65370]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4dcd5f61-eaf3-4485-bbfb-19905919f789 with Priority: HIGHEST for action port [ 976.581579] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock rules-5b2126a9-5b17-4e9d-9c36-75348e49bbe8 taken with stack trace [, , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 976.581842] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-5b2126a9-5b17-4e9d-9c36-75348e49bbe8" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 976.581999] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-5b2126a9-5b17-4e9d-9c36-75348e49bbe8" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 976.582402] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-5b2126a9-5b17-4e9d-9c36-75348e49bbe8" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 976.582570] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('5b2126a9-5b17-4e9d-9c36-75348e49bbe8',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 976.583509] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock member-5b2126a9-5b17-4e9d-9c36-75348e49bbe8 taken with stack trace [, , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 976.583860] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5b2126a9-5b17-4e9d-9c36-75348e49bbe8" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 976.584066] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5b2126a9-5b17-4e9d-9c36-75348e49bbe8" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 976.584330] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5b2126a9-5b17-4e9d-9c36-75348e49bbe8" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 976.584568] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 976.586019] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 976.586019] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 976.586019] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 976.586019] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 976.586019] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5b2126a9-5b17-4e9d-9c36-75348e49bbe8',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 976.586019] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock port-4dcd5f61-eaf3-4485-bbfb-19905919f789 taken with stack trace [, , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 976.586605] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-4dcd5f61-eaf3-4485-bbfb-19905919f789" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 976.586758] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-4dcd5f61-eaf3-4485-bbfb-19905919f789" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 976.587038] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-4dcd5f61-eaf3-4485-bbfb-19905919f789" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 976.587204] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4dcd5f61-eaf3-4485-bbfb-19905919f789',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 976.619273] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 67f4a0c1-3a3c-4ed8-9358-3a9645aba154 in Status: SUCCESS [ 976.619462] env[65370]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 67f4a0c1-3a3c-4ed8-9358-3a9645aba154 deletion is rescheduled due to dependency. [ 976.619577] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-67f4a0c1-3a3c-4ed8-9358-3a9645aba154" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 976.872111] env[65370]: INFO networking_nsxv3.common.synchronization [req-306e7e5b-5201-460e-80f7-eb046dbf922d req-ba2676f9-0a2d-400d-bf9b-fc299f98b373 tempest-ServerActionsTestJSON-720598601 tempest-ServerActionsTestJSON-720598601-project-member] Enqueued Resource ID: 23fa7df4-0993-48e9-9080-1087f76da31c with Priority: HIGHEST for action security_group_members [ 976.872679] env[65370]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 23fa7df4-0993-48e9-9080-1087f76da31c with Priority: HIGHEST for action security_group_members [ 976.873182] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock member-23fa7df4-0993-48e9-9080-1087f76da31c taken with stack trace [, , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 976.873383] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-23fa7df4-0993-48e9-9080-1087f76da31c" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 976.873485] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-23fa7df4-0993-48e9-9080-1087f76da31c" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 976.873933] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-23fa7df4-0993-48e9-9080-1087f76da31c" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 976.873933] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 976.874420] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 976.874420] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 976.874569] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 976.874569] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 976.874674] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('23fa7df4-0993-48e9-9080-1087f76da31c',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 977.055084] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: de5a6b9b-a5a9-4ccc-b897-0244548cc5fd in Status: SUCCESS [ 977.055273] env[65370]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: de5a6b9b-a5a9-4ccc-b897-0244548cc5fd deletion is rescheduled due to dependency. [ 977.055386] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-de5a6b9b-a5a9-4ccc-b897-0244548cc5fd" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 977.089534] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('5b2126a9-5b17-4e9d-9c36-75348e49bbe8',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 977.090779] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock member-5b2126a9-5b17-4e9d-9c36-75348e49bbe8 taken with stack trace [, , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 977.090928] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5b2126a9-5b17-4e9d-9c36-75348e49bbe8" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 977.091293] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 4dcd5f61-eaf3-4485-bbfb-19905919f789 with status ACTIVE [ 977.091293] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 977.091675] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 977.091675] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 977.091780] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 977.091827] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 977.091976] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 977.092101] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 977.092182] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 977.092359] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 977.092450] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 977.092698] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 977.092841] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 977.092938] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 977.097176] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 977.097176] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 977.097311] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 4dcd5f61-eaf3-4485-bbfb-19905919f789 is going to be updated. [ 977.121364] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 977.121596] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 977.121670] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 977.121886] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 977.122042] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 977.122204] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-4dcd5f61-eaf3-4485-bbfb-19905919f789" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 977.264348] env[65370]: DEBUG networking_nsxv3.common.locking [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Lock network-609 taken with stack trace [, , , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 977.264727] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquiring lock "network-609" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 977.264727] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquired lock "network-609" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 977.264980] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquired external semaphore "network-609" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 977.265423] env[65370]: DEBUG networking_nsxv3.common.locking [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 977.265677] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquiring lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 977.265853] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquired lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 977.266152] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquired external semaphore "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 977.266363] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Releasing lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 977.266633] env[65370]: DEBUG dogpile.cache.region [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] No value present for key: 'zone-id' {{(pid=65370) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 977.266798] env[65370]: DEBUG dogpile.lock [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] NeedRegenerationException {{(pid=65370) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 977.266988] env[65370]: DEBUG dogpile.lock [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] no value, waiting for create lock {{(pid=65370) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 977.267196] env[65370]: DEBUG dogpile.lock [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] value creation lock acquired {{(pid=65370) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 977.267402] env[65370]: DEBUG dogpile.cache.region [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] No value present for key: 'zone-id' {{(pid=65370) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 977.267579] env[65370]: DEBUG dogpile.lock [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Calling creation function for not-yet-present value {{(pid=65370) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 977.267765] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 977.292549] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 977.293011] env[65370]: DEBUG dogpile.cache.region [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Cache value generated in 0.025 seconds for key(s): 'zone-id' {{(pid=65370) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 977.293250] env[65370]: DEBUG dogpile.lock [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Released creation lock {{(pid=65370) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 977.293489] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Releasing lock "network-609" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 977.293901] env[65370]: DEBUG networking_nsxv3.common.locking [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Lock port-0f395508-a192-4c51-b7c2-7bf32466c5b8 taken with stack trace [, , , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 977.294166] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquiring lock "port-0f395508-a192-4c51-b7c2-7bf32466c5b8" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 977.294344] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquired lock "port-0f395508-a192-4c51-b7c2-7bf32466c5b8" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 977.294719] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquired external semaphore "port-0f395508-a192-4c51-b7c2-7bf32466c5b8" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 977.294956] env[65370]: DEBUG networking_nsxv3.api.rpc [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0f395508-a192-4c51-b7c2-7bf32466c5b8',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 977.379440] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 977.379620] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 977.379670] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 977.379902] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 977.379991] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 977.380324] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 977.380324] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 977.380435] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 977.380501] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 977.380575] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 977.380657] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 23fa7df4-0993-48e9-9080-1087f76da31c already deleted. [ 977.380747] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-23fa7df4-0993-48e9-9080-1087f76da31c" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 977.600766] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('5b2126a9-5b17-4e9d-9c36-75348e49bbe8',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 977.799008] env[65370]: DEBUG networking_nsxv3.common.locking [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 977.799220] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquiring lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 977.799366] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquired lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 977.799643] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquired external semaphore "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 977.799785] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Releasing lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 977.799932] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Segment Port 0f395508-a192-4c51-b7c2-7bf32466c5b8 not found, creating... [ 977.800249] env[65370]: DEBUG networking_nsxv3.common.locking [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 977.801340] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquiring lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 977.801537] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquired lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 977.801770] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquired external semaphore "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 977.801901] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Releasing lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 977.802196] env[65370]: DEBUG networking_nsxv3.common.locking [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 977.802344] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquiring lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 977.802453] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquired lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 977.804199] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquired external semaphore "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 977.804199] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Releasing lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 977.804199] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Resource: SegmentPort with ID: 0f395508-a192-4c51-b7c2-7bf32466c5b8 is going to be created. [ 977.826119] env[65370]: DEBUG networking_nsxv3.common.locking [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 977.826119] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquiring lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 977.826119] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquired lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 977.826305] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquired external semaphore "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 977.826400] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Releasing lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 977.826625] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Releasing lock "port-0f395508-a192-4c51-b7c2-7bf32466c5b8" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 978.072117] env[65370]: INFO networking_nsxv3.common.synchronization [None req-8a346749-edef-4e23-b1bd-22879309ed5f None None] Enqueued Resource ID: 4af44c1a-b1dd-4cdd-a946-db31056975f5 with Priority: HIGHEST for action port [ 978.072748] env[65370]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4af44c1a-b1dd-4cdd-a946-db31056975f5 with Priority: HIGHEST for action port [ 978.073101] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock port-4af44c1a-b1dd-4cdd-a946-db31056975f5 taken with stack trace [, , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 978.074226] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-4af44c1a-b1dd-4cdd-a946-db31056975f5" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 978.074275] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-4af44c1a-b1dd-4cdd-a946-db31056975f5" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 978.075307] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-4af44c1a-b1dd-4cdd-a946-db31056975f5" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 978.075307] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4af44c1a-b1dd-4cdd-a946-db31056975f5',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 978.103197] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 978.103295] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 978.103329] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 978.103667] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 978.103784] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 978.103904] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5b2126a9-5b17-4e9d-9c36-75348e49bbe8 is going to be created. [ 978.129695] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 978.129957] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 978.130080] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 978.130301] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 978.130490] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 978.141868] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5b2126a9-5b17-4e9d-9c36-75348e49bbe8 in Status: UNINITIALIZED for 2s [ 978.556967] env[65370]: INFO networking_nsxv3.common.synchronization [req-306e7e5b-5201-460e-80f7-eb046dbf922d req-33778dca-ec3a-4192-8540-1407eaeaad00 service nova] Enqueued Resource ID: 23fa7df4-0993-48e9-9080-1087f76da31c with Priority: HIGHEST for action security_group_rules [ 978.557319] env[65370]: INFO networking_nsxv3.common.synchronization [req-306e7e5b-5201-460e-80f7-eb046dbf922d req-33778dca-ec3a-4192-8540-1407eaeaad00 service nova] Enqueued Resource ID: 23fa7df4-0993-48e9-9080-1087f76da31c with Priority: HIGHEST for action security_group_members [ 978.557319] env[65370]: INFO networking_nsxv3.common.synchronization [req-306e7e5b-5201-460e-80f7-eb046dbf922d req-33778dca-ec3a-4192-8540-1407eaeaad00 service nova] Enqueued Resource ID: 0f395508-a192-4c51-b7c2-7bf32466c5b8 with Priority: HIGHEST for action port [ 978.557408] env[65370]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 23fa7df4-0993-48e9-9080-1087f76da31c with Priority: HIGHEST for action security_group_rules [ 978.557535] env[65370]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 23fa7df4-0993-48e9-9080-1087f76da31c with Priority: HIGHEST for action security_group_members [ 978.557628] env[65370]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0f395508-a192-4c51-b7c2-7bf32466c5b8 with Priority: HIGHEST for action port [ 978.558225] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock rules-23fa7df4-0993-48e9-9080-1087f76da31c taken with stack trace [, , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 978.558401] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-23fa7df4-0993-48e9-9080-1087f76da31c" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 978.558444] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-23fa7df4-0993-48e9-9080-1087f76da31c" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 978.558694] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-23fa7df4-0993-48e9-9080-1087f76da31c" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 978.558694] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('23fa7df4-0993-48e9-9080-1087f76da31c',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 978.559969] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock member-23fa7df4-0993-48e9-9080-1087f76da31c taken with stack trace [, , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 978.560099] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-23fa7df4-0993-48e9-9080-1087f76da31c" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 978.560169] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-23fa7df4-0993-48e9-9080-1087f76da31c" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 978.560334] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-23fa7df4-0993-48e9-9080-1087f76da31c" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 978.560489] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 978.560585] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 978.560647] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 978.560821] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 978.560911] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 978.561033] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('23fa7df4-0993-48e9-9080-1087f76da31c',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 978.561736] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock port-0f395508-a192-4c51-b7c2-7bf32466c5b8 taken with stack trace [, , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 978.561842] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-0f395508-a192-4c51-b7c2-7bf32466c5b8" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 978.561975] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-0f395508-a192-4c51-b7c2-7bf32466c5b8" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 978.562072] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-0f395508-a192-4c51-b7c2-7bf32466c5b8" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 978.562144] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0f395508-a192-4c51-b7c2-7bf32466c5b8',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 978.578295] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 4af44c1a-b1dd-4cdd-a946-db31056975f5 [ 978.578511] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 978.578639] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 978.578698] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 978.578904] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 978.579031] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 978.579151] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:4af44c1a-b1dd-4cdd-a946-db31056975f5 already deleted. [ 978.579241] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-4af44c1a-b1dd-4cdd-a946-db31056975f5" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 979.063786] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('23fa7df4-0993-48e9-9080-1087f76da31c',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 979.064323] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock member-23fa7df4-0993-48e9-9080-1087f76da31c taken with stack trace [, , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 979.064436] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-23fa7df4-0993-48e9-9080-1087f76da31c" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 979.065058] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 0f395508-a192-4c51-b7c2-7bf32466c5b8 with status ACTIVE [ 979.065058] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 979.065243] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 979.065243] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 979.065402] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 979.065488] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 979.065649] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 979.065740] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 979.065800] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 979.065949] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 979.066038] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 979.066213] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 979.066299] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 979.066364] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 979.066958] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 979.066958] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 979.066958] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 0f395508-a192-4c51-b7c2-7bf32466c5b8 is going to be updated. [ 979.088462] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 979.088625] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 979.088699] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 979.088891] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 979.089041] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 979.089206] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-0f395508-a192-4c51-b7c2-7bf32466c5b8" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 979.560509] env[65370]: INFO networking_nsxv3.common.synchronization [None req-292d99b1-b4e0-42e9-9b2b-364998bd8e77 tempest-ServerDiskConfigTestJSON-902849627 tempest-ServerDiskConfigTestJSON-902849627-project-member] Enqueued Resource ID: 490b322b-6ef7-4b8c-a5c3-1803d53ec184 with Priority: HIGHEST for action security_group_rules [ 979.560968] env[65370]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 490b322b-6ef7-4b8c-a5c3-1803d53ec184 with Priority: HIGHEST for action security_group_rules [ 979.561276] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock rules-490b322b-6ef7-4b8c-a5c3-1803d53ec184 taken with stack trace [, , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 979.561400] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-490b322b-6ef7-4b8c-a5c3-1803d53ec184" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 979.561467] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-490b322b-6ef7-4b8c-a5c3-1803d53ec184" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 979.561721] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-490b322b-6ef7-4b8c-a5c3-1803d53ec184" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 979.561830] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('490b322b-6ef7-4b8c-a5c3-1803d53ec184',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 979.565473] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('23fa7df4-0993-48e9-9080-1087f76da31c',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 979.668794] env[65370]: INFO networking_nsxv3.common.synchronization [None req-a2567037-d462-4787-9a90-615d2209aeab tempest-ServerDiskConfigTestJSON-902849627 tempest-ServerDiskConfigTestJSON-902849627-project-member] Enqueued Resource ID: 490b322b-6ef7-4b8c-a5c3-1803d53ec184 with Priority: HIGHEST for action security_group_rules [ 979.669502] env[65370]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 490b322b-6ef7-4b8c-a5c3-1803d53ec184 with Priority: HIGHEST for action security_group_rules [ 979.669813] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock rules-490b322b-6ef7-4b8c-a5c3-1803d53ec184 taken with stack trace [, , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 979.669917] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-490b322b-6ef7-4b8c-a5c3-1803d53ec184" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 980.068107] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 980.068437] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 980.068437] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 980.068613] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 980.068613] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 980.068764] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 23fa7df4-0993-48e9-9080-1087f76da31c is going to be created. [ 980.085321] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 980.085471] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 980.085584] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 980.085836] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 980.085890] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 980.085979] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 490b322b-6ef7-4b8c-a5c3-1803d53ec184 already deleted. [ 980.086077] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-490b322b-6ef7-4b8c-a5c3-1803d53ec184" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 980.086725] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-490b322b-6ef7-4b8c-a5c3-1803d53ec184" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 980.086725] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-490b322b-6ef7-4b8c-a5c3-1803d53ec184" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 980.086725] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('490b322b-6ef7-4b8c-a5c3-1803d53ec184',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 980.095050] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 980.095050] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 980.095050] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 980.095050] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 980.095050] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 980.103881] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 23fa7df4-0993-48e9-9080-1087f76da31c in Status: UNINITIALIZED for 2s [ 980.153504] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5b2126a9-5b17-4e9d-9c36-75348e49bbe8 in Status: SUCCESS [ 980.153504] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5b2126a9-5b17-4e9d-9c36-75348e49bbe8" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 980.153504] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5b2126a9-5b17-4e9d-9c36-75348e49bbe8" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 980.153504] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5b2126a9-5b17-4e9d-9c36-75348e49bbe8" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 980.153504] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 980.153504] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 980.153504] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 980.153504] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 980.153504] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 980.153504] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5b2126a9-5b17-4e9d-9c36-75348e49bbe8" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 980.153504] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('5b2126a9-5b17-4e9d-9c36-75348e49bbe8',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 980.607191] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 980.607435] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 980.607435] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 980.607566] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 980.607657] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 980.607755] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 490b322b-6ef7-4b8c-a5c3-1803d53ec184 already deleted. [ 980.607832] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-490b322b-6ef7-4b8c-a5c3-1803d53ec184" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 980.658432] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock member-5b2126a9-5b17-4e9d-9c36-75348e49bbe8 taken with stack trace [, , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 980.658589] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5b2126a9-5b17-4e9d-9c36-75348e49bbe8" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 980.658661] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5b2126a9-5b17-4e9d-9c36-75348e49bbe8" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 980.658875] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5b2126a9-5b17-4e9d-9c36-75348e49bbe8" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 980.659054] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 980.659160] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 980.659247] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 980.659396] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 980.659483] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 980.659569] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5b2126a9-5b17-4e9d-9c36-75348e49bbe8" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 980.659713] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock member-5b2126a9-5b17-4e9d-9c36-75348e49bbe8 taken with stack trace [, , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 980.659806] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5b2126a9-5b17-4e9d-9c36-75348e49bbe8" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 980.659864] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5b2126a9-5b17-4e9d-9c36-75348e49bbe8" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 980.660030] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5b2126a9-5b17-4e9d-9c36-75348e49bbe8" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 980.660175] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 980.660265] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 980.660329] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 980.660465] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 980.660537] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 980.660614] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5b2126a9-5b17-4e9d-9c36-75348e49bbe8" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 980.660700] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('5b2126a9-5b17-4e9d-9c36-75348e49bbe8',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 981.163286] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 5b2126a9-5b17-4e9d-9c36-75348e49bbe8: rpc.has_security_group_logging(os_id): False [ 981.184186] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 981.184349] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 981.184455] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 981.184650] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 981.184736] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 981.185094] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 981.185208] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 981.185333] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 981.185430] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 981.185509] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 981.185707] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 981.185803] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 981.185916] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 981.186148] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 981.186148] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 981.186376] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 981.186526] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 981.186526] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 981.186696] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 981.186799] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 981.186799] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 5b2126a9-5b17-4e9d-9c36-75348e49bbe8 is going to be created. [ 981.269271] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 981.269562] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 981.269562] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 981.270252] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 981.270252] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 981.285159] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 5b2126a9-5b17-4e9d-9c36-75348e49bbe8 in Status: IN_PROGRESS for 2s [ 981.853262] env[65370]: INFO networking_nsxv3.common.synchronization [req-c77ab7d6-4d4d-4328-b85d-bf5ce2db0619 req-f540d56e-3ad2-4396-b8ea-7747db103463 tempest-ServerActionsTestOtherB-1099767447 tempest-ServerActionsTestOtherB-1099767447-project-member] Enqueued Resource ID: 2011abd7-ba10-4aae-84fb-1b1bfbd238fa with Priority: HIGHEST for action security_group_members [ 981.854414] env[65370]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2011abd7-ba10-4aae-84fb-1b1bfbd238fa with Priority: HIGHEST for action security_group_members [ 981.854414] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock member-2011abd7-ba10-4aae-84fb-1b1bfbd238fa taken with stack trace [, , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 981.854414] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2011abd7-ba10-4aae-84fb-1b1bfbd238fa" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 981.854630] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2011abd7-ba10-4aae-84fb-1b1bfbd238fa" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 981.854738] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2011abd7-ba10-4aae-84fb-1b1bfbd238fa" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 981.855030] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 981.855103] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 981.855156] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 981.855306] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 981.855392] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 981.855478] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2011abd7-ba10-4aae-84fb-1b1bfbd238fa',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 982.117087] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 23fa7df4-0993-48e9-9080-1087f76da31c in Status: SUCCESS [ 982.117358] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-23fa7df4-0993-48e9-9080-1087f76da31c" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 982.117536] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-23fa7df4-0993-48e9-9080-1087f76da31c" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 982.117779] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-23fa7df4-0993-48e9-9080-1087f76da31c" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 982.117978] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 982.118168] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 982.118247] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 982.118424] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 982.118538] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 982.118682] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-23fa7df4-0993-48e9-9080-1087f76da31c" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 982.118799] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('23fa7df4-0993-48e9-9080-1087f76da31c',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 982.254531] env[65370]: DEBUG networking_nsxv3.common.locking [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Lock network-93 taken with stack trace [, , , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 982.255393] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquiring lock "network-93" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 982.255393] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquired lock "network-93" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 982.255587] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquired external semaphore "network-93" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 982.255875] env[65370]: DEBUG networking_nsxv3.common.locking [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 982.256062] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquiring lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 982.256195] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquired lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 982.256437] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquired external semaphore "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 982.256596] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Releasing lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 982.256849] env[65370]: DEBUG dogpile.cache.region [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] No value present for key: 'zone-id' {{(pid=65370) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 982.257551] env[65370]: DEBUG dogpile.lock [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] NeedRegenerationException {{(pid=65370) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 982.257751] env[65370]: DEBUG dogpile.lock [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] no value, waiting for create lock {{(pid=65370) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 982.257751] env[65370]: DEBUG dogpile.lock [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] value creation lock acquired {{(pid=65370) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 982.257879] env[65370]: DEBUG dogpile.cache.region [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] No value present for key: 'zone-id' {{(pid=65370) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 982.257981] env[65370]: DEBUG dogpile.lock [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Calling creation function for not-yet-present value {{(pid=65370) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 982.258155] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 982.282444] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 982.282616] env[65370]: DEBUG dogpile.cache.region [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Cache value generated in 0.024 seconds for key(s): 'zone-id' {{(pid=65370) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 982.282751] env[65370]: DEBUG dogpile.lock [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Released creation lock {{(pid=65370) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 982.282945] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Releasing lock "network-93" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 982.283295] env[65370]: DEBUG networking_nsxv3.common.locking [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Lock port-306f18b1-ab23-4d01-9ce6-2396ab985909 taken with stack trace [, , , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 982.283469] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquiring lock "port-306f18b1-ab23-4d01-9ce6-2396ab985909" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 982.283586] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquired lock "port-306f18b1-ab23-4d01-9ce6-2396ab985909" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 982.283989] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquired external semaphore "port-306f18b1-ab23-4d01-9ce6-2396ab985909" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 982.284145] env[65370]: DEBUG networking_nsxv3.api.rpc [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('306f18b1-ab23-4d01-9ce6-2396ab985909',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 982.358531] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 982.358531] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 982.358766] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 982.358962] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 982.359134] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 982.359442] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 982.359734] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 982.359734] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 982.359994] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 982.360147] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 982.360323] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2011abd7-ba10-4aae-84fb-1b1bfbd238fa is going to be updated. [ 982.392519] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 982.392721] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 982.392795] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 982.393036] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 982.393302] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 982.405736] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2011abd7-ba10-4aae-84fb-1b1bfbd238fa in Status: IN_PROGRESS for 2s [ 982.621239] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('23fa7df4-0993-48e9-9080-1087f76da31c',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 982.787447] env[65370]: DEBUG networking_nsxv3.common.locking [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 982.787733] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquiring lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 982.788071] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquired lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 982.788388] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquired external semaphore "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 982.789183] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Releasing lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 982.789183] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Segment Port 306f18b1-ab23-4d01-9ce6-2396ab985909 not found, creating... [ 982.789588] env[65370]: DEBUG networking_nsxv3.common.locking [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 982.789698] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquiring lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 982.789868] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquired lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 982.790218] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquired external semaphore "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 982.790429] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Releasing lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 982.790842] env[65370]: DEBUG networking_nsxv3.common.locking [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 982.791113] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquiring lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 982.791301] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquired lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 982.791627] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquired external semaphore "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 982.791820] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Releasing lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 982.792041] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Resource: SegmentPort with ID: 306f18b1-ab23-4d01-9ce6-2396ab985909 is going to be created. [ 982.816147] env[65370]: DEBUG networking_nsxv3.common.locking [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 982.816490] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquiring lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 982.816611] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquired lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 982.817059] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquired external semaphore "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 982.817176] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Releasing lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 982.817403] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Releasing lock "port-306f18b1-ab23-4d01-9ce6-2396ab985909" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 983.123712] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 23fa7df4-0993-48e9-9080-1087f76da31c: rpc.has_security_group_logging(os_id): False [ 983.144336] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 983.144336] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 983.144336] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 983.144574] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 983.144574] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 983.145037] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 983.145037] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 983.145037] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 983.145882] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 983.145882] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 983.145882] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 23fa7df4-0993-48e9-9080-1087f76da31c is going to be created. [ 983.158664] env[65370]: INFO networking_nsxv3.common.synchronization [req-fc8b41b4-392c-42d1-9f81-4c97733dd53a req-6c95ba23-aaee-47a1-8326-f48a42f5ba07 tempest-ServerDiskConfigTestJSON-902849627 tempest-ServerDiskConfigTestJSON-902849627-project-member] Enqueued Resource ID: 420136f3-91df-4669-b5e3-cee436aeacb9 with Priority: HIGHEST for action security_group_members [ 983.159847] env[65370]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 420136f3-91df-4669-b5e3-cee436aeacb9 with Priority: HIGHEST for action security_group_members [ 983.161033] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock member-420136f3-91df-4669-b5e3-cee436aeacb9 taken with stack trace [, , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 983.161033] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-420136f3-91df-4669-b5e3-cee436aeacb9" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 983.161033] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-420136f3-91df-4669-b5e3-cee436aeacb9" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 983.161033] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-420136f3-91df-4669-b5e3-cee436aeacb9" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 983.161033] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 983.161033] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 983.161448] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 983.161448] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 983.161448] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 983.161448] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('420136f3-91df-4669-b5e3-cee436aeacb9',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 983.207372] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 983.207575] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 983.207575] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 983.207853] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 983.208171] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 983.223465] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 23fa7df4-0993-48e9-9080-1087f76da31c in Status: IN_PROGRESS for 2s [ 983.314730] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 5b2126a9-5b17-4e9d-9c36-75348e49bbe8 in Status: SUCCESS [ 983.314730] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-5b2126a9-5b17-4e9d-9c36-75348e49bbe8" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 983.536494] env[65370]: INFO networking_nsxv3.common.synchronization [req-6535af8b-d6e9-4a14-adbe-896b592dd53a req-fd047ecf-0899-4448-a0fa-cafe5973e10f tempest-AttachInterfacesV270Test-2119411272 tempest-AttachInterfacesV270Test-2119411272-project-member] Enqueued Resource ID: 361130b7-6514-4c56-97c2-909bb5c1a95f with Priority: HIGHEST for action security_group_members [ 983.537317] env[65370]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 361130b7-6514-4c56-97c2-909bb5c1a95f with Priority: HIGHEST for action security_group_members [ 983.537426] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock member-361130b7-6514-4c56-97c2-909bb5c1a95f taken with stack trace [, , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 983.537496] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-361130b7-6514-4c56-97c2-909bb5c1a95f" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 983.537534] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-361130b7-6514-4c56-97c2-909bb5c1a95f" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 983.537749] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-361130b7-6514-4c56-97c2-909bb5c1a95f" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 983.538117] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 983.538117] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 983.538117] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 983.538274] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 983.538311] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 983.538403] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('361130b7-6514-4c56-97c2-909bb5c1a95f',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 983.596844] env[65370]: INFO networking_nsxv3.common.synchronization [req-c77ab7d6-4d4d-4328-b85d-bf5ce2db0619 req-67b57531-190d-4bfd-85c5-9edfa3d7c847 service nova] Enqueued Resource ID: 2011abd7-ba10-4aae-84fb-1b1bfbd238fa with Priority: HIGHEST for action security_group_rules [ 983.597064] env[65370]: INFO networking_nsxv3.common.synchronization [req-c77ab7d6-4d4d-4328-b85d-bf5ce2db0619 req-67b57531-190d-4bfd-85c5-9edfa3d7c847 service nova] Enqueued Resource ID: 2011abd7-ba10-4aae-84fb-1b1bfbd238fa with Priority: HIGHEST for action security_group_members [ 983.597258] env[65370]: INFO networking_nsxv3.common.synchronization [req-c77ab7d6-4d4d-4328-b85d-bf5ce2db0619 req-67b57531-190d-4bfd-85c5-9edfa3d7c847 service nova] Enqueued Resource ID: 306f18b1-ab23-4d01-9ce6-2396ab985909 with Priority: HIGHEST for action port [ 983.597771] env[65370]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2011abd7-ba10-4aae-84fb-1b1bfbd238fa with Priority: HIGHEST for action security_group_rules [ 983.597948] env[65370]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2011abd7-ba10-4aae-84fb-1b1bfbd238fa with Priority: HIGHEST for action security_group_members [ 983.598144] env[65370]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 306f18b1-ab23-4d01-9ce6-2396ab985909 with Priority: HIGHEST for action port [ 983.598397] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock rules-2011abd7-ba10-4aae-84fb-1b1bfbd238fa taken with stack trace [, , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 983.598521] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-2011abd7-ba10-4aae-84fb-1b1bfbd238fa" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 983.598578] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-2011abd7-ba10-4aae-84fb-1b1bfbd238fa" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 983.598823] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-2011abd7-ba10-4aae-84fb-1b1bfbd238fa" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 983.598867] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('2011abd7-ba10-4aae-84fb-1b1bfbd238fa',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 983.601163] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock member-2011abd7-ba10-4aae-84fb-1b1bfbd238fa taken with stack trace [, , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 983.601163] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2011abd7-ba10-4aae-84fb-1b1bfbd238fa" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 983.601163] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock port-306f18b1-ab23-4d01-9ce6-2396ab985909 taken with stack trace [, , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 983.601163] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-306f18b1-ab23-4d01-9ce6-2396ab985909" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 983.601163] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-306f18b1-ab23-4d01-9ce6-2396ab985909" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 983.601574] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-306f18b1-ab23-4d01-9ce6-2396ab985909" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 983.601574] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('306f18b1-ab23-4d01-9ce6-2396ab985909',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 983.664443] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 983.664613] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 983.664675] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 983.664896] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 983.665026] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 983.665261] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 983.665358] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 983.665418] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 983.665585] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 983.665665] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 983.665750] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 420136f3-91df-4669-b5e3-cee436aeacb9 is going to be updated. [ 983.696221] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 983.696393] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 983.696393] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 983.696695] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 983.696894] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 983.707656] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 420136f3-91df-4669-b5e3-cee436aeacb9 in Status: IN_PROGRESS for 2s [ 984.040916] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 984.041173] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 984.041314] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 984.041625] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 984.041752] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 984.042051] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 984.042210] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 984.042283] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 984.042466] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 984.042553] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 984.042651] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 361130b7-6514-4c56-97c2-909bb5c1a95f is going to be updated. [ 984.084646] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 984.084646] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 984.085013] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 984.085348] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 984.085643] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 984.095864] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 361130b7-6514-4c56-97c2-909bb5c1a95f in Status: IN_PROGRESS for 2s [ 984.103553] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock member-2011abd7-ba10-4aae-84fb-1b1bfbd238fa taken with stack trace [, , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 984.103731] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2011abd7-ba10-4aae-84fb-1b1bfbd238fa" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 984.106011] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 306f18b1-ab23-4d01-9ce6-2396ab985909 with status ACTIVE [ 984.106209] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 984.106337] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 984.106405] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 984.106613] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 984.106703] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 984.106898] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 984.107012] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 984.107125] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 984.107247] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 984.107325] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 984.107507] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 984.107601] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 984.107660] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 984.107794] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 984.107867] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 984.107966] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 306f18b1-ab23-4d01-9ce6-2396ab985909 is going to be updated. [ 984.135540] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 984.135540] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 984.135540] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 984.135540] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 984.135540] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 984.135540] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-306f18b1-ab23-4d01-9ce6-2396ab985909" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 984.415483] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2011abd7-ba10-4aae-84fb-1b1bfbd238fa in Status: SUCCESS [ 984.415656] env[65370]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2011abd7-ba10-4aae-84fb-1b1bfbd238fa deletion is rescheduled due to dependency. [ 984.415769] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2011abd7-ba10-4aae-84fb-1b1bfbd238fa" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 984.415935] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2011abd7-ba10-4aae-84fb-1b1bfbd238fa" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 984.416161] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2011abd7-ba10-4aae-84fb-1b1bfbd238fa" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 984.416355] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 984.416471] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 984.416535] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 984.417070] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 984.417070] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 984.417070] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2011abd7-ba10-4aae-84fb-1b1bfbd238fa',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 984.918915] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('2011abd7-ba10-4aae-84fb-1b1bfbd238fa',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 985.240682] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 23fa7df4-0993-48e9-9080-1087f76da31c in Status: SUCCESS [ 985.241108] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-23fa7df4-0993-48e9-9080-1087f76da31c" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 985.276262] env[65370]: INFO networking_nsxv3.common.synchronization [req-488b36cf-62f8-4f8d-a067-5c2d922fcb9e req-1e691835-20cc-41c3-a3bc-383f29ccb78e tempest-MultipleCreateTestJSON-1838347642 tempest-MultipleCreateTestJSON-1838347642-project-member] Enqueued Resource ID: 1bc5c407-ee61-45f3-a29e-c586a26bcaff with Priority: HIGHEST for action security_group_members [ 985.276787] env[65370]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1bc5c407-ee61-45f3-a29e-c586a26bcaff with Priority: HIGHEST for action security_group_members [ 985.277470] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock member-1bc5c407-ee61-45f3-a29e-c586a26bcaff taken with stack trace [, , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 985.277470] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1bc5c407-ee61-45f3-a29e-c586a26bcaff" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 985.277470] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1bc5c407-ee61-45f3-a29e-c586a26bcaff" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 985.277669] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1bc5c407-ee61-45f3-a29e-c586a26bcaff" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 985.277855] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 985.277965] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 985.278040] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 985.278198] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 985.278281] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 985.278371] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1bc5c407-ee61-45f3-a29e-c586a26bcaff',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 985.421778] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('2011abd7-ba10-4aae-84fb-1b1bfbd238fa',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 985.652375] env[65370]: DEBUG networking_nsxv3.common.locking [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Lock network-237 taken with stack trace [, , , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 985.652621] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquiring lock "network-237" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 985.652836] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquired lock "network-237" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 985.653227] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquired external semaphore "network-237" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 985.653642] env[65370]: DEBUG networking_nsxv3.common.locking [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 985.653867] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquiring lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 985.654054] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquired lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 985.655226] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquired external semaphore "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 985.655226] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Releasing lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 985.655226] env[65370]: DEBUG dogpile.cache.region [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] No value present for key: 'zone-id' {{(pid=65370) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 985.655226] env[65370]: DEBUG dogpile.lock [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] NeedRegenerationException {{(pid=65370) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 985.655226] env[65370]: DEBUG dogpile.lock [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] no value, waiting for create lock {{(pid=65370) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 985.655226] env[65370]: DEBUG dogpile.lock [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] value creation lock acquired {{(pid=65370) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 985.655226] env[65370]: DEBUG dogpile.cache.region [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] No value present for key: 'zone-id' {{(pid=65370) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 985.655623] env[65370]: DEBUG dogpile.lock [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Calling creation function for not-yet-present value {{(pid=65370) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 985.655623] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 985.677594] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 985.677594] env[65370]: DEBUG dogpile.cache.region [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=65370) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 985.677594] env[65370]: DEBUG dogpile.lock [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Released creation lock {{(pid=65370) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 985.677770] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Releasing lock "network-237" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 985.678042] env[65370]: DEBUG networking_nsxv3.common.locking [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Lock port-da2ddcf1-c82c-4941-b0d3-4faab2c3a71a taken with stack trace [, , , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 985.678256] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquiring lock "port-da2ddcf1-c82c-4941-b0d3-4faab2c3a71a" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 985.678409] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquired lock "port-da2ddcf1-c82c-4941-b0d3-4faab2c3a71a" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 985.678759] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquired external semaphore "port-da2ddcf1-c82c-4941-b0d3-4faab2c3a71a" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 985.678917] env[65370]: DEBUG networking_nsxv3.api.rpc [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('da2ddcf1-c82c-4941-b0d3-4faab2c3a71a',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 985.717060] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 420136f3-91df-4669-b5e3-cee436aeacb9 in Status: SUCCESS [ 985.717231] env[65370]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 420136f3-91df-4669-b5e3-cee436aeacb9 deletion is rescheduled due to dependency. [ 985.717370] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-420136f3-91df-4669-b5e3-cee436aeacb9" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 985.781054] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 985.781054] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 985.781054] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 985.781300] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 985.781300] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 985.781414] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 985.781511] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 985.782064] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 985.782064] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 985.782064] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 985.782064] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1bc5c407-ee61-45f3-a29e-c586a26bcaff is going to be updated. [ 985.829281] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 985.829456] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 985.829549] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 985.829783] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 985.829955] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 985.841999] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1bc5c407-ee61-45f3-a29e-c586a26bcaff in Status: IN_PROGRESS for 2s [ 985.924551] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 985.924759] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 985.924911] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 985.925217] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 985.925374] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 985.925489] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2011abd7-ba10-4aae-84fb-1b1bfbd238fa is going to be updated. [ 985.968430] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 985.968657] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 985.968657] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 985.968860] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 985.969014] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 985.978915] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2011abd7-ba10-4aae-84fb-1b1bfbd238fa in Status: IN_PROGRESS for 2s [ 986.112053] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 361130b7-6514-4c56-97c2-909bb5c1a95f in Status: SUCCESS [ 986.112053] env[65370]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 361130b7-6514-4c56-97c2-909bb5c1a95f deletion is rescheduled due to dependency. [ 986.112053] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-361130b7-6514-4c56-97c2-909bb5c1a95f" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 986.182024] env[65370]: DEBUG networking_nsxv3.common.locking [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 986.182024] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquiring lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 986.182024] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquired lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 986.182490] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquired external semaphore "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 986.182555] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Releasing lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 986.182790] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Segment Port da2ddcf1-c82c-4941-b0d3-4faab2c3a71a not found, creating... [ 986.183226] env[65370]: DEBUG networking_nsxv3.common.locking [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 986.183852] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquiring lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 986.183852] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquired lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 986.183852] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquired external semaphore "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 986.183997] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Releasing lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 986.184764] env[65370]: DEBUG networking_nsxv3.common.locking [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 986.184764] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquiring lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 986.184764] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquired lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 986.184764] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquired external semaphore "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 986.185168] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Releasing lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 986.185168] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Resource: SegmentPort with ID: da2ddcf1-c82c-4941-b0d3-4faab2c3a71a is going to be created. [ 986.227119] env[65370]: DEBUG networking_nsxv3.common.locking [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 986.227119] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquiring lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 986.227298] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquired lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 986.228183] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquired external semaphore "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 986.228508] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Releasing lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 986.228839] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Releasing lock "port-da2ddcf1-c82c-4941-b0d3-4faab2c3a71a" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 986.913259] env[65370]: INFO networking_nsxv3.common.synchronization [req-488b36cf-62f8-4f8d-a067-5c2d922fcb9e req-796717b6-e9e9-444f-9d5b-1dfcced9c8b3 service nova] Enqueued Resource ID: 1bc5c407-ee61-45f3-a29e-c586a26bcaff with Priority: HIGHEST for action security_group_rules [ 986.913259] env[65370]: INFO networking_nsxv3.common.synchronization [req-488b36cf-62f8-4f8d-a067-5c2d922fcb9e req-796717b6-e9e9-444f-9d5b-1dfcced9c8b3 service nova] Enqueued Resource ID: 1bc5c407-ee61-45f3-a29e-c586a26bcaff with Priority: HIGHEST for action security_group_members [ 986.913259] env[65370]: INFO networking_nsxv3.common.synchronization [req-488b36cf-62f8-4f8d-a067-5c2d922fcb9e req-796717b6-e9e9-444f-9d5b-1dfcced9c8b3 service nova] Enqueued Resource ID: da2ddcf1-c82c-4941-b0d3-4faab2c3a71a with Priority: HIGHEST for action port [ 986.913259] env[65370]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1bc5c407-ee61-45f3-a29e-c586a26bcaff with Priority: HIGHEST for action security_group_rules [ 986.913676] env[65370]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1bc5c407-ee61-45f3-a29e-c586a26bcaff with Priority: HIGHEST for action security_group_members [ 986.913709] env[65370]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: da2ddcf1-c82c-4941-b0d3-4faab2c3a71a with Priority: HIGHEST for action port [ 986.914028] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock rules-1bc5c407-ee61-45f3-a29e-c586a26bcaff taken with stack trace [, , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 986.914187] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-1bc5c407-ee61-45f3-a29e-c586a26bcaff" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 986.914258] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-1bc5c407-ee61-45f3-a29e-c586a26bcaff" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 986.914973] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-1bc5c407-ee61-45f3-a29e-c586a26bcaff" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 986.914973] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('1bc5c407-ee61-45f3-a29e-c586a26bcaff',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 986.915562] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock member-1bc5c407-ee61-45f3-a29e-c586a26bcaff taken with stack trace [, , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 986.915824] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1bc5c407-ee61-45f3-a29e-c586a26bcaff" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 986.915973] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock port-da2ddcf1-c82c-4941-b0d3-4faab2c3a71a taken with stack trace [, , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 986.916119] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-da2ddcf1-c82c-4941-b0d3-4faab2c3a71a" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 986.916207] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-da2ddcf1-c82c-4941-b0d3-4faab2c3a71a" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 986.916439] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-da2ddcf1-c82c-4941-b0d3-4faab2c3a71a" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 986.916547] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('da2ddcf1-c82c-4941-b0d3-4faab2c3a71a',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 987.418703] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock member-1bc5c407-ee61-45f3-a29e-c586a26bcaff taken with stack trace [, , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 987.418941] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1bc5c407-ee61-45f3-a29e-c586a26bcaff" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 987.419131] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port da2ddcf1-c82c-4941-b0d3-4faab2c3a71a with status ACTIVE [ 987.420036] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 987.420036] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 987.420036] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 987.420036] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 987.420036] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 987.420036] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 987.420366] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 987.420366] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 987.420366] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 987.420456] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 987.420599] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 987.420691] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 987.420747] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 987.420881] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 987.420951] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 987.421044] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: da2ddcf1-c82c-4941-b0d3-4faab2c3a71a is going to be updated. [ 987.446189] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 987.446523] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 987.446523] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 987.446777] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 987.447030] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 987.447309] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-da2ddcf1-c82c-4941-b0d3-4faab2c3a71a" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 987.855368] env[65370]: INFO networking_nsxv3.common.synchronization [req-488b36cf-62f8-4f8d-a067-5c2d922fcb9e req-3aeedbb6-07d0-436a-abcd-f98a84704f42 tempest-MultipleCreateTestJSON-1838347642 tempest-MultipleCreateTestJSON-1838347642-project-member] Enqueued Resource ID: 1bc5c407-ee61-45f3-a29e-c586a26bcaff with Priority: HIGHEST for action security_group_members [ 987.856650] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1bc5c407-ee61-45f3-a29e-c586a26bcaff in Status: SUCCESS [ 987.856838] env[65370]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1bc5c407-ee61-45f3-a29e-c586a26bcaff deletion is rescheduled due to dependency. [ 987.856967] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1bc5c407-ee61-45f3-a29e-c586a26bcaff" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 987.857542] env[65370]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1bc5c407-ee61-45f3-a29e-c586a26bcaff with Priority: HIGHEST for action security_group_members [ 987.857750] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1bc5c407-ee61-45f3-a29e-c586a26bcaff" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 987.857976] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1bc5c407-ee61-45f3-a29e-c586a26bcaff" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 987.858202] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 987.858340] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 987.858428] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 987.859035] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 987.859035] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 987.859035] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1bc5c407-ee61-45f3-a29e-c586a26bcaff',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 987.860720] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock member-1bc5c407-ee61-45f3-a29e-c586a26bcaff taken with stack trace [, , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 987.860826] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1bc5c407-ee61-45f3-a29e-c586a26bcaff" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 987.990739] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2011abd7-ba10-4aae-84fb-1b1bfbd238fa in Status: SUCCESS [ 987.991421] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2011abd7-ba10-4aae-84fb-1b1bfbd238fa" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 987.992876] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2011abd7-ba10-4aae-84fb-1b1bfbd238fa" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 987.992876] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2011abd7-ba10-4aae-84fb-1b1bfbd238fa" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 987.992876] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 987.992876] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 987.992876] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 987.992876] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 987.992876] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 987.992876] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2011abd7-ba10-4aae-84fb-1b1bfbd238fa" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 987.992876] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('2011abd7-ba10-4aae-84fb-1b1bfbd238fa',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 988.261757] env[65370]: DEBUG networking_nsxv3.common.locking [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Lock network-237 taken with stack trace [, , , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 988.261958] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquiring lock "network-237" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 988.262097] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquired lock "network-237" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 988.262373] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquired external semaphore "network-237" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 988.262651] env[65370]: DEBUG networking_nsxv3.common.locking [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 988.262798] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquiring lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 988.262913] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquired lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 988.263658] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquired external semaphore "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 988.263871] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Releasing lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 988.265248] env[65370]: DEBUG dogpile.cache.region [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] No value present for key: 'zone-id' {{(pid=65370) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 988.265371] env[65370]: DEBUG dogpile.lock [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] NeedRegenerationException {{(pid=65370) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 988.265476] env[65370]: DEBUG dogpile.lock [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] no value, waiting for create lock {{(pid=65370) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 988.265597] env[65370]: DEBUG dogpile.lock [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] value creation lock acquired {{(pid=65370) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 988.265706] env[65370]: DEBUG dogpile.cache.region [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] No value present for key: 'zone-id' {{(pid=65370) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 988.265815] env[65370]: DEBUG dogpile.lock [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Calling creation function for not-yet-present value {{(pid=65370) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 988.266168] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 988.288547] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 988.288856] env[65370]: DEBUG dogpile.cache.region [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=65370) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 988.289054] env[65370]: DEBUG dogpile.lock [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Released creation lock {{(pid=65370) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 988.289733] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Releasing lock "network-237" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 988.289733] env[65370]: DEBUG networking_nsxv3.common.locking [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Lock port-d555017f-60fc-4077-bc7c-863db67fa92c taken with stack trace [, , , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 988.289960] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquiring lock "port-d555017f-60fc-4077-bc7c-863db67fa92c" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 988.290128] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquired lock "port-d555017f-60fc-4077-bc7c-863db67fa92c" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 988.290571] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquired external semaphore "port-d555017f-60fc-4077-bc7c-863db67fa92c" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 988.290753] env[65370]: DEBUG networking_nsxv3.api.rpc [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d555017f-60fc-4077-bc7c-863db67fa92c',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 988.360946] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('1bc5c407-ee61-45f3-a29e-c586a26bcaff',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 988.502402] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('2011abd7-ba10-4aae-84fb-1b1bfbd238fa',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 988.793752] env[65370]: DEBUG networking_nsxv3.common.locking [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 988.793939] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquiring lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 988.794032] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquired lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 988.794263] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquired external semaphore "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 988.794414] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Releasing lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 988.794564] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Segment Port d555017f-60fc-4077-bc7c-863db67fa92c not found, creating... [ 988.794813] env[65370]: DEBUG networking_nsxv3.common.locking [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 988.794964] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquiring lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 988.795145] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquired lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 988.795342] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquired external semaphore "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 988.795482] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Releasing lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 988.795765] env[65370]: DEBUG networking_nsxv3.common.locking [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 988.795919] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquiring lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 988.796053] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquired lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 988.796410] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquired external semaphore "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 988.796410] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Releasing lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 988.796566] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Resource: SegmentPort with ID: d555017f-60fc-4077-bc7c-863db67fa92c is going to be created. [ 988.816440] env[65370]: DEBUG networking_nsxv3.common.locking [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 988.816650] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquiring lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 988.816763] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquired lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 988.817128] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquired external semaphore "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 988.817376] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Releasing lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 988.817597] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Releasing lock "port-d555017f-60fc-4077-bc7c-863db67fa92c" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 988.864436] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('1bc5c407-ee61-45f3-a29e-c586a26bcaff',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 989.005671] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 2011abd7-ba10-4aae-84fb-1b1bfbd238fa: rpc.has_security_group_logging(os_id): False [ 989.025498] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 989.025735] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 989.026070] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 989.026279] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 989.026384] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 989.026903] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 989.026903] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 989.027076] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 989.027244] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 989.027453] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 989.027572] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 2011abd7-ba10-4aae-84fb-1b1bfbd238fa is going to be updated. [ 989.103367] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 989.103568] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 989.103568] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 989.103786] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 989.103929] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 989.116643] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 2011abd7-ba10-4aae-84fb-1b1bfbd238fa in Status: IN_PROGRESS for 2s [ 989.330945] env[65370]: INFO networking_nsxv3.common.synchronization [req-263585fc-6302-4ee2-a985-13c526cf92c7 req-fc08245d-47af-48f1-87c8-d051d8b52385 tempest-ServerDiagnosticsTest-1182163202 tempest-ServerDiagnosticsTest-1182163202-project-member] Enqueued Resource ID: 5b2126a9-5b17-4e9d-9c36-75348e49bbe8 with Priority: HIGHEST for action security_group_members [ 989.331305] env[65370]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5b2126a9-5b17-4e9d-9c36-75348e49bbe8 with Priority: HIGHEST for action security_group_members [ 989.331641] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock member-5b2126a9-5b17-4e9d-9c36-75348e49bbe8 taken with stack trace [, , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 989.331771] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5b2126a9-5b17-4e9d-9c36-75348e49bbe8" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 989.332308] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5b2126a9-5b17-4e9d-9c36-75348e49bbe8" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 989.332308] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5b2126a9-5b17-4e9d-9c36-75348e49bbe8" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 989.332308] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 989.332308] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 989.332514] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 989.332514] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 989.336187] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 989.336187] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5b2126a9-5b17-4e9d-9c36-75348e49bbe8',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 989.365998] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 989.366210] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 989.366255] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 989.366432] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 989.366520] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 989.366625] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1bc5c407-ee61-45f3-a29e-c586a26bcaff is going to be updated. [ 989.398605] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 989.398755] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 989.398839] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 989.399336] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 989.399489] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 989.409082] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1bc5c407-ee61-45f3-a29e-c586a26bcaff in Status: IN_PROGRESS for 2s [ 989.548901] env[65370]: INFO networking_nsxv3.common.synchronization [req-488b36cf-62f8-4f8d-a067-5c2d922fcb9e req-25e3b503-01e7-44b5-9a14-02768f975d38 service nova] Enqueued Resource ID: 1bc5c407-ee61-45f3-a29e-c586a26bcaff with Priority: HIGHEST for action security_group_rules [ 989.549055] env[65370]: INFO networking_nsxv3.common.synchronization [req-488b36cf-62f8-4f8d-a067-5c2d922fcb9e req-25e3b503-01e7-44b5-9a14-02768f975d38 service nova] Enqueued Resource ID: 1bc5c407-ee61-45f3-a29e-c586a26bcaff with Priority: HIGHEST for action security_group_members [ 989.549202] env[65370]: INFO networking_nsxv3.common.synchronization [req-488b36cf-62f8-4f8d-a067-5c2d922fcb9e req-25e3b503-01e7-44b5-9a14-02768f975d38 service nova] Enqueued Resource ID: d555017f-60fc-4077-bc7c-863db67fa92c with Priority: HIGHEST for action port [ 989.549889] env[65370]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1bc5c407-ee61-45f3-a29e-c586a26bcaff with Priority: HIGHEST for action security_group_rules [ 989.549990] env[65370]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1bc5c407-ee61-45f3-a29e-c586a26bcaff with Priority: HIGHEST for action security_group_members [ 989.550055] env[65370]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d555017f-60fc-4077-bc7c-863db67fa92c with Priority: HIGHEST for action port [ 989.550344] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock rules-1bc5c407-ee61-45f3-a29e-c586a26bcaff taken with stack trace [, , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 989.550600] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-1bc5c407-ee61-45f3-a29e-c586a26bcaff" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 989.550737] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock member-1bc5c407-ee61-45f3-a29e-c586a26bcaff taken with stack trace [, , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 989.550874] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1bc5c407-ee61-45f3-a29e-c586a26bcaff" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 989.550953] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock port-d555017f-60fc-4077-bc7c-863db67fa92c taken with stack trace [, , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 989.551060] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-d555017f-60fc-4077-bc7c-863db67fa92c" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 989.551131] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-d555017f-60fc-4077-bc7c-863db67fa92c" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 989.551350] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-d555017f-60fc-4077-bc7c-863db67fa92c" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 989.551430] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d555017f-60fc-4077-bc7c-863db67fa92c',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 989.838455] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 989.838639] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 989.838639] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 989.839221] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 989.839221] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 989.839221] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 989.839221] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 989.839448] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 989.839448] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 989.839507] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 989.839565] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5b2126a9-5b17-4e9d-9c36-75348e49bbe8 is going to be updated. [ 989.872842] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 989.872842] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 989.872842] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 989.872842] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 989.872842] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 989.882035] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5b2126a9-5b17-4e9d-9c36-75348e49bbe8 in Status: IN_PROGRESS for 2s [ 990.054233] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port d555017f-60fc-4077-bc7c-863db67fa92c with status ACTIVE [ 990.054538] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 990.054616] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 990.054696] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 990.054903] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 990.054994] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 990.055195] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 990.055295] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 990.055354] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 990.055498] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 990.055572] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 990.055751] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 990.055841] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 990.055899] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 990.056542] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 990.056542] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 990.056542] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: d555017f-60fc-4077-bc7c-863db67fa92c is going to be updated. [ 990.081598] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 990.081803] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 990.081803] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 990.082078] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 990.082252] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 990.082438] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-d555017f-60fc-4077-bc7c-863db67fa92c" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 991.131259] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 2011abd7-ba10-4aae-84fb-1b1bfbd238fa in Status: SUCCESS [ 991.131635] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-2011abd7-ba10-4aae-84fb-1b1bfbd238fa" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 991.419777] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1bc5c407-ee61-45f3-a29e-c586a26bcaff in Status: SUCCESS [ 991.419994] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1bc5c407-ee61-45f3-a29e-c586a26bcaff" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 991.420181] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1bc5c407-ee61-45f3-a29e-c586a26bcaff" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 991.420403] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1bc5c407-ee61-45f3-a29e-c586a26bcaff" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 991.420585] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 991.421252] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 991.421252] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 991.421252] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 991.421252] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 991.421252] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1bc5c407-ee61-45f3-a29e-c586a26bcaff" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 991.421252] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('1bc5c407-ee61-45f3-a29e-c586a26bcaff',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 991.422676] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1bc5c407-ee61-45f3-a29e-c586a26bcaff" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 991.422870] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1bc5c407-ee61-45f3-a29e-c586a26bcaff" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 991.423061] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 991.423175] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 991.423238] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 991.423380] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 991.423584] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 991.423686] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1bc5c407-ee61-45f3-a29e-c586a26bcaff',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 991.893215] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5b2126a9-5b17-4e9d-9c36-75348e49bbe8 in Status: SUCCESS [ 991.893435] env[65370]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5b2126a9-5b17-4e9d-9c36-75348e49bbe8 deletion is rescheduled due to dependency. [ 991.893541] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5b2126a9-5b17-4e9d-9c36-75348e49bbe8" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 991.923314] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock member-1bc5c407-ee61-45f3-a29e-c586a26bcaff taken with stack trace [, , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 991.923747] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1bc5c407-ee61-45f3-a29e-c586a26bcaff" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 991.926341] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('1bc5c407-ee61-45f3-a29e-c586a26bcaff',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 992.428827] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('1bc5c407-ee61-45f3-a29e-c586a26bcaff',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 992.933303] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 992.933303] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 992.933303] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 992.933303] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 992.933303] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 992.933303] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1bc5c407-ee61-45f3-a29e-c586a26bcaff is going to be updated. [ 992.963507] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 992.966217] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 992.966882] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 992.967185] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 992.967359] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 992.977959] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1bc5c407-ee61-45f3-a29e-c586a26bcaff in Status: IN_PROGRESS for 2s [ 994.551437] env[65370]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 994.551828] env[65370]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=4 [ 994.759743] env[65370]: INFO networking_nsxv3.common.synchronization [req-a4699295-9cc7-4ebd-ab1a-dd84ed6f9b99 req-b09c2249-af71-410b-a448-d91fe4c636fb tempest-ServersNegativeTestJSON-226836032 tempest-ServersNegativeTestJSON-226836032-project-member] Enqueued Resource ID: eba16cc3-e8ee-4772-ba0d-2b7b582b7844 with Priority: HIGHEST for action security_group_members [ 994.760592] env[65370]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: eba16cc3-e8ee-4772-ba0d-2b7b582b7844 with Priority: HIGHEST for action security_group_members [ 994.761047] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock member-eba16cc3-e8ee-4772-ba0d-2b7b582b7844 taken with stack trace [, , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 994.761307] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-eba16cc3-e8ee-4772-ba0d-2b7b582b7844" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 994.761481] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-eba16cc3-e8ee-4772-ba0d-2b7b582b7844" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 994.762272] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-eba16cc3-e8ee-4772-ba0d-2b7b582b7844" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 994.762272] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 994.762272] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 994.762272] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 994.762658] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 994.762838] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 994.763033] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('eba16cc3-e8ee-4772-ba0d-2b7b582b7844',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 994.991029] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1bc5c407-ee61-45f3-a29e-c586a26bcaff in Status: SUCCESS [ 994.991258] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1bc5c407-ee61-45f3-a29e-c586a26bcaff" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 994.991439] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1bc5c407-ee61-45f3-a29e-c586a26bcaff" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 994.991665] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1bc5c407-ee61-45f3-a29e-c586a26bcaff" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 994.991851] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 994.991983] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 994.992063] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 994.992230] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 994.992334] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 994.992434] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1bc5c407-ee61-45f3-a29e-c586a26bcaff',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 995.265751] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 995.265751] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 995.265751] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 995.266365] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 995.266549] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 995.266956] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 995.267108] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 995.267229] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 995.268046] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 995.268293] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 995.268455] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: eba16cc3-e8ee-4772-ba0d-2b7b582b7844 already deleted. [ 995.269073] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-eba16cc3-e8ee-4772-ba0d-2b7b582b7844" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 995.296037] env[65370]: DEBUG networking_nsxv3.common.locking [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Lock network-611 taken with stack trace [, , , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 995.296037] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquiring lock "network-611" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 995.296294] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquired lock "network-611" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 995.296726] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquired external semaphore "network-611" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 995.297335] env[65370]: DEBUG networking_nsxv3.common.locking [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 995.297634] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquiring lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 995.297971] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquired lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 995.298490] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquired external semaphore "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 995.299099] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Releasing lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 995.299422] env[65370]: DEBUG dogpile.cache.region [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] No value present for key: 'zone-id' {{(pid=65370) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 995.299525] env[65370]: DEBUG dogpile.lock [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] NeedRegenerationException {{(pid=65370) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 995.300149] env[65370]: DEBUG dogpile.lock [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] no value, waiting for create lock {{(pid=65370) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 995.300149] env[65370]: DEBUG dogpile.lock [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] value creation lock acquired {{(pid=65370) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 995.300338] env[65370]: DEBUG dogpile.cache.region [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] No value present for key: 'zone-id' {{(pid=65370) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 995.300536] env[65370]: DEBUG dogpile.lock [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Calling creation function for not-yet-present value {{(pid=65370) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 995.301012] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 995.325831] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 995.328320] env[65370]: DEBUG dogpile.cache.region [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Cache value generated in 0.026 seconds for key(s): 'zone-id' {{(pid=65370) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 995.328320] env[65370]: DEBUG dogpile.lock [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Released creation lock {{(pid=65370) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 995.328616] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Releasing lock "network-611" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 995.329052] env[65370]: DEBUG networking_nsxv3.common.locking [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Lock port-f94879de-dc14-4034-9d4b-ab2f91d6de6a taken with stack trace [, , , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 995.329289] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquiring lock "port-f94879de-dc14-4034-9d4b-ab2f91d6de6a" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 995.329950] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquired lock "port-f94879de-dc14-4034-9d4b-ab2f91d6de6a" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 995.329950] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquired external semaphore "port-f94879de-dc14-4034-9d4b-ab2f91d6de6a" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 995.330540] env[65370]: DEBUG networking_nsxv3.api.rpc [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f94879de-dc14-4034-9d4b-ab2f91d6de6a',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 995.457059] env[65370]: INFO networking_nsxv3.common.synchronization [req-d0a09f19-cab7-4703-b53c-ca652aafcc53 req-a3f1f760-4921-4157-8621-5d318db53ea1 tempest-AttachVolumeNegativeTest-719365731 tempest-AttachVolumeNegativeTest-719365731-project-member] Enqueued Resource ID: 8ea97aa8-b2b5-4fb2-ad6c-cbae92dacf23 with Priority: HIGHEST for action security_group_members [ 995.457749] env[65370]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8ea97aa8-b2b5-4fb2-ad6c-cbae92dacf23 with Priority: HIGHEST for action security_group_members [ 995.458206] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock member-8ea97aa8-b2b5-4fb2-ad6c-cbae92dacf23 taken with stack trace [, , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 995.458351] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8ea97aa8-b2b5-4fb2-ad6c-cbae92dacf23" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 995.458499] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8ea97aa8-b2b5-4fb2-ad6c-cbae92dacf23" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 995.458642] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8ea97aa8-b2b5-4fb2-ad6c-cbae92dacf23" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 995.458815] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 995.458919] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 995.458986] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 995.459187] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 995.459280] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 995.459401] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('8ea97aa8-b2b5-4fb2-ad6c-cbae92dacf23',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 995.495111] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('1bc5c407-ee61-45f3-a29e-c586a26bcaff',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 995.833573] env[65370]: DEBUG networking_nsxv3.common.locking [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 995.833885] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquiring lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 995.833926] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquired lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 995.834233] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquired external semaphore "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 995.834380] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Releasing lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 995.834626] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Segment Port f94879de-dc14-4034-9d4b-ab2f91d6de6a not found, creating... [ 995.834801] env[65370]: DEBUG networking_nsxv3.common.locking [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 995.835041] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquiring lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 995.835170] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquired lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 995.835391] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquired external semaphore "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 995.835522] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Releasing lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 995.835810] env[65370]: DEBUG networking_nsxv3.common.locking [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 995.835963] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquiring lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 995.836089] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquired lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 995.836291] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquired external semaphore "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 995.836420] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Releasing lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 995.836553] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Resource: SegmentPort with ID: f94879de-dc14-4034-9d4b-ab2f91d6de6a is going to be created. [ 995.859774] env[65370]: DEBUG networking_nsxv3.common.locking [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 995.859996] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquiring lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 995.860129] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquired lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 995.860403] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquired external semaphore "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 995.860644] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Releasing lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 995.860914] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Releasing lock "port-f94879de-dc14-4034-9d4b-ab2f91d6de6a" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 995.963380] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 995.963590] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 995.963590] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 995.964210] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 995.964210] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 995.964210] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 995.964210] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 995.964617] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 995.964617] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 995.964617] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 995.964617] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8ea97aa8-b2b5-4fb2-ad6c-cbae92dacf23 is going to be updated. [ 995.998418] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('1bc5c407-ee61-45f3-a29e-c586a26bcaff',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 996.009167] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 996.009764] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 996.010066] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 996.011025] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 996.011025] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 996.030277] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8ea97aa8-b2b5-4fb2-ad6c-cbae92dacf23 in Status: IN_PROGRESS for 2s [ 996.501157] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 996.501335] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 996.501399] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 996.502527] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 996.502527] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 996.502527] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1bc5c407-ee61-45f3-a29e-c586a26bcaff is going to be updated. [ 996.530906] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 996.531074] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 996.531166] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 996.531415] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 996.532099] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 996.540674] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1bc5c407-ee61-45f3-a29e-c586a26bcaff in Status: IN_PROGRESS for 2s [ 996.596760] env[65370]: INFO networking_nsxv3.common.synchronization [req-a4699295-9cc7-4ebd-ab1a-dd84ed6f9b99 req-54f49b77-a590-4dfb-b208-3aade4a21e4a service nova] Enqueued Resource ID: eba16cc3-e8ee-4772-ba0d-2b7b582b7844 with Priority: HIGHEST for action security_group_rules [ 996.596952] env[65370]: INFO networking_nsxv3.common.synchronization [req-a4699295-9cc7-4ebd-ab1a-dd84ed6f9b99 req-54f49b77-a590-4dfb-b208-3aade4a21e4a service nova] Enqueued Resource ID: eba16cc3-e8ee-4772-ba0d-2b7b582b7844 with Priority: HIGHEST for action security_group_members [ 996.597227] env[65370]: INFO networking_nsxv3.common.synchronization [req-a4699295-9cc7-4ebd-ab1a-dd84ed6f9b99 req-54f49b77-a590-4dfb-b208-3aade4a21e4a service nova] Enqueued Resource ID: f94879de-dc14-4034-9d4b-ab2f91d6de6a with Priority: HIGHEST for action port [ 996.597802] env[65370]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: eba16cc3-e8ee-4772-ba0d-2b7b582b7844 with Priority: HIGHEST for action security_group_rules [ 996.597939] env[65370]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: eba16cc3-e8ee-4772-ba0d-2b7b582b7844 with Priority: HIGHEST for action security_group_members [ 996.598060] env[65370]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f94879de-dc14-4034-9d4b-ab2f91d6de6a with Priority: HIGHEST for action port [ 996.598330] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock rules-eba16cc3-e8ee-4772-ba0d-2b7b582b7844 taken with stack trace [, , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 996.598458] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-eba16cc3-e8ee-4772-ba0d-2b7b582b7844" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 996.598521] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-eba16cc3-e8ee-4772-ba0d-2b7b582b7844" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 996.599015] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-eba16cc3-e8ee-4772-ba0d-2b7b582b7844" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 996.599015] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('eba16cc3-e8ee-4772-ba0d-2b7b582b7844',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 996.599834] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock member-eba16cc3-e8ee-4772-ba0d-2b7b582b7844 taken with stack trace [, , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 996.599939] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-eba16cc3-e8ee-4772-ba0d-2b7b582b7844" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 996.599939] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-eba16cc3-e8ee-4772-ba0d-2b7b582b7844" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 996.600221] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-eba16cc3-e8ee-4772-ba0d-2b7b582b7844" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 996.600315] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 996.600366] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 996.600398] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 996.600539] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 996.600606] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 996.601759] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('eba16cc3-e8ee-4772-ba0d-2b7b582b7844',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 996.601759] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock port-f94879de-dc14-4034-9d4b-ab2f91d6de6a taken with stack trace [, , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 996.601759] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-f94879de-dc14-4034-9d4b-ab2f91d6de6a" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 996.601759] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-f94879de-dc14-4034-9d4b-ab2f91d6de6a" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 996.602266] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-f94879de-dc14-4034-9d4b-ab2f91d6de6a" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 996.602266] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f94879de-dc14-4034-9d4b-ab2f91d6de6a',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 997.024796] env[65370]: INFO networking_nsxv3.common.synchronization [req-4cb362e9-a4e9-4091-a76c-2227505ac100 req-5b540e3f-3d6a-4164-ab41-c3c8b31daeb3 tempest-ServersV294TestFqdnHostnames-48421139 tempest-ServersV294TestFqdnHostnames-48421139-project-member] Enqueued Resource ID: 002e5341-7a4b-4a54-ad04-59531e87f867 with Priority: HIGHEST for action security_group_members [ 997.025368] env[65370]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 002e5341-7a4b-4a54-ad04-59531e87f867 with Priority: HIGHEST for action security_group_members [ 997.026376] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock member-002e5341-7a4b-4a54-ad04-59531e87f867 taken with stack trace [, , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 997.026526] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-002e5341-7a4b-4a54-ad04-59531e87f867" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 997.026599] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-002e5341-7a4b-4a54-ad04-59531e87f867" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 997.026797] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-002e5341-7a4b-4a54-ad04-59531e87f867" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 997.026982] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 997.027135] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 997.027211] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 997.027372] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 997.027458] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 997.027561] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('002e5341-7a4b-4a54-ad04-59531e87f867',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 997.104047] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock member-eba16cc3-e8ee-4772-ba0d-2b7b582b7844 taken with stack trace [, , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 997.104047] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-eba16cc3-e8ee-4772-ba0d-2b7b582b7844" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 997.104287] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('eba16cc3-e8ee-4772-ba0d-2b7b582b7844',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 997.105026] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port f94879de-dc14-4034-9d4b-ab2f91d6de6a with status ACTIVE [ 997.105443] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 997.105720] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 997.105720] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 997.107454] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 997.107454] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 997.107454] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 997.107454] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 997.107454] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 997.107454] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 997.107454] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 997.107454] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 997.107454] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 997.107454] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 997.107454] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 997.107454] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 997.107454] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: f94879de-dc14-4034-9d4b-ab2f91d6de6a is going to be updated. [ 997.129672] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 997.129927] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 997.129927] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 997.130244] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 997.130323] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 997.130479] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-f94879de-dc14-4034-9d4b-ab2f91d6de6a" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 997.529531] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 997.531093] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 997.531093] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 997.531093] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 997.531093] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 997.531093] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 997.531093] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 997.531093] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 997.531093] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 997.531093] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 997.531093] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 002e5341-7a4b-4a54-ad04-59531e87f867 is going to be updated. [ 997.542846] env[65370]: INFO networking_nsxv3.common.synchronization [req-48de9181-085e-4e74-a108-46b1495c4055 req-feeac7e7-4cc0-47fb-860e-6f4550f32dfa tempest-ServerActionsV293TestJSON-2044734182 tempest-ServerActionsV293TestJSON-2044734182-project-member] Enqueued Resource ID: 5b5e0c25-5d4e-4e13-9670-be19b4122c73 with Priority: HIGHEST for action security_group_members [ 997.542951] env[65370]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5b5e0c25-5d4e-4e13-9670-be19b4122c73 with Priority: HIGHEST for action security_group_members [ 997.543198] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock member-5b5e0c25-5d4e-4e13-9670-be19b4122c73 taken with stack trace [, , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 997.543321] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5b5e0c25-5d4e-4e13-9670-be19b4122c73" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 997.543388] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5b5e0c25-5d4e-4e13-9670-be19b4122c73" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 997.543639] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5b5e0c25-5d4e-4e13-9670-be19b4122c73" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 997.543796] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 997.543898] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 997.543959] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 997.544134] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 997.544221] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 997.544314] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5b5e0c25-5d4e-4e13-9670-be19b4122c73',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 997.559388] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 997.559534] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 997.559646] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 997.559808] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 997.559942] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 997.572255] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 002e5341-7a4b-4a54-ad04-59531e87f867 in Status: IN_PROGRESS for 2s [ 997.610574] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('eba16cc3-e8ee-4772-ba0d-2b7b582b7844',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 997.957087] env[65370]: DEBUG networking_nsxv3.common.locking [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Lock network-159 taken with stack trace [, , , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 997.957087] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquiring lock "network-159" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 997.957087] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquired lock "network-159" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 997.957591] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquired external semaphore "network-159" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 997.958017] env[65370]: DEBUG networking_nsxv3.common.locking [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 997.958275] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquiring lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 997.958412] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquired lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 997.958657] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquired external semaphore "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 997.958808] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Releasing lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 997.959036] env[65370]: DEBUG dogpile.cache.region [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] No value present for key: 'zone-id' {{(pid=65370) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 997.959152] env[65370]: DEBUG dogpile.lock [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] NeedRegenerationException {{(pid=65370) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 997.959257] env[65370]: DEBUG dogpile.lock [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] no value, waiting for create lock {{(pid=65370) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 997.959442] env[65370]: DEBUG dogpile.lock [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] value creation lock acquired {{(pid=65370) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 997.959552] env[65370]: DEBUG dogpile.cache.region [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] No value present for key: 'zone-id' {{(pid=65370) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 997.959656] env[65370]: DEBUG dogpile.lock [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Calling creation function for not-yet-present value {{(pid=65370) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 997.959787] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 997.981966] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 997.981966] env[65370]: DEBUG dogpile.cache.region [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=65370) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 997.981966] env[65370]: DEBUG dogpile.lock [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Released creation lock {{(pid=65370) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 997.981966] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Releasing lock "network-159" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 997.981966] env[65370]: DEBUG networking_nsxv3.common.locking [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Lock port-28a67d02-ede3-47eb-a3f8-5c49e014cdfe taken with stack trace [, , , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 997.981966] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquiring lock "port-28a67d02-ede3-47eb-a3f8-5c49e014cdfe" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 997.981966] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquired lock "port-28a67d02-ede3-47eb-a3f8-5c49e014cdfe" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 997.981966] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquired external semaphore "port-28a67d02-ede3-47eb-a3f8-5c49e014cdfe" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 997.981966] env[65370]: DEBUG networking_nsxv3.api.rpc [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('28a67d02-ede3-47eb-a3f8-5c49e014cdfe',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 998.041760] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8ea97aa8-b2b5-4fb2-ad6c-cbae92dacf23 in Status: SUCCESS [ 998.042695] env[65370]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8ea97aa8-b2b5-4fb2-ad6c-cbae92dacf23 deletion is rescheduled due to dependency. [ 998.042695] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8ea97aa8-b2b5-4fb2-ad6c-cbae92dacf23" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 998.048303] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 998.048303] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 998.048303] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 998.048303] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 998.048303] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 998.048303] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 998.048303] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 998.048303] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 998.048303] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 998.048303] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 998.048303] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5b5e0c25-5d4e-4e13-9670-be19b4122c73 already deleted. [ 998.048303] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5b5e0c25-5d4e-4e13-9670-be19b4122c73" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 998.113924] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 998.113924] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 998.113924] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 998.113924] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 998.113924] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 998.113924] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: eba16cc3-e8ee-4772-ba0d-2b7b582b7844 is going to be created. [ 998.121029] env[65370]: INFO networking_nsxv3.common.synchronization [None req-ab0c9d0f-ac75-42c3-8de8-aa9350f63515 None None] Enqueued Resource ID: c836786e-fa7e-49e9-91bf-3aff0d75d3f4 with Priority: HIGHEST for action port [ 998.121702] env[65370]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c836786e-fa7e-49e9-91bf-3aff0d75d3f4 with Priority: HIGHEST for action port [ 998.122226] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock port-c836786e-fa7e-49e9-91bf-3aff0d75d3f4 taken with stack trace [, , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 998.122389] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-c836786e-fa7e-49e9-91bf-3aff0d75d3f4" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 998.122499] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-c836786e-fa7e-49e9-91bf-3aff0d75d3f4" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 998.123052] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-c836786e-fa7e-49e9-91bf-3aff0d75d3f4" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 998.123052] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c836786e-fa7e-49e9-91bf-3aff0d75d3f4',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 998.158636] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 998.158636] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 998.158975] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 998.159027] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 998.159186] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 998.169770] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: eba16cc3-e8ee-4772-ba0d-2b7b582b7844 in Status: UNINITIALIZED for 2s [ 998.484095] env[65370]: DEBUG networking_nsxv3.common.locking [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 998.484325] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquiring lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 998.484445] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquired lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 998.484717] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquired external semaphore "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 998.484864] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Releasing lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 998.485052] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Segment Port 28a67d02-ede3-47eb-a3f8-5c49e014cdfe not found, creating... [ 998.485310] env[65370]: DEBUG networking_nsxv3.common.locking [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 998.485472] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquiring lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 998.485586] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquired lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 998.485802] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquired external semaphore "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 998.485930] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Releasing lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 998.486225] env[65370]: DEBUG networking_nsxv3.common.locking [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 998.486380] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquiring lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 998.486490] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquired lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 998.486688] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquired external semaphore "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 998.486828] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Releasing lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 998.486953] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Resource: SegmentPort with ID: 28a67d02-ede3-47eb-a3f8-5c49e014cdfe is going to be created. [ 998.509883] env[65370]: DEBUG networking_nsxv3.common.locking [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 998.510130] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquiring lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 998.510230] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquired lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 998.510675] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquired external semaphore "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 998.511621] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Releasing lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 998.511880] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Releasing lock "port-28a67d02-ede3-47eb-a3f8-5c49e014cdfe" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 998.552269] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1bc5c407-ee61-45f3-a29e-c586a26bcaff in Status: SUCCESS [ 998.552525] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1bc5c407-ee61-45f3-a29e-c586a26bcaff" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 998.552709] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1bc5c407-ee61-45f3-a29e-c586a26bcaff" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 998.552921] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1bc5c407-ee61-45f3-a29e-c586a26bcaff" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 998.553141] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 998.553248] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 998.553558] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 998.553558] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 998.553694] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 998.553694] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1bc5c407-ee61-45f3-a29e-c586a26bcaff" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 998.553828] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock member-1bc5c407-ee61-45f3-a29e-c586a26bcaff taken with stack trace [, , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 998.553909] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1bc5c407-ee61-45f3-a29e-c586a26bcaff" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 998.553969] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1bc5c407-ee61-45f3-a29e-c586a26bcaff" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 998.554130] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1bc5c407-ee61-45f3-a29e-c586a26bcaff" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 998.554266] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 998.554353] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 998.554406] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 998.554538] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 998.554600] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 998.554675] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1bc5c407-ee61-45f3-a29e-c586a26bcaff" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 998.554749] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('1bc5c407-ee61-45f3-a29e-c586a26bcaff',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 998.626144] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port c836786e-fa7e-49e9-91bf-3aff0d75d3f4 [ 998.626348] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 998.626447] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 998.626511] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 998.626716] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 998.626804] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 998.626906] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:c836786e-fa7e-49e9-91bf-3aff0d75d3f4 already deleted. [ 998.626983] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-c836786e-fa7e-49e9-91bf-3aff0d75d3f4" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 999.057267] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 1bc5c407-ee61-45f3-a29e-c586a26bcaff: rpc.has_security_group_logging(os_id): False [ 999.081896] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 999.082077] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 999.082132] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 999.082339] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 999.082426] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 999.082614] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 999.082712] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 999.082770] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 999.082915] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 999.082989] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 999.083208] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 999.083305] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 999.083364] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 999.083498] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 999.083571] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 999.083736] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 999.083818] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 999.083877] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 999.084027] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 999.085519] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 999.087387] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 1bc5c407-ee61-45f3-a29e-c586a26bcaff is going to be updated. [ 999.151626] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 999.151755] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 999.151835] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 999.152358] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 999.152358] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 999.188075] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 1bc5c407-ee61-45f3-a29e-c586a26bcaff in Status: IN_PROGRESS for 2s [ 999.363683] env[65370]: INFO networking_nsxv3.common.synchronization [req-48de9181-085e-4e74-a108-46b1495c4055 req-49f34ad0-8a26-480f-a412-1eb70d313777 service nova] Enqueued Resource ID: 5b5e0c25-5d4e-4e13-9670-be19b4122c73 with Priority: HIGHEST for action security_group_rules [ 999.363683] env[65370]: INFO networking_nsxv3.common.synchronization [req-48de9181-085e-4e74-a108-46b1495c4055 req-49f34ad0-8a26-480f-a412-1eb70d313777 service nova] Enqueued Resource ID: 5b5e0c25-5d4e-4e13-9670-be19b4122c73 with Priority: HIGHEST for action security_group_members [ 999.363683] env[65370]: INFO networking_nsxv3.common.synchronization [req-48de9181-085e-4e74-a108-46b1495c4055 req-49f34ad0-8a26-480f-a412-1eb70d313777 service nova] Enqueued Resource ID: 28a67d02-ede3-47eb-a3f8-5c49e014cdfe with Priority: HIGHEST for action port [ 999.364343] env[65370]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5b5e0c25-5d4e-4e13-9670-be19b4122c73 with Priority: HIGHEST for action security_group_rules [ 999.364612] env[65370]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5b5e0c25-5d4e-4e13-9670-be19b4122c73 with Priority: HIGHEST for action security_group_members [ 999.364877] env[65370]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 28a67d02-ede3-47eb-a3f8-5c49e014cdfe with Priority: HIGHEST for action port [ 999.365317] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock rules-5b5e0c25-5d4e-4e13-9670-be19b4122c73 taken with stack trace [, , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 999.365591] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-5b5e0c25-5d4e-4e13-9670-be19b4122c73" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 999.365748] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-5b5e0c25-5d4e-4e13-9670-be19b4122c73" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 999.366064] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-5b5e0c25-5d4e-4e13-9670-be19b4122c73" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 999.366232] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('5b5e0c25-5d4e-4e13-9670-be19b4122c73',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 999.367195] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock member-5b5e0c25-5d4e-4e13-9670-be19b4122c73 taken with stack trace [, , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 999.367447] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5b5e0c25-5d4e-4e13-9670-be19b4122c73" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 999.367603] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5b5e0c25-5d4e-4e13-9670-be19b4122c73" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 999.369036] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5b5e0c25-5d4e-4e13-9670-be19b4122c73" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 999.369036] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 999.369036] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 999.369036] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 999.369036] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 999.369036] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 999.369036] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5b5e0c25-5d4e-4e13-9670-be19b4122c73',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 999.370049] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock port-28a67d02-ede3-47eb-a3f8-5c49e014cdfe taken with stack trace [, , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 999.370530] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-28a67d02-ede3-47eb-a3f8-5c49e014cdfe" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 999.370684] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-28a67d02-ede3-47eb-a3f8-5c49e014cdfe" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 999.370913] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-28a67d02-ede3-47eb-a3f8-5c49e014cdfe" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 999.371079] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('28a67d02-ede3-47eb-a3f8-5c49e014cdfe',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 999.582519] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 002e5341-7a4b-4a54-ad04-59531e87f867 in Status: SUCCESS [ 999.582697] env[65370]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 002e5341-7a4b-4a54-ad04-59531e87f867 deletion is rescheduled due to dependency. [ 999.582805] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-002e5341-7a4b-4a54-ad04-59531e87f867" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 999.873193] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('5b5e0c25-5d4e-4e13-9670-be19b4122c73',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 999.874280] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock member-5b5e0c25-5d4e-4e13-9670-be19b4122c73 taken with stack trace [, , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 999.874564] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5b5e0c25-5d4e-4e13-9670-be19b4122c73" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 999.874564] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 28a67d02-ede3-47eb-a3f8-5c49e014cdfe with status ACTIVE [ 999.874727] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 999.874888] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 999.875262] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 999.875262] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 999.875262] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 999.875452] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 999.875774] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 999.875774] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 999.875774] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 999.875939] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 999.875983] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 999.876150] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 999.876212] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 999.876400] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 999.876538] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 999.876538] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 28a67d02-ede3-47eb-a3f8-5c49e014cdfe is going to be updated. [ 999.900574] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 999.900574] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 999.900574] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 999.900574] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 999.900955] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 999.900955] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-28a67d02-ede3-47eb-a3f8-5c49e014cdfe" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1000.080306] env[65370]: INFO networking_nsxv3.common.synchronization [req-f2ee4378-fd8b-496f-8938-a515032768c4 req-6cf9c7c3-5a14-4dd7-84e1-bfe6484b3b84 tempest-ServerDiskConfigTestJSON-902849627 tempest-ServerDiskConfigTestJSON-902849627-project-member] Enqueued Resource ID: 420136f3-91df-4669-b5e3-cee436aeacb9 with Priority: HIGHEST for action security_group_members [ 1000.081194] env[65370]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 420136f3-91df-4669-b5e3-cee436aeacb9 with Priority: HIGHEST for action security_group_members [ 1000.082061] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock member-420136f3-91df-4669-b5e3-cee436aeacb9 taken with stack trace [, , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1000.082061] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-420136f3-91df-4669-b5e3-cee436aeacb9" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1000.082061] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-420136f3-91df-4669-b5e3-cee436aeacb9" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1000.082061] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-420136f3-91df-4669-b5e3-cee436aeacb9" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1000.082282] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1000.083677] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1000.083677] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1000.083835] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1000.084039] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1000.084096] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('420136f3-91df-4669-b5e3-cee436aeacb9',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1000.181526] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: eba16cc3-e8ee-4772-ba0d-2b7b582b7844 in Status: SUCCESS [ 1000.181861] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-eba16cc3-e8ee-4772-ba0d-2b7b582b7844" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1000.181861] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-eba16cc3-e8ee-4772-ba0d-2b7b582b7844" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1000.183385] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-eba16cc3-e8ee-4772-ba0d-2b7b582b7844" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1000.183385] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1000.183385] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1000.183385] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1000.183385] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1000.183385] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1000.183385] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-eba16cc3-e8ee-4772-ba0d-2b7b582b7844" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1000.183385] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('eba16cc3-e8ee-4772-ba0d-2b7b582b7844',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1000.337523] env[65370]: INFO networking_nsxv3.common.synchronization [None req-f2d52fe9-d640-4e5e-85e3-d63279e914d8 None None] Enqueued Resource ID: 5fa33b64-03f6-4220-95e3-69afa4b81d17 with Priority: HIGHEST for action port [ 1000.337963] env[65370]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5fa33b64-03f6-4220-95e3-69afa4b81d17 with Priority: HIGHEST for action port [ 1000.338384] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock port-5fa33b64-03f6-4220-95e3-69afa4b81d17 taken with stack trace [, , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1000.338939] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-5fa33b64-03f6-4220-95e3-69afa4b81d17" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1000.339057] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-5fa33b64-03f6-4220-95e3-69afa4b81d17" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1000.339806] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-5fa33b64-03f6-4220-95e3-69afa4b81d17" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1000.339806] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5fa33b64-03f6-4220-95e3-69afa4b81d17',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1000.378906] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('5b5e0c25-5d4e-4e13-9670-be19b4122c73',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1000.494873] env[65370]: DEBUG networking_nsxv3.common.locking [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Lock network-974 taken with stack trace [, , , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1000.495828] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquiring lock "network-974" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1000.495828] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquired lock "network-974" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1000.495828] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquired external semaphore "network-974" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1000.496472] env[65370]: DEBUG networking_nsxv3.common.locking [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1000.497223] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquiring lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1000.497223] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquired lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1000.497363] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquired external semaphore "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1000.498027] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Releasing lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1000.498027] env[65370]: DEBUG dogpile.cache.region [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] No value present for key: 'zone-id' {{(pid=65370) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1000.498027] env[65370]: DEBUG dogpile.lock [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] NeedRegenerationException {{(pid=65370) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1000.498027] env[65370]: DEBUG dogpile.lock [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] no value, waiting for create lock {{(pid=65370) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1000.498027] env[65370]: DEBUG dogpile.lock [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] value creation lock acquired {{(pid=65370) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1000.498027] env[65370]: DEBUG dogpile.cache.region [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] No value present for key: 'zone-id' {{(pid=65370) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1000.498342] env[65370]: DEBUG dogpile.lock [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Calling creation function for not-yet-present value {{(pid=65370) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1000.498422] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1000.521752] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1000.521926] env[65370]: DEBUG dogpile.cache.region [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Cache value generated in 0.024 seconds for key(s): 'zone-id' {{(pid=65370) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1000.522075] env[65370]: DEBUG dogpile.lock [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Released creation lock {{(pid=65370) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1000.522259] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Releasing lock "network-974" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1000.522583] env[65370]: DEBUG networking_nsxv3.common.locking [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Lock port-bd22b123-7a21-4095-b7a9-12cf5856c8d5 taken with stack trace [, , , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1000.522754] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquiring lock "port-bd22b123-7a21-4095-b7a9-12cf5856c8d5" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1000.522887] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquired lock "port-bd22b123-7a21-4095-b7a9-12cf5856c8d5" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1000.523396] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquired external semaphore "port-bd22b123-7a21-4095-b7a9-12cf5856c8d5" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1000.523396] env[65370]: DEBUG networking_nsxv3.api.rpc [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('bd22b123-7a21-4095-b7a9-12cf5856c8d5',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1000.587036] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1000.587036] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1000.587036] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1000.589992] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1000.589992] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1000.589992] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1000.589992] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1000.589992] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1000.589992] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1000.589992] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1000.589992] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 420136f3-91df-4669-b5e3-cee436aeacb9 is going to be updated. [ 1000.618496] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1000.618635] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1000.618736] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1000.618923] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1000.619083] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1000.631183] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 420136f3-91df-4669-b5e3-cee436aeacb9 in Status: IN_PROGRESS for 2s [ 1000.688479] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock member-eba16cc3-e8ee-4772-ba0d-2b7b582b7844 taken with stack trace [, , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1000.688656] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-eba16cc3-e8ee-4772-ba0d-2b7b582b7844" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1000.688727] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-eba16cc3-e8ee-4772-ba0d-2b7b582b7844" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1000.688900] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-eba16cc3-e8ee-4772-ba0d-2b7b582b7844" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1000.689697] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1000.689836] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1000.689902] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1000.690083] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1000.690174] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1000.690273] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-eba16cc3-e8ee-4772-ba0d-2b7b582b7844" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1000.690452] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock member-eba16cc3-e8ee-4772-ba0d-2b7b582b7844 taken with stack trace [, , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1000.690546] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-eba16cc3-e8ee-4772-ba0d-2b7b582b7844" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1000.690605] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-eba16cc3-e8ee-4772-ba0d-2b7b582b7844" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1000.690742] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-eba16cc3-e8ee-4772-ba0d-2b7b582b7844" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1000.690886] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1000.690978] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1000.691051] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1000.691188] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1000.691263] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1000.691343] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-eba16cc3-e8ee-4772-ba0d-2b7b582b7844" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1000.691430] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('eba16cc3-e8ee-4772-ba0d-2b7b582b7844',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1000.844385] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 5fa33b64-03f6-4220-95e3-69afa4b81d17 [ 1000.844626] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1000.844760] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1000.844981] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1000.845074] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1000.845193] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1000.845311] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:5fa33b64-03f6-4220-95e3-69afa4b81d17 already deleted. [ 1000.845397] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-5fa33b64-03f6-4220-95e3-69afa4b81d17" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1000.882561] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1000.882716] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1000.882773] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1000.882984] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1000.883084] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1000.883250] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5b5e0c25-5d4e-4e13-9670-be19b4122c73 is going to be created. [ 1000.908593] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1000.908803] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1000.908803] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1000.909024] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1000.909191] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1000.920871] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5b5e0c25-5d4e-4e13-9670-be19b4122c73 in Status: UNINITIALIZED for 2s [ 1001.027543] env[65370]: DEBUG networking_nsxv3.common.locking [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1001.027842] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquiring lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1001.027930] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquired lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1001.028219] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquired external semaphore "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1001.029127] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Releasing lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1001.029127] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Segment Port bd22b123-7a21-4095-b7a9-12cf5856c8d5 not found, creating... [ 1001.029127] env[65370]: DEBUG networking_nsxv3.common.locking [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1001.029127] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquiring lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1001.029127] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquired lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1001.029356] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquired external semaphore "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1001.029523] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Releasing lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1001.029680] env[65370]: DEBUG networking_nsxv3.common.locking [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1001.029840] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquiring lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1001.029950] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquired lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1001.030170] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquired external semaphore "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1001.030316] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Releasing lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1001.030455] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Resource: SegmentPort with ID: bd22b123-7a21-4095-b7a9-12cf5856c8d5 is going to be created. [ 1001.052794] env[65370]: DEBUG networking_nsxv3.common.locking [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1001.054486] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquiring lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1001.054486] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquired lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1001.054486] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquired external semaphore "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1001.054486] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Releasing lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1001.054486] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Releasing lock "port-bd22b123-7a21-4095-b7a9-12cf5856c8d5" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1001.193192] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for eba16cc3-e8ee-4772-ba0d-2b7b582b7844: rpc.has_security_group_logging(os_id): False [ 1001.234044] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 1bc5c407-ee61-45f3-a29e-c586a26bcaff in Status: SUCCESS [ 1001.236317] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-1bc5c407-ee61-45f3-a29e-c586a26bcaff" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1001.240313] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1001.240587] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1001.240587] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1001.241102] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1001.241190] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1001.241689] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1001.241689] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1001.241689] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1001.241925] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1001.241925] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1001.242241] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1001.242379] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1001.242446] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1001.242799] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1001.242884] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1001.243131] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1001.243235] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1001.243299] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1001.243475] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1001.243553] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1001.243643] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: eba16cc3-e8ee-4772-ba0d-2b7b582b7844 is going to be created. [ 1001.245046] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-1bc5c407-ee61-45f3-a29e-c586a26bcaff" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1001.245216] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-1bc5c407-ee61-45f3-a29e-c586a26bcaff" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1001.245360] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('1bc5c407-ee61-45f3-a29e-c586a26bcaff',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1001.349124] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1001.349124] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1001.349124] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1001.349124] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1001.349124] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1001.361383] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: eba16cc3-e8ee-4772-ba0d-2b7b582b7844 in Status: IN_PROGRESS for 2s [ 1001.747863] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock member-1bc5c407-ee61-45f3-a29e-c586a26bcaff taken with stack trace [, , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1001.748155] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1bc5c407-ee61-45f3-a29e-c586a26bcaff" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1001.748155] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1bc5c407-ee61-45f3-a29e-c586a26bcaff" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1001.748490] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1bc5c407-ee61-45f3-a29e-c586a26bcaff" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1001.748675] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1001.748801] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1001.748869] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1001.749051] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1001.749140] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1001.749239] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1bc5c407-ee61-45f3-a29e-c586a26bcaff" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1001.749332] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('1bc5c407-ee61-45f3-a29e-c586a26bcaff',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1001.839968] env[65370]: INFO networking_nsxv3.common.synchronization [req-f2ee4378-fd8b-496f-8938-a515032768c4 req-1ab24518-c495-4daa-92eb-ca00cefaf064 service nova] Enqueued Resource ID: 420136f3-91df-4669-b5e3-cee436aeacb9 with Priority: HIGHEST for action security_group_rules [ 1001.840491] env[65370]: INFO networking_nsxv3.common.synchronization [req-f2ee4378-fd8b-496f-8938-a515032768c4 req-1ab24518-c495-4daa-92eb-ca00cefaf064 service nova] Enqueued Resource ID: 420136f3-91df-4669-b5e3-cee436aeacb9 with Priority: HIGHEST for action security_group_members [ 1001.840723] env[65370]: INFO networking_nsxv3.common.synchronization [req-f2ee4378-fd8b-496f-8938-a515032768c4 req-1ab24518-c495-4daa-92eb-ca00cefaf064 service nova] Enqueued Resource ID: bd22b123-7a21-4095-b7a9-12cf5856c8d5 with Priority: HIGHEST for action port [ 1001.841311] env[65370]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 420136f3-91df-4669-b5e3-cee436aeacb9 with Priority: HIGHEST for action security_group_rules [ 1001.841466] env[65370]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 420136f3-91df-4669-b5e3-cee436aeacb9 with Priority: HIGHEST for action security_group_members [ 1001.841572] env[65370]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bd22b123-7a21-4095-b7a9-12cf5856c8d5 with Priority: HIGHEST for action port [ 1001.841919] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock rules-420136f3-91df-4669-b5e3-cee436aeacb9 taken with stack trace [, , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1001.842124] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-420136f3-91df-4669-b5e3-cee436aeacb9" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1001.842124] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-420136f3-91df-4669-b5e3-cee436aeacb9" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1001.842541] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-420136f3-91df-4669-b5e3-cee436aeacb9" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1001.842541] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('420136f3-91df-4669-b5e3-cee436aeacb9',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1001.845635] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock member-420136f3-91df-4669-b5e3-cee436aeacb9 taken with stack trace [, , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1001.845635] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-420136f3-91df-4669-b5e3-cee436aeacb9" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1001.845635] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock port-bd22b123-7a21-4095-b7a9-12cf5856c8d5 taken with stack trace [, , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1001.845635] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-bd22b123-7a21-4095-b7a9-12cf5856c8d5" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1001.845635] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-bd22b123-7a21-4095-b7a9-12cf5856c8d5" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1001.845635] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-bd22b123-7a21-4095-b7a9-12cf5856c8d5" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1001.845635] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('bd22b123-7a21-4095-b7a9-12cf5856c8d5',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1002.251978] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock member-1bc5c407-ee61-45f3-a29e-c586a26bcaff taken with stack trace [, , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1002.252302] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1bc5c407-ee61-45f3-a29e-c586a26bcaff" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1002.252302] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1bc5c407-ee61-45f3-a29e-c586a26bcaff" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1002.252373] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1bc5c407-ee61-45f3-a29e-c586a26bcaff" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1002.253027] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1002.253027] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1002.253027] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1002.253027] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1002.253027] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1002.253027] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1bc5c407-ee61-45f3-a29e-c586a26bcaff" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1002.253318] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock member-1bc5c407-ee61-45f3-a29e-c586a26bcaff taken with stack trace [, , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1002.253318] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1bc5c407-ee61-45f3-a29e-c586a26bcaff" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1002.253318] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1bc5c407-ee61-45f3-a29e-c586a26bcaff" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1002.253490] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1bc5c407-ee61-45f3-a29e-c586a26bcaff" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1002.253530] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1002.253622] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1002.253687] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1002.253810] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1002.253882] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1002.253959] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1bc5c407-ee61-45f3-a29e-c586a26bcaff" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1002.254081] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('1bc5c407-ee61-45f3-a29e-c586a26bcaff',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1002.352448] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock member-420136f3-91df-4669-b5e3-cee436aeacb9 taken with stack trace [, , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1002.352448] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-420136f3-91df-4669-b5e3-cee436aeacb9" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1002.352448] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port bd22b123-7a21-4095-b7a9-12cf5856c8d5 with status ACTIVE [ 1002.352448] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1002.352448] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1002.352448] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1002.352448] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1002.352448] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1002.352448] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1002.352448] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1002.352448] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1002.352448] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1002.352448] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1002.352448] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1002.352990] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1002.352990] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1002.352990] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1002.352990] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1002.352990] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: bd22b123-7a21-4095-b7a9-12cf5856c8d5 is going to be updated. [ 1002.374680] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1002.375927] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1002.375927] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1002.375927] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1002.375927] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1002.375927] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-bd22b123-7a21-4095-b7a9-12cf5856c8d5" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1002.643802] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 420136f3-91df-4669-b5e3-cee436aeacb9 in Status: IN_PROGRESS for 4s [ 1002.756488] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 1bc5c407-ee61-45f3-a29e-c586a26bcaff: rpc.has_security_group_logging(os_id): False [ 1002.779029] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1002.779029] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1002.779204] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1002.779495] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1002.779495] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1002.779732] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1002.779841] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1002.779905] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1002.780100] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1002.780218] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1002.780465] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1002.780564] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1002.780622] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1002.780768] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1002.780853] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1002.782120] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1002.782439] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1002.782439] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1002.782651] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1002.782738] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1002.782830] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 1bc5c407-ee61-45f3-a29e-c586a26bcaff is going to be updated. [ 1002.859643] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1002.859643] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1002.859643] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1002.859967] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1002.860660] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1002.883578] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 1bc5c407-ee61-45f3-a29e-c586a26bcaff in Status: IN_PROGRESS for 2s [ 1002.934185] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5b5e0c25-5d4e-4e13-9670-be19b4122c73 in Status: SUCCESS [ 1002.934185] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5b5e0c25-5d4e-4e13-9670-be19b4122c73" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1002.934185] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5b5e0c25-5d4e-4e13-9670-be19b4122c73" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1002.934185] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5b5e0c25-5d4e-4e13-9670-be19b4122c73" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1002.934356] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1002.934441] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1002.934505] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1002.934661] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1002.934741] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1002.934828] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5b5e0c25-5d4e-4e13-9670-be19b4122c73" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1002.934928] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('5b5e0c25-5d4e-4e13-9670-be19b4122c73',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1003.377055] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: eba16cc3-e8ee-4772-ba0d-2b7b582b7844 in Status: SUCCESS [ 1003.377433] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-eba16cc3-e8ee-4772-ba0d-2b7b582b7844" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1003.439709] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('5b5e0c25-5d4e-4e13-9670-be19b4122c73',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1003.543493] env[65370]: INFO networking_nsxv3.common.synchronization [req-7ba0d20d-6e1f-44f4-8f86-583c4e389b58 req-f6481511-fba4-463a-9336-e253def85617 tempest-MultipleCreateTestJSON-1838347642 tempest-MultipleCreateTestJSON-1838347642-project-member] Enqueued Resource ID: 1bc5c407-ee61-45f3-a29e-c586a26bcaff with Priority: HIGHEST for action security_group_members [ 1003.544828] env[65370]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1bc5c407-ee61-45f3-a29e-c586a26bcaff with Priority: HIGHEST for action security_group_members [ 1003.545284] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock member-1bc5c407-ee61-45f3-a29e-c586a26bcaff taken with stack trace [, , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1003.545424] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1bc5c407-ee61-45f3-a29e-c586a26bcaff" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1003.545495] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1bc5c407-ee61-45f3-a29e-c586a26bcaff" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1003.545754] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1bc5c407-ee61-45f3-a29e-c586a26bcaff" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1003.545909] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1003.546022] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1003.546079] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1003.546289] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1003.546415] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1003.546529] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1bc5c407-ee61-45f3-a29e-c586a26bcaff',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1003.941406] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 5b5e0c25-5d4e-4e13-9670-be19b4122c73: rpc.has_security_group_logging(os_id): False [ 1003.965289] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1003.965435] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1003.965531] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1003.965736] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1003.965825] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1003.966089] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1003.966195] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1003.966257] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1003.966408] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1003.966539] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1003.966579] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 5b5e0c25-5d4e-4e13-9670-be19b4122c73 is going to be created. [ 1004.045724] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1004.045963] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1004.046085] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1004.046390] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1004.046590] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1004.048382] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('1bc5c407-ee61-45f3-a29e-c586a26bcaff',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1004.069867] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 5b5e0c25-5d4e-4e13-9670-be19b4122c73 in Status: IN_PROGRESS for 2s [ 1004.369912] env[65370]: INFO networking_nsxv3.common.synchronization [req-d4348310-d617-4385-8fc4-2b12e64c4e41 req-96a620d6-6bde-4f4f-aea3-db996dcc4a32 tempest-DeleteServersTestJSON-1160924027 tempest-DeleteServersTestJSON-1160924027-project-member] Enqueued Resource ID: 1eaa763e-4469-4428-92d0-ba20a6c99edc with Priority: HIGHEST for action security_group_members [ 1004.370890] env[65370]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1eaa763e-4469-4428-92d0-ba20a6c99edc with Priority: HIGHEST for action security_group_members [ 1004.370980] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock member-1eaa763e-4469-4428-92d0-ba20a6c99edc taken with stack trace [, , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1004.371459] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1eaa763e-4469-4428-92d0-ba20a6c99edc" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1004.371564] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1eaa763e-4469-4428-92d0-ba20a6c99edc" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1004.371788] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1eaa763e-4469-4428-92d0-ba20a6c99edc" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1004.372050] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1004.372112] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1004.372112] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1004.372810] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1004.372810] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1004.372810] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1eaa763e-4469-4428-92d0-ba20a6c99edc',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1004.552141] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('1bc5c407-ee61-45f3-a29e-c586a26bcaff',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1004.573265] env[65370]: INFO networking_nsxv3.common.synchronization [req-db85152d-edfd-497e-8154-db3e020bafcd req-1e5f3cef-106c-4aad-8550-26395b903762 tempest-MultipleCreateTestJSON-1838347642 tempest-MultipleCreateTestJSON-1838347642-project-member] Enqueued Resource ID: 1bc5c407-ee61-45f3-a29e-c586a26bcaff with Priority: HIGHEST for action security_group_members [ 1004.573845] env[65370]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1bc5c407-ee61-45f3-a29e-c586a26bcaff with Priority: HIGHEST for action security_group_members [ 1004.574505] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock member-1bc5c407-ee61-45f3-a29e-c586a26bcaff taken with stack trace [, , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1004.574616] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1bc5c407-ee61-45f3-a29e-c586a26bcaff" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1004.656878] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 420136f3-91df-4669-b5e3-cee436aeacb9 in Status: SUCCESS [ 1004.657077] env[65370]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 420136f3-91df-4669-b5e3-cee436aeacb9 deletion is rescheduled due to dependency. [ 1004.657273] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-420136f3-91df-4669-b5e3-cee436aeacb9" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1004.657453] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-420136f3-91df-4669-b5e3-cee436aeacb9" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1004.657684] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-420136f3-91df-4669-b5e3-cee436aeacb9" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1004.657893] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1004.658080] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1004.658180] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1004.658310] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1004.658392] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1004.658479] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('420136f3-91df-4669-b5e3-cee436aeacb9',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1004.787990] env[65370]: DEBUG networking_nsxv3.common.locking [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Lock network-712 taken with stack trace [, , , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1004.788340] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquiring lock "network-712" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1004.788469] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquired lock "network-712" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1004.788740] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquired external semaphore "network-712" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1004.789904] env[65370]: DEBUG networking_nsxv3.common.locking [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1004.790178] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquiring lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1004.790410] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquired lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1004.790892] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquired external semaphore "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1004.791061] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Releasing lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1004.791285] env[65370]: DEBUG dogpile.cache.region [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] No value present for key: 'zone-id' {{(pid=65370) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1004.791670] env[65370]: DEBUG dogpile.lock [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] NeedRegenerationException {{(pid=65370) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1004.791801] env[65370]: DEBUG dogpile.lock [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] no value, waiting for create lock {{(pid=65370) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1004.791908] env[65370]: DEBUG dogpile.lock [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] value creation lock acquired {{(pid=65370) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1004.792039] env[65370]: DEBUG dogpile.cache.region [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] No value present for key: 'zone-id' {{(pid=65370) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1004.792200] env[65370]: DEBUG dogpile.lock [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Calling creation function for not-yet-present value {{(pid=65370) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1004.792397] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1004.815402] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1004.815582] env[65370]: DEBUG dogpile.cache.region [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=65370) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1004.815761] env[65370]: DEBUG dogpile.lock [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Released creation lock {{(pid=65370) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1004.816139] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Releasing lock "network-712" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1004.816443] env[65370]: DEBUG networking_nsxv3.common.locking [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Lock port-6593af17-6358-48ef-b38c-c09b124766a5 taken with stack trace [, , , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1004.816619] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquiring lock "port-6593af17-6358-48ef-b38c-c09b124766a5" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1004.816740] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquired lock "port-6593af17-6358-48ef-b38c-c09b124766a5" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1004.817064] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquired external semaphore "port-6593af17-6358-48ef-b38c-c09b124766a5" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1004.817261] env[65370]: DEBUG networking_nsxv3.api.rpc [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6593af17-6358-48ef-b38c-c09b124766a5',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1004.876401] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1004.876401] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1004.876401] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1004.876401] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1004.899766] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1004.902397] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1004.902397] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1004.902397] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1004.902397] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1004.902397] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1004.902397] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1eaa763e-4469-4428-92d0-ba20a6c99edc is going to be updated. [ 1004.904619] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 1bc5c407-ee61-45f3-a29e-c586a26bcaff in Status: SUCCESS [ 1004.904954] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-1bc5c407-ee61-45f3-a29e-c586a26bcaff" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1004.935647] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1004.935647] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1004.935647] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1004.935647] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1004.935647] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1004.944220] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1eaa763e-4469-4428-92d0-ba20a6c99edc in Status: IN_PROGRESS for 2s [ 1005.055028] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1005.055317] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1005.055374] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1005.055662] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1005.055758] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1005.055888] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1bc5c407-ee61-45f3-a29e-c586a26bcaff is going to be updated. [ 1005.111312] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1005.111489] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1005.111540] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1005.111727] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1005.111865] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1005.124740] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1bc5c407-ee61-45f3-a29e-c586a26bcaff in Status: IN_PROGRESS for 2s [ 1005.161023] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('420136f3-91df-4669-b5e3-cee436aeacb9',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1005.320194] env[65370]: DEBUG networking_nsxv3.common.locking [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1005.320405] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquiring lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1005.320568] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquired lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1005.320811] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquired external semaphore "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1005.320961] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Releasing lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1005.321120] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Segment Port 6593af17-6358-48ef-b38c-c09b124766a5 not found, creating... [ 1005.321449] env[65370]: DEBUG networking_nsxv3.common.locking [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1005.321613] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquiring lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1005.321728] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquired lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1005.321963] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquired external semaphore "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1005.322081] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Releasing lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1005.322415] env[65370]: DEBUG networking_nsxv3.common.locking [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1005.322533] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquiring lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1005.322635] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquired lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1005.322830] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquired external semaphore "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1005.322959] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Releasing lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1005.323111] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Resource: SegmentPort with ID: 6593af17-6358-48ef-b38c-c09b124766a5 is going to be created. [ 1005.346361] env[65370]: DEBUG networking_nsxv3.common.locking [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1005.346616] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquiring lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1005.346675] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquired lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1005.346953] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquired external semaphore "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1005.347257] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Releasing lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1005.347487] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Releasing lock "port-6593af17-6358-48ef-b38c-c09b124766a5" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1005.662642] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('420136f3-91df-4669-b5e3-cee436aeacb9',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1006.085930] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 5b5e0c25-5d4e-4e13-9670-be19b4122c73 in Status: SUCCESS [ 1006.088026] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-5b5e0c25-5d4e-4e13-9670-be19b4122c73" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1006.122048] env[65370]: INFO networking_nsxv3.common.synchronization [req-d4348310-d617-4385-8fc4-2b12e64c4e41 req-6c450ffd-480b-4757-b318-d6ffc8c5ff5a service nova] Enqueued Resource ID: 1eaa763e-4469-4428-92d0-ba20a6c99edc with Priority: HIGHEST for action security_group_rules [ 1006.122285] env[65370]: INFO networking_nsxv3.common.synchronization [req-d4348310-d617-4385-8fc4-2b12e64c4e41 req-6c450ffd-480b-4757-b318-d6ffc8c5ff5a service nova] Enqueued Resource ID: 1eaa763e-4469-4428-92d0-ba20a6c99edc with Priority: HIGHEST for action security_group_members [ 1006.122465] env[65370]: INFO networking_nsxv3.common.synchronization [req-d4348310-d617-4385-8fc4-2b12e64c4e41 req-6c450ffd-480b-4757-b318-d6ffc8c5ff5a service nova] Enqueued Resource ID: 6593af17-6358-48ef-b38c-c09b124766a5 with Priority: HIGHEST for action port [ 1006.123128] env[65370]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1eaa763e-4469-4428-92d0-ba20a6c99edc with Priority: HIGHEST for action security_group_rules [ 1006.123304] env[65370]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1eaa763e-4469-4428-92d0-ba20a6c99edc with Priority: HIGHEST for action security_group_members [ 1006.123422] env[65370]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6593af17-6358-48ef-b38c-c09b124766a5 with Priority: HIGHEST for action port [ 1006.123711] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock rules-1eaa763e-4469-4428-92d0-ba20a6c99edc taken with stack trace [, , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1006.123849] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-1eaa763e-4469-4428-92d0-ba20a6c99edc" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1006.123918] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-1eaa763e-4469-4428-92d0-ba20a6c99edc" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1006.124202] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-1eaa763e-4469-4428-92d0-ba20a6c99edc" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1006.124327] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('1eaa763e-4469-4428-92d0-ba20a6c99edc',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1006.126961] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock member-1eaa763e-4469-4428-92d0-ba20a6c99edc taken with stack trace [, , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1006.126961] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1eaa763e-4469-4428-92d0-ba20a6c99edc" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1006.126961] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock port-6593af17-6358-48ef-b38c-c09b124766a5 taken with stack trace [, , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1006.126961] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-6593af17-6358-48ef-b38c-c09b124766a5" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1006.126961] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-6593af17-6358-48ef-b38c-c09b124766a5" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1006.126961] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-6593af17-6358-48ef-b38c-c09b124766a5" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1006.126961] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6593af17-6358-48ef-b38c-c09b124766a5',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1006.165825] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1006.165981] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1006.166059] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1006.166277] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1006.166367] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1006.166462] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 420136f3-91df-4669-b5e3-cee436aeacb9 is going to be updated. [ 1006.225857] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1006.226044] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1006.226348] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1006.226562] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1006.226720] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1006.253048] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 420136f3-91df-4669-b5e3-cee436aeacb9 in Status: IN_PROGRESS for 2s [ 1006.628418] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock member-1eaa763e-4469-4428-92d0-ba20a6c99edc taken with stack trace [, , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1006.629052] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1eaa763e-4469-4428-92d0-ba20a6c99edc" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1006.629388] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 6593af17-6358-48ef-b38c-c09b124766a5 with status ACTIVE [ 1006.629637] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1006.630218] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1006.630305] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1006.630554] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1006.630651] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1006.630876] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1006.630981] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1006.631071] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1006.631556] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1006.631742] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1006.632010] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1006.632084] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1006.632312] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1006.632490] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1006.632572] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1006.632769] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 6593af17-6358-48ef-b38c-c09b124766a5 is going to be updated. [ 1006.660292] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1006.660680] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1006.660844] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1006.661214] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1006.661497] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1006.661801] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-6593af17-6358-48ef-b38c-c09b124766a5" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1006.956338] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1eaa763e-4469-4428-92d0-ba20a6c99edc in Status: SUCCESS [ 1006.956691] env[65370]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1eaa763e-4469-4428-92d0-ba20a6c99edc deletion is rescheduled due to dependency. [ 1006.956691] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1eaa763e-4469-4428-92d0-ba20a6c99edc" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1006.956784] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1eaa763e-4469-4428-92d0-ba20a6c99edc" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1006.956943] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1eaa763e-4469-4428-92d0-ba20a6c99edc" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1006.957213] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1006.957341] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1006.957406] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1006.957975] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1006.957975] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1006.957975] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1eaa763e-4469-4428-92d0-ba20a6c99edc',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1007.136058] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1bc5c407-ee61-45f3-a29e-c586a26bcaff in Status: SUCCESS [ 1007.136404] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1bc5c407-ee61-45f3-a29e-c586a26bcaff" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1007.136618] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1bc5c407-ee61-45f3-a29e-c586a26bcaff" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1007.136855] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1bc5c407-ee61-45f3-a29e-c586a26bcaff" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1007.137091] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1007.137274] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1007.137383] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1007.137575] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1007.137699] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1007.138152] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1bc5c407-ee61-45f3-a29e-c586a26bcaff',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1007.459981] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('1eaa763e-4469-4428-92d0-ba20a6c99edc',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1007.640225] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1007.640413] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1007.640413] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1007.640691] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1007.641627] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1007.641627] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1007.641627] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1007.641627] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1007.641627] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1007.641627] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1007.641627] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1bc5c407-ee61-45f3-a29e-c586a26bcaff is going to be updated. [ 1007.656015] env[65370]: INFO networking_nsxv3.common.synchronization [req-70cc408b-ba68-4132-9324-3248ff5d6d5c req-6eadd0d9-dc0d-45c6-9ec2-5714f3587ccc tempest-ServerActionsTestOtherA-1239332614 tempest-ServerActionsTestOtherA-1239332614-project-member] Enqueued Resource ID: f37147a2-7642-4b7c-a970-ffec078fbee9 with Priority: HIGHEST for action security_group_members [ 1007.656547] env[65370]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f37147a2-7642-4b7c-a970-ffec078fbee9 with Priority: HIGHEST for action security_group_members [ 1007.656849] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock member-f37147a2-7642-4b7c-a970-ffec078fbee9 taken with stack trace [, , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1007.656989] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f37147a2-7642-4b7c-a970-ffec078fbee9" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1007.657041] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f37147a2-7642-4b7c-a970-ffec078fbee9" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1007.658204] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f37147a2-7642-4b7c-a970-ffec078fbee9" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1007.658309] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1007.658806] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1007.658806] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1007.658806] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1007.658806] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1007.658806] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f37147a2-7642-4b7c-a970-ffec078fbee9',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1007.672134] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1007.672134] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1007.672134] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1007.672134] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1007.672134] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1007.681170] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1bc5c407-ee61-45f3-a29e-c586a26bcaff in Status: IN_PROGRESS for 2s [ 1007.962772] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('1eaa763e-4469-4428-92d0-ba20a6c99edc',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1008.161738] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1008.161738] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1008.161864] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1008.162751] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1008.162751] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1008.162751] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1008.163108] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1008.163108] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1008.163182] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1008.163408] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1008.163408] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f37147a2-7642-4b7c-a970-ffec078fbee9 is going to be updated. [ 1008.197939] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1008.197939] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1008.198206] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1008.198627] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1008.198627] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1008.211885] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f37147a2-7642-4b7c-a970-ffec078fbee9 in Status: IN_PROGRESS for 2s [ 1008.265510] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 420136f3-91df-4669-b5e3-cee436aeacb9 in Status: SUCCESS [ 1008.265792] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-420136f3-91df-4669-b5e3-cee436aeacb9" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1008.265967] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-420136f3-91df-4669-b5e3-cee436aeacb9" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1008.266182] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-420136f3-91df-4669-b5e3-cee436aeacb9" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1008.266401] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1008.266576] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1008.266632] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1008.266765] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1008.266892] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1008.266939] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-420136f3-91df-4669-b5e3-cee436aeacb9" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1008.267049] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('420136f3-91df-4669-b5e3-cee436aeacb9',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1008.464700] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1008.464923] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1008.465039] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1008.465317] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1008.465876] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1008.466224] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1eaa763e-4469-4428-92d0-ba20a6c99edc is going to be updated. [ 1008.500338] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1008.501737] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1008.501737] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1008.501737] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1008.501737] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1008.510654] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1eaa763e-4469-4428-92d0-ba20a6c99edc in Status: IN_PROGRESS for 2s [ 1008.772518] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock member-420136f3-91df-4669-b5e3-cee436aeacb9 taken with stack trace [, , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1008.772689] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-420136f3-91df-4669-b5e3-cee436aeacb9" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1008.772762] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-420136f3-91df-4669-b5e3-cee436aeacb9" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1008.773025] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-420136f3-91df-4669-b5e3-cee436aeacb9" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1008.773204] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1008.773304] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1008.773370] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1008.773528] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1008.773617] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1008.773715] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-420136f3-91df-4669-b5e3-cee436aeacb9" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1008.773872] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock member-420136f3-91df-4669-b5e3-cee436aeacb9 taken with stack trace [, , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1008.773965] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-420136f3-91df-4669-b5e3-cee436aeacb9" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1008.774037] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-420136f3-91df-4669-b5e3-cee436aeacb9" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1008.774183] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-420136f3-91df-4669-b5e3-cee436aeacb9" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1008.774324] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1008.774416] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1008.774475] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1008.774611] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1008.774716] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1008.774756] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-420136f3-91df-4669-b5e3-cee436aeacb9" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1008.774863] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('420136f3-91df-4669-b5e3-cee436aeacb9',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1009.279424] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 420136f3-91df-4669-b5e3-cee436aeacb9: rpc.has_security_group_logging(os_id): False [ 1009.298755] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1009.298883] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1009.298955] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1009.299198] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1009.299293] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1009.299504] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1009.299616] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1009.299681] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1009.299833] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1009.299916] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1009.300134] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1009.300230] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1009.300290] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1009.300431] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1009.300503] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1009.300680] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1009.300764] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1009.300824] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1009.300960] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1009.301072] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1009.301164] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 420136f3-91df-4669-b5e3-cee436aeacb9 is going to be updated. [ 1009.366963] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1009.366963] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1009.366963] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1009.366963] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1009.366963] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1009.380644] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 420136f3-91df-4669-b5e3-cee436aeacb9 in Status: IN_PROGRESS for 2s [ 1009.647068] env[65370]: INFO networking_nsxv3.common.synchronization [None req-83052e13-b26a-4698-aa25-3c752c23d864 None None] Enqueued Resource ID: 9f0733a8-5ba2-4353-b122-74c027661d03 with Priority: HIGHEST for action port [ 1009.647533] env[65370]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9f0733a8-5ba2-4353-b122-74c027661d03 with Priority: HIGHEST for action port [ 1009.647877] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock port-9f0733a8-5ba2-4353-b122-74c027661d03 taken with stack trace [, , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1009.648252] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-9f0733a8-5ba2-4353-b122-74c027661d03" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1009.649353] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-9f0733a8-5ba2-4353-b122-74c027661d03" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1009.649353] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-9f0733a8-5ba2-4353-b122-74c027661d03" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1009.649353] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9f0733a8-5ba2-4353-b122-74c027661d03',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1009.691422] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1bc5c407-ee61-45f3-a29e-c586a26bcaff in Status: SUCCESS [ 1009.691660] env[65370]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1bc5c407-ee61-45f3-a29e-c586a26bcaff deletion is rescheduled due to dependency. [ 1009.691889] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1bc5c407-ee61-45f3-a29e-c586a26bcaff" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1010.151894] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 9f0733a8-5ba2-4353-b122-74c027661d03 [ 1010.151894] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1010.152804] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1010.152804] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1010.152804] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1010.152804] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1010.152990] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:9f0733a8-5ba2-4353-b122-74c027661d03 already deleted. [ 1010.152990] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-9f0733a8-5ba2-4353-b122-74c027661d03" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1010.223546] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f37147a2-7642-4b7c-a970-ffec078fbee9 in Status: SUCCESS [ 1010.223797] env[65370]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f37147a2-7642-4b7c-a970-ffec078fbee9 deletion is rescheduled due to dependency. [ 1010.223955] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f37147a2-7642-4b7c-a970-ffec078fbee9" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1010.520567] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1eaa763e-4469-4428-92d0-ba20a6c99edc in Status: SUCCESS [ 1010.520928] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1eaa763e-4469-4428-92d0-ba20a6c99edc" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1010.520928] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1eaa763e-4469-4428-92d0-ba20a6c99edc" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1010.521167] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1eaa763e-4469-4428-92d0-ba20a6c99edc" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1010.521372] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1010.521481] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1010.521567] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1010.521734] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1010.521814] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1010.521899] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1eaa763e-4469-4428-92d0-ba20a6c99edc" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1010.521997] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('1eaa763e-4469-4428-92d0-ba20a6c99edc',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1010.810017] env[65370]: INFO networking_nsxv3.common.synchronization [None req-e87d0a91-3107-4acc-bc10-aee5f92b3dd5 tempest-AttachVolumeTestJSON-1795434373 tempest-AttachVolumeTestJSON-1795434373-project-member] Enqueued Resource ID: aa619879-3f9d-4aea-b1cb-1e5adfe92cfd with Priority: HIGHEST for action security_group_rules [ 1010.810017] env[65370]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: aa619879-3f9d-4aea-b1cb-1e5adfe92cfd with Priority: HIGHEST for action security_group_rules [ 1010.810017] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock rules-aa619879-3f9d-4aea-b1cb-1e5adfe92cfd taken with stack trace [, , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1010.810017] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-aa619879-3f9d-4aea-b1cb-1e5adfe92cfd" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1010.811093] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-aa619879-3f9d-4aea-b1cb-1e5adfe92cfd" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1010.811093] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-aa619879-3f9d-4aea-b1cb-1e5adfe92cfd" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1010.811093] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('aa619879-3f9d-4aea-b1cb-1e5adfe92cfd',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1011.025034] env[65370]: INFO networking_nsxv3.common.synchronization [None req-5c178d84-6be7-4158-843c-1875cef8f23b tempest-AttachVolumeTestJSON-1795434373 tempest-AttachVolumeTestJSON-1795434373-project-member] Enqueued Resource ID: aa619879-3f9d-4aea-b1cb-1e5adfe92cfd with Priority: HIGHEST for action security_group_rules [ 1011.025034] env[65370]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: aa619879-3f9d-4aea-b1cb-1e5adfe92cfd with Priority: HIGHEST for action security_group_rules [ 1011.025034] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock rules-aa619879-3f9d-4aea-b1cb-1e5adfe92cfd taken with stack trace [, , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1011.025403] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-aa619879-3f9d-4aea-b1cb-1e5adfe92cfd" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1011.029226] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock member-1eaa763e-4469-4428-92d0-ba20a6c99edc taken with stack trace [, , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1011.029226] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1eaa763e-4469-4428-92d0-ba20a6c99edc" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1011.029226] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1eaa763e-4469-4428-92d0-ba20a6c99edc" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1011.029226] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1eaa763e-4469-4428-92d0-ba20a6c99edc" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1011.029226] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1011.029226] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1011.029226] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1011.029226] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1011.029226] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1011.029226] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1eaa763e-4469-4428-92d0-ba20a6c99edc" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1011.029226] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock member-1eaa763e-4469-4428-92d0-ba20a6c99edc taken with stack trace [, , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1011.029226] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1eaa763e-4469-4428-92d0-ba20a6c99edc" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1011.029226] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1eaa763e-4469-4428-92d0-ba20a6c99edc" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1011.029226] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1eaa763e-4469-4428-92d0-ba20a6c99edc" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1011.029226] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1011.029226] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1011.029944] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1011.029944] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1011.029944] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1011.029944] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1eaa763e-4469-4428-92d0-ba20a6c99edc" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1011.029944] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('1eaa763e-4469-4428-92d0-ba20a6c99edc',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1011.356538] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1011.356538] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1011.356538] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1011.356538] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1011.357199] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1011.357199] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: aa619879-3f9d-4aea-b1cb-1e5adfe92cfd already deleted. [ 1011.357199] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-aa619879-3f9d-4aea-b1cb-1e5adfe92cfd" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1011.357199] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-aa619879-3f9d-4aea-b1cb-1e5adfe92cfd" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1011.357387] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-aa619879-3f9d-4aea-b1cb-1e5adfe92cfd" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1011.357444] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('aa619879-3f9d-4aea-b1cb-1e5adfe92cfd',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1011.396223] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 420136f3-91df-4669-b5e3-cee436aeacb9 in Status: SUCCESS [ 1011.396515] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-420136f3-91df-4669-b5e3-cee436aeacb9" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1011.532064] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 1eaa763e-4469-4428-92d0-ba20a6c99edc: rpc.has_security_group_logging(os_id): False [ 1011.551744] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1011.552022] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1011.552086] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1011.552276] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1011.552478] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1011.552862] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1011.552862] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1011.552862] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1011.553024] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1011.553024] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1011.553196] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1011.553284] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1011.553342] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1011.553476] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1011.553568] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1011.554114] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1011.554114] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1011.554114] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1011.554114] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1011.554299] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1011.554299] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 1eaa763e-4469-4428-92d0-ba20a6c99edc is going to be updated. [ 1011.627499] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1011.627595] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1011.627658] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1011.627889] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1011.628064] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1011.643704] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 1eaa763e-4469-4428-92d0-ba20a6c99edc in Status: IN_PROGRESS for 2s [ 1011.880551] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1011.880705] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1011.880756] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1011.880980] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1011.881083] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1011.881178] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: aa619879-3f9d-4aea-b1cb-1e5adfe92cfd already deleted. [ 1011.881271] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-aa619879-3f9d-4aea-b1cb-1e5adfe92cfd" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1012.258116] env[65370]: INFO networking_nsxv3.common.synchronization [None req-ec056a39-044c-437c-a2d1-8dc352f36c98 None None] Enqueued Resource ID: 3605fdc7-8ac7-4bee-8943-48ec82e293f7 with Priority: HIGHEST for action port [ 1012.261884] env[65370]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3605fdc7-8ac7-4bee-8943-48ec82e293f7 with Priority: HIGHEST for action port [ 1012.262320] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock port-3605fdc7-8ac7-4bee-8943-48ec82e293f7 taken with stack trace [, , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1012.262528] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-3605fdc7-8ac7-4bee-8943-48ec82e293f7" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1012.262659] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-3605fdc7-8ac7-4bee-8943-48ec82e293f7" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1012.262949] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-3605fdc7-8ac7-4bee-8943-48ec82e293f7" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1012.263056] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3605fdc7-8ac7-4bee-8943-48ec82e293f7',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1012.767404] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 3605fdc7-8ac7-4bee-8943-48ec82e293f7 [ 1012.768589] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1012.768691] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1012.768770] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1012.769056] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1012.769123] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1012.769175] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:3605fdc7-8ac7-4bee-8943-48ec82e293f7 already deleted. [ 1012.769252] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-3605fdc7-8ac7-4bee-8943-48ec82e293f7" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1012.855324] env[65370]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-22548ca9-c949-4428-b53c-fd85bd762917 None None] NSXv3 Agent Agent loop - iteration:1 completed [ 1012.855324] env[65370]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-22548ca9-c949-4428-b53c-fd85bd762917 None None] NSXv3 Agent Agent loop - iteration:2 started [ 1013.175828] env[65370]: INFO networking_nsxv3.common.synchronization [req-d5cc75ab-bb9f-4010-bade-663c10d8eed6 req-af156848-b69e-49a7-ac95-dabfc326dcf6 tempest-ListServerFiltersTestJSON-1679580052 tempest-ListServerFiltersTestJSON-1679580052-project-member] Enqueued Resource ID: 9496f4d5-71fb-471e-bab0-2220819ba7ed with Priority: HIGHEST for action security_group_members [ 1013.175828] env[65370]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9496f4d5-71fb-471e-bab0-2220819ba7ed with Priority: HIGHEST for action security_group_members [ 1013.176035] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock member-9496f4d5-71fb-471e-bab0-2220819ba7ed taken with stack trace [, , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1013.176391] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9496f4d5-71fb-471e-bab0-2220819ba7ed" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1013.176391] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9496f4d5-71fb-471e-bab0-2220819ba7ed" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1013.176540] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9496f4d5-71fb-471e-bab0-2220819ba7ed" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1013.177205] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1013.177205] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1013.177205] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1013.177205] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1013.177205] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1013.177205] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9496f4d5-71fb-471e-bab0-2220819ba7ed',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1013.651264] env[65370]: DEBUG networking_nsxv3.common.locking [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Lock network-392 taken with stack trace [, , , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1013.651525] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquiring lock "network-392" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1013.652321] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquired lock "network-392" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1013.652656] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquired external semaphore "network-392" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1013.652938] env[65370]: DEBUG networking_nsxv3.common.locking [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1013.653184] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquiring lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1013.653353] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquired lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1013.653653] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquired external semaphore "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1013.653788] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Releasing lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1013.654075] env[65370]: DEBUG dogpile.cache.region [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] No value present for key: 'zone-id' {{(pid=65370) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1013.654605] env[65370]: DEBUG dogpile.lock [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] NeedRegenerationException {{(pid=65370) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1013.654740] env[65370]: DEBUG dogpile.lock [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] no value, waiting for create lock {{(pid=65370) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1013.654857] env[65370]: DEBUG dogpile.lock [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] value creation lock acquired {{(pid=65370) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1013.654973] env[65370]: DEBUG dogpile.cache.region [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] No value present for key: 'zone-id' {{(pid=65370) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1013.655115] env[65370]: DEBUG dogpile.lock [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Calling creation function for not-yet-present value {{(pid=65370) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1013.655249] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1013.658060] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 1eaa763e-4469-4428-92d0-ba20a6c99edc in Status: SUCCESS [ 1013.658269] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-1eaa763e-4469-4428-92d0-ba20a6c99edc" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1013.675244] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1013.675463] env[65370]: DEBUG dogpile.cache.region [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=65370) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1013.675610] env[65370]: DEBUG dogpile.lock [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Released creation lock {{(pid=65370) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1013.675808] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Releasing lock "network-392" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1013.676168] env[65370]: DEBUG networking_nsxv3.common.locking [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Lock port-d81f6fa4-27ad-4fcc-bc24-157f2e6e915b taken with stack trace [, , , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1013.676357] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquiring lock "port-d81f6fa4-27ad-4fcc-bc24-157f2e6e915b" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1013.676486] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquired lock "port-d81f6fa4-27ad-4fcc-bc24-157f2e6e915b" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1013.676812] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquired external semaphore "port-d81f6fa4-27ad-4fcc-bc24-157f2e6e915b" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1013.676955] env[65370]: DEBUG networking_nsxv3.api.rpc [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d81f6fa4-27ad-4fcc-bc24-157f2e6e915b',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1013.680686] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1013.680807] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1013.680876] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1013.681078] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1013.681206] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1013.681404] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1013.681529] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1013.681597] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1013.681775] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1013.681856] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1013.681954] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9496f4d5-71fb-471e-bab0-2220819ba7ed already deleted. [ 1013.682078] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9496f4d5-71fb-471e-bab0-2220819ba7ed" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1014.107535] env[65370]: INFO networking_nsxv3.common.synchronization [req-fffc49d4-0145-4bf0-a2c9-20691264111b req-af5f5701-1fd9-4830-a33d-f17909ab3b91 tempest-AttachInterfacesTestJSON-315686657 tempest-AttachInterfacesTestJSON-315686657-project-member] Enqueued Resource ID: 826ed52a-9222-434f-a4f9-e83fd60a5345 with Priority: HIGHEST for action security_group_members [ 1014.108172] env[65370]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 826ed52a-9222-434f-a4f9-e83fd60a5345 with Priority: HIGHEST for action security_group_members [ 1014.108615] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock member-826ed52a-9222-434f-a4f9-e83fd60a5345 taken with stack trace [, , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1014.108823] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-826ed52a-9222-434f-a4f9-e83fd60a5345" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1014.108896] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-826ed52a-9222-434f-a4f9-e83fd60a5345" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1014.109183] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-826ed52a-9222-434f-a4f9-e83fd60a5345" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1014.109355] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1014.109833] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1014.109833] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1014.109833] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1014.109833] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1014.109833] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('826ed52a-9222-434f-a4f9-e83fd60a5345',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1014.181029] env[65370]: DEBUG networking_nsxv3.common.locking [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1014.181029] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquiring lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1014.181310] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquired lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1014.181383] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquired external semaphore "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1014.181525] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Releasing lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1014.181670] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Segment Port d81f6fa4-27ad-4fcc-bc24-157f2e6e915b not found, creating... [ 1014.181985] env[65370]: DEBUG networking_nsxv3.common.locking [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1014.182087] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquiring lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1014.182186] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquired lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1014.182572] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquired external semaphore "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1014.182775] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Releasing lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1014.183068] env[65370]: DEBUG networking_nsxv3.common.locking [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1014.183221] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquiring lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1014.183331] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquired lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1014.183596] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquired external semaphore "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1014.183726] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Releasing lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1014.183857] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Resource: SegmentPort with ID: d81f6fa4-27ad-4fcc-bc24-157f2e6e915b is going to be created. [ 1014.205572] env[65370]: DEBUG networking_nsxv3.common.locking [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1014.205804] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquiring lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1014.205896] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquired lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1014.206239] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquired external semaphore "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1014.206481] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Releasing lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1014.206713] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Releasing lock "port-d81f6fa4-27ad-4fcc-bc24-157f2e6e915b" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1014.612131] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1014.612331] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1014.612379] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1014.612572] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1014.612660] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1014.612882] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1014.612990] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1014.613043] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1014.613159] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1014.613230] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1014.613313] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 826ed52a-9222-434f-a4f9-e83fd60a5345 already deleted. [ 1014.613393] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-826ed52a-9222-434f-a4f9-e83fd60a5345" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1014.953351] env[65370]: INFO networking_nsxv3.common.synchronization [req-d5cc75ab-bb9f-4010-bade-663c10d8eed6 req-b58582f0-44ee-4fcd-802f-68daa680dd41 service nova] Enqueued Resource ID: 9496f4d5-71fb-471e-bab0-2220819ba7ed with Priority: HIGHEST for action security_group_rules [ 1014.953724] env[65370]: INFO networking_nsxv3.common.synchronization [req-d5cc75ab-bb9f-4010-bade-663c10d8eed6 req-b58582f0-44ee-4fcd-802f-68daa680dd41 service nova] Enqueued Resource ID: 9496f4d5-71fb-471e-bab0-2220819ba7ed with Priority: HIGHEST for action security_group_members [ 1014.954142] env[65370]: INFO networking_nsxv3.common.synchronization [req-d5cc75ab-bb9f-4010-bade-663c10d8eed6 req-b58582f0-44ee-4fcd-802f-68daa680dd41 service nova] Enqueued Resource ID: d81f6fa4-27ad-4fcc-bc24-157f2e6e915b with Priority: HIGHEST for action port [ 1014.955208] env[65370]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9496f4d5-71fb-471e-bab0-2220819ba7ed with Priority: HIGHEST for action security_group_rules [ 1014.955515] env[65370]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9496f4d5-71fb-471e-bab0-2220819ba7ed with Priority: HIGHEST for action security_group_members [ 1014.958731] env[65370]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d81f6fa4-27ad-4fcc-bc24-157f2e6e915b with Priority: HIGHEST for action port [ 1014.958731] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock rules-9496f4d5-71fb-471e-bab0-2220819ba7ed taken with stack trace [, , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1014.958731] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-9496f4d5-71fb-471e-bab0-2220819ba7ed" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1014.958731] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-9496f4d5-71fb-471e-bab0-2220819ba7ed" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1014.958731] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-9496f4d5-71fb-471e-bab0-2220819ba7ed" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1014.958731] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('9496f4d5-71fb-471e-bab0-2220819ba7ed',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1014.958731] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock member-9496f4d5-71fb-471e-bab0-2220819ba7ed taken with stack trace [, , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1014.958731] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9496f4d5-71fb-471e-bab0-2220819ba7ed" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1014.958731] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9496f4d5-71fb-471e-bab0-2220819ba7ed" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1014.959571] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9496f4d5-71fb-471e-bab0-2220819ba7ed" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1014.959935] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1014.960907] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1014.961360] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1014.962231] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1014.962565] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1014.962921] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9496f4d5-71fb-471e-bab0-2220819ba7ed',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1014.964194] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock port-d81f6fa4-27ad-4fcc-bc24-157f2e6e915b taken with stack trace [, , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1014.964521] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-d81f6fa4-27ad-4fcc-bc24-157f2e6e915b" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1014.964944] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-d81f6fa4-27ad-4fcc-bc24-157f2e6e915b" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1014.964944] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-d81f6fa4-27ad-4fcc-bc24-157f2e6e915b" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1014.965652] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d81f6fa4-27ad-4fcc-bc24-157f2e6e915b',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1015.272370] env[65370]: DEBUG networking_nsxv3.common.locking [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Lock network-309 taken with stack trace [, , , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1015.272773] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquiring lock "network-309" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1015.273213] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquired lock "network-309" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1015.273763] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquired external semaphore "network-309" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1015.274163] env[65370]: DEBUG networking_nsxv3.common.locking [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1015.274423] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquiring lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1015.274659] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquired lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1015.275085] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquired external semaphore "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1015.275346] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Releasing lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1015.276337] env[65370]: DEBUG dogpile.cache.region [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] No value present for key: 'zone-id' {{(pid=65370) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1015.276507] env[65370]: DEBUG dogpile.lock [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] NeedRegenerationException {{(pid=65370) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1015.276677] env[65370]: DEBUG dogpile.lock [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] no value, waiting for create lock {{(pid=65370) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1015.276751] env[65370]: DEBUG dogpile.lock [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] value creation lock acquired {{(pid=65370) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1015.276859] env[65370]: DEBUG dogpile.cache.region [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] No value present for key: 'zone-id' {{(pid=65370) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1015.276986] env[65370]: DEBUG dogpile.lock [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Calling creation function for not-yet-present value {{(pid=65370) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1015.277143] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1015.301524] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1015.301767] env[65370]: DEBUG dogpile.cache.region [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Cache value generated in 0.025 seconds for key(s): 'zone-id' {{(pid=65370) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1015.301920] env[65370]: DEBUG dogpile.lock [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Released creation lock {{(pid=65370) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1015.302315] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Releasing lock "network-309" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1015.302988] env[65370]: DEBUG networking_nsxv3.common.locking [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Lock port-88c391b7-ce5e-49ee-8d09-789ef40043db taken with stack trace [, , , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1015.303256] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquiring lock "port-88c391b7-ce5e-49ee-8d09-789ef40043db" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1015.303427] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquired lock "port-88c391b7-ce5e-49ee-8d09-789ef40043db" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1015.303846] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquired external semaphore "port-88c391b7-ce5e-49ee-8d09-789ef40043db" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1015.304043] env[65370]: DEBUG networking_nsxv3.api.rpc [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('88c391b7-ce5e-49ee-8d09-789ef40043db',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1015.467570] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('9496f4d5-71fb-471e-bab0-2220819ba7ed',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1015.468633] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock member-9496f4d5-71fb-471e-bab0-2220819ba7ed taken with stack trace [, , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1015.468781] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9496f4d5-71fb-471e-bab0-2220819ba7ed" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1015.469116] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port d81f6fa4-27ad-4fcc-bc24-157f2e6e915b with status ACTIVE [ 1015.469506] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1015.469506] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1015.469506] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1015.469743] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1015.469778] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1015.470047] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1015.470047] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1015.470171] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1015.470240] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1015.470343] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1015.470485] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1015.470581] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1015.470635] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1015.470753] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1015.470826] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1015.470911] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: d81f6fa4-27ad-4fcc-bc24-157f2e6e915b is going to be updated. [ 1015.587038] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1015.587038] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1015.587038] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1015.587038] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1015.587430] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1015.587599] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-d81f6fa4-27ad-4fcc-bc24-157f2e6e915b" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1015.686937] env[65370]: INFO networking_nsxv3.common.synchronization [None req-5894ed0d-ef1c-4c43-99c9-b368e75bbf1f None None] Enqueued Resource ID: 5d56bdf9-610b-4270-b087-09e9c9481926 with Priority: HIGHEST for action port [ 1015.687677] env[65370]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5d56bdf9-610b-4270-b087-09e9c9481926 with Priority: HIGHEST for action port [ 1015.687987] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock port-5d56bdf9-610b-4270-b087-09e9c9481926 taken with stack trace [, , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1015.688663] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-5d56bdf9-610b-4270-b087-09e9c9481926" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1015.688791] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-5d56bdf9-610b-4270-b087-09e9c9481926" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1015.689106] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-5d56bdf9-610b-4270-b087-09e9c9481926" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1015.689246] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5d56bdf9-610b-4270-b087-09e9c9481926',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1015.807155] env[65370]: DEBUG networking_nsxv3.common.locking [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1015.807861] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquiring lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1015.808008] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquired lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1015.808383] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquired external semaphore "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1015.808552] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Releasing lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1015.808715] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Segment Port 88c391b7-ce5e-49ee-8d09-789ef40043db not found, creating... [ 1015.809032] env[65370]: DEBUG networking_nsxv3.common.locking [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1015.809217] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquiring lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1015.809408] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquired lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1015.809765] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquired external semaphore "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1015.809990] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Releasing lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1015.811226] env[65370]: DEBUG networking_nsxv3.common.locking [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1015.811609] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquiring lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1015.812079] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquired lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1015.812384] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquired external semaphore "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1015.812592] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Releasing lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1015.812947] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Resource: SegmentPort with ID: 88c391b7-ce5e-49ee-8d09-789ef40043db is going to be created. [ 1015.845929] env[65370]: DEBUG networking_nsxv3.common.locking [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1015.846179] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquiring lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1015.846304] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquired lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1015.846585] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquired external semaphore "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1015.846877] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Releasing lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1015.847087] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Releasing lock "port-88c391b7-ce5e-49ee-8d09-789ef40043db" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1015.970351] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('9496f4d5-71fb-471e-bab0-2220819ba7ed',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1016.192474] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 5d56bdf9-610b-4270-b087-09e9c9481926 [ 1016.192726] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1016.192862] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1016.192929] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1016.193182] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1016.193306] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1016.193406] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:5d56bdf9-610b-4270-b087-09e9c9481926 already deleted. [ 1016.193489] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-5d56bdf9-610b-4270-b087-09e9c9481926" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1016.355700] env[65370]: INFO networking_nsxv3.common.synchronization [req-44a4cf01-7726-46e4-b56a-191c75c1851a req-16145d76-bd5a-4b28-b7c2-79b78ef2d547 tempest-ServerAddressesTestJSON-1719711035 tempest-ServerAddressesTestJSON-1719711035-project-member] Enqueued Resource ID: 48262726-1476-4e14-ad49-3cb37aeed405 with Priority: HIGHEST for action security_group_members [ 1016.356383] env[65370]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 48262726-1476-4e14-ad49-3cb37aeed405 with Priority: HIGHEST for action security_group_members [ 1016.356595] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock member-48262726-1476-4e14-ad49-3cb37aeed405 taken with stack trace [, , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1016.356708] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-48262726-1476-4e14-ad49-3cb37aeed405" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1016.356784] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-48262726-1476-4e14-ad49-3cb37aeed405" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1016.357047] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-48262726-1476-4e14-ad49-3cb37aeed405" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1016.357232] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1016.357343] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1016.357401] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1016.358030] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1016.358030] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1016.358030] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('48262726-1476-4e14-ad49-3cb37aeed405',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1016.474240] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1016.474240] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1016.474240] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1016.474240] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1016.474240] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1016.474240] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9496f4d5-71fb-471e-bab0-2220819ba7ed is going to be created. [ 1016.501981] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1016.501981] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1016.501981] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1016.502294] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1016.502294] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1016.517245] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9496f4d5-71fb-471e-bab0-2220819ba7ed in Status: UNINITIALIZED for 2s [ 1016.547033] env[65370]: INFO networking_nsxv3.common.synchronization [req-fffc49d4-0145-4bf0-a2c9-20691264111b req-83ec759f-49bd-400b-955e-07adf7f8c07d service nova] Enqueued Resource ID: 826ed52a-9222-434f-a4f9-e83fd60a5345 with Priority: HIGHEST for action security_group_rules [ 1016.547033] env[65370]: INFO networking_nsxv3.common.synchronization [req-fffc49d4-0145-4bf0-a2c9-20691264111b req-83ec759f-49bd-400b-955e-07adf7f8c07d service nova] Enqueued Resource ID: 826ed52a-9222-434f-a4f9-e83fd60a5345 with Priority: HIGHEST for action security_group_members [ 1016.547184] env[65370]: INFO networking_nsxv3.common.synchronization [req-fffc49d4-0145-4bf0-a2c9-20691264111b req-83ec759f-49bd-400b-955e-07adf7f8c07d service nova] Enqueued Resource ID: 88c391b7-ce5e-49ee-8d09-789ef40043db with Priority: HIGHEST for action port [ 1016.547892] env[65370]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 826ed52a-9222-434f-a4f9-e83fd60a5345 with Priority: HIGHEST for action security_group_rules [ 1016.547892] env[65370]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 826ed52a-9222-434f-a4f9-e83fd60a5345 with Priority: HIGHEST for action security_group_members [ 1016.548044] env[65370]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 88c391b7-ce5e-49ee-8d09-789ef40043db with Priority: HIGHEST for action port [ 1016.548427] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock rules-826ed52a-9222-434f-a4f9-e83fd60a5345 taken with stack trace [, , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1016.548587] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-826ed52a-9222-434f-a4f9-e83fd60a5345" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1016.548677] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-826ed52a-9222-434f-a4f9-e83fd60a5345" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1016.548952] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-826ed52a-9222-434f-a4f9-e83fd60a5345" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1016.549078] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('826ed52a-9222-434f-a4f9-e83fd60a5345',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1016.550142] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock member-826ed52a-9222-434f-a4f9-e83fd60a5345 taken with stack trace [, , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1016.550302] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-826ed52a-9222-434f-a4f9-e83fd60a5345" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1016.550397] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-826ed52a-9222-434f-a4f9-e83fd60a5345" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1016.550619] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-826ed52a-9222-434f-a4f9-e83fd60a5345" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1016.550822] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1016.550971] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1016.551073] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1016.551248] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1016.551359] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1016.551473] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('826ed52a-9222-434f-a4f9-e83fd60a5345',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1016.552323] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock port-88c391b7-ce5e-49ee-8d09-789ef40043db taken with stack trace [, , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1016.552475] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-88c391b7-ce5e-49ee-8d09-789ef40043db" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1016.552556] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-88c391b7-ce5e-49ee-8d09-789ef40043db" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1016.552708] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-88c391b7-ce5e-49ee-8d09-789ef40043db" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1016.552783] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('88c391b7-ce5e-49ee-8d09-789ef40043db',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1016.846231] env[65370]: DEBUG networking_nsxv3.common.locking [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Lock network-969 taken with stack trace [, , , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1016.847044] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquiring lock "network-969" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1016.847378] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquired lock "network-969" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1016.847743] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquired external semaphore "network-969" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1016.848225] env[65370]: DEBUG networking_nsxv3.common.locking [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1016.848552] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquiring lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1016.848657] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquired lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1016.848878] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquired external semaphore "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1016.849041] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Releasing lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1016.849305] env[65370]: DEBUG dogpile.cache.region [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] No value present for key: 'zone-id' {{(pid=65370) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1016.849434] env[65370]: DEBUG dogpile.lock [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] NeedRegenerationException {{(pid=65370) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1016.849564] env[65370]: DEBUG dogpile.lock [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] no value, waiting for create lock {{(pid=65370) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1016.849711] env[65370]: DEBUG dogpile.lock [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] value creation lock acquired {{(pid=65370) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1016.849830] env[65370]: DEBUG dogpile.cache.region [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] No value present for key: 'zone-id' {{(pid=65370) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1016.850105] env[65370]: DEBUG dogpile.lock [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Calling creation function for not-yet-present value {{(pid=65370) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1016.850105] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1016.859929] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1016.860157] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1016.860260] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1016.860498] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1016.860625] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1016.860854] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1016.860989] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1016.861092] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1016.861277] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1016.861390] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1016.861634] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 48262726-1476-4e14-ad49-3cb37aeed405 already deleted. [ 1016.861634] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-48262726-1476-4e14-ad49-3cb37aeed405" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1016.869211] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1016.869371] env[65370]: DEBUG dogpile.cache.region [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=65370) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1016.869545] env[65370]: DEBUG dogpile.lock [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Released creation lock {{(pid=65370) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1016.869761] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Releasing lock "network-969" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1016.870141] env[65370]: DEBUG networking_nsxv3.common.locking [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Lock port-9fa0d06d-96b2-4001-82ce-062738430164 taken with stack trace [, , , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1016.870385] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquiring lock "port-9fa0d06d-96b2-4001-82ce-062738430164" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1016.870559] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquired lock "port-9fa0d06d-96b2-4001-82ce-062738430164" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1016.870890] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquired external semaphore "port-9fa0d06d-96b2-4001-82ce-062738430164" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1016.871083] env[65370]: DEBUG networking_nsxv3.api.rpc [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9fa0d06d-96b2-4001-82ce-062738430164',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1016.944151] env[65370]: INFO networking_nsxv3.common.synchronization [req-83b256b8-ffda-4cab-a640-e65456dd3980 req-9d0eb39a-968b-4f33-b762-9c0a65a0a3b5 tempest-AttachVolumeNegativeTest-719365731 tempest-AttachVolumeNegativeTest-719365731-project-member] Enqueued Resource ID: a64b2117-cdc3-4b72-a9f3-57dfa8198991 with Priority: HIGHEST for action security_group_members [ 1016.946519] env[65370]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a64b2117-cdc3-4b72-a9f3-57dfa8198991 with Priority: HIGHEST for action security_group_members [ 1016.947503] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock member-a64b2117-cdc3-4b72-a9f3-57dfa8198991 taken with stack trace [, , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1016.947503] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a64b2117-cdc3-4b72-a9f3-57dfa8198991" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1016.947503] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a64b2117-cdc3-4b72-a9f3-57dfa8198991" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1016.947703] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a64b2117-cdc3-4b72-a9f3-57dfa8198991" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1016.948326] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1016.948326] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1016.948326] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1016.948326] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1016.948326] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1016.948555] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a64b2117-cdc3-4b72-a9f3-57dfa8198991',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1017.057429] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock member-826ed52a-9222-434f-a4f9-e83fd60a5345 taken with stack trace [, , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1017.057429] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-826ed52a-9222-434f-a4f9-e83fd60a5345" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1017.057429] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('826ed52a-9222-434f-a4f9-e83fd60a5345',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1017.058730] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 88c391b7-ce5e-49ee-8d09-789ef40043db with status ACTIVE [ 1017.058730] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1017.058730] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1017.058730] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1017.058730] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1017.058977] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1017.058977] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1017.059096] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1017.059158] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1017.059276] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1017.059342] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1017.059528] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1017.059614] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1017.059671] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1017.060591] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1017.060591] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1017.060591] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 88c391b7-ce5e-49ee-8d09-789ef40043db is going to be updated. [ 1017.085799] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1017.086053] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1017.086135] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1017.086389] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1017.086546] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1017.086829] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-88c391b7-ce5e-49ee-8d09-789ef40043db" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1017.374157] env[65370]: DEBUG networking_nsxv3.common.locking [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1017.374485] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquiring lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1017.376588] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquired lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1017.376588] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquired external semaphore "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1017.376588] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Releasing lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1017.376588] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Segment Port 9fa0d06d-96b2-4001-82ce-062738430164 not found, creating... [ 1017.376588] env[65370]: DEBUG networking_nsxv3.common.locking [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1017.376588] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquiring lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1017.376588] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquired lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1017.376588] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquired external semaphore "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1017.376588] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Releasing lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1017.378655] env[65370]: DEBUG networking_nsxv3.common.locking [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1017.378655] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquiring lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1017.378655] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquired lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1017.380030] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquired external semaphore "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1017.380030] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Releasing lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1017.380030] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Resource: SegmentPort with ID: 9fa0d06d-96b2-4001-82ce-062738430164 is going to be created. [ 1017.404099] env[65370]: DEBUG networking_nsxv3.common.locking [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1017.404277] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquiring lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1017.405281] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquired lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1017.405281] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquired external semaphore "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1017.405281] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Releasing lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1017.405281] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Releasing lock "port-9fa0d06d-96b2-4001-82ce-062738430164" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1017.451069] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1017.451246] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1017.451319] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1017.451538] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1017.451627] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1017.451833] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1017.451974] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1017.451974] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1017.452141] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1017.452215] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1017.452301] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a64b2117-cdc3-4b72-a9f3-57dfa8198991 is going to be updated. [ 1017.511334] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1017.511540] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1017.511540] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1017.511761] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1017.511906] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1017.522805] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a64b2117-cdc3-4b72-a9f3-57dfa8198991 in Status: IN_PROGRESS for 2s [ 1017.562312] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('826ed52a-9222-434f-a4f9-e83fd60a5345',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1018.066597] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1018.066783] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1018.066847] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1018.068019] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1018.068019] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1018.068019] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 826ed52a-9222-434f-a4f9-e83fd60a5345 is going to be created. [ 1018.091231] env[65370]: INFO networking_nsxv3.common.synchronization [None req-a95a865a-5ea0-4ba4-a8ed-c27d952bdd3a tempest-AttachVolumeShelveTestJSON-478164993 tempest-AttachVolumeShelveTestJSON-478164993-project-member] Enqueued Resource ID: 154b7e30-9d22-43f4-84bb-7d8dd4d7cc9a with Priority: HIGHEST for action security_group_rules [ 1018.091944] env[65370]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 154b7e30-9d22-43f4-84bb-7d8dd4d7cc9a with Priority: HIGHEST for action security_group_rules [ 1018.093930] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock rules-154b7e30-9d22-43f4-84bb-7d8dd4d7cc9a taken with stack trace [, , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1018.093930] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-154b7e30-9d22-43f4-84bb-7d8dd4d7cc9a" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1018.093930] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-154b7e30-9d22-43f4-84bb-7d8dd4d7cc9a" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1018.093930] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-154b7e30-9d22-43f4-84bb-7d8dd4d7cc9a" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1018.093930] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('154b7e30-9d22-43f4-84bb-7d8dd4d7cc9a',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1018.095837] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1018.095959] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1018.096032] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1018.096189] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1018.096347] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1018.108593] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 826ed52a-9222-434f-a4f9-e83fd60a5345 in Status: UNINITIALIZED for 2s [ 1018.145344] env[65370]: INFO networking_nsxv3.common.synchronization [req-44a4cf01-7726-46e4-b56a-191c75c1851a req-34d1706e-a40c-42cc-9159-2ea82f7143f9 service nova] Enqueued Resource ID: 48262726-1476-4e14-ad49-3cb37aeed405 with Priority: HIGHEST for action security_group_rules [ 1018.145344] env[65370]: INFO networking_nsxv3.common.synchronization [req-44a4cf01-7726-46e4-b56a-191c75c1851a req-34d1706e-a40c-42cc-9159-2ea82f7143f9 service nova] Enqueued Resource ID: 48262726-1476-4e14-ad49-3cb37aeed405 with Priority: HIGHEST for action security_group_members [ 1018.145593] env[65370]: INFO networking_nsxv3.common.synchronization [req-44a4cf01-7726-46e4-b56a-191c75c1851a req-34d1706e-a40c-42cc-9159-2ea82f7143f9 service nova] Enqueued Resource ID: 9fa0d06d-96b2-4001-82ce-062738430164 with Priority: HIGHEST for action port [ 1018.146091] env[65370]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 48262726-1476-4e14-ad49-3cb37aeed405 with Priority: HIGHEST for action security_group_rules [ 1018.146191] env[65370]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 48262726-1476-4e14-ad49-3cb37aeed405 with Priority: HIGHEST for action security_group_members [ 1018.146900] env[65370]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9fa0d06d-96b2-4001-82ce-062738430164 with Priority: HIGHEST for action port [ 1018.147286] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock rules-48262726-1476-4e14-ad49-3cb37aeed405 taken with stack trace [, , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1018.148039] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-48262726-1476-4e14-ad49-3cb37aeed405" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1018.148186] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-48262726-1476-4e14-ad49-3cb37aeed405" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1018.148483] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-48262726-1476-4e14-ad49-3cb37aeed405" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1018.148599] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('48262726-1476-4e14-ad49-3cb37aeed405',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1018.151805] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock member-48262726-1476-4e14-ad49-3cb37aeed405 taken with stack trace [, , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1018.153697] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-48262726-1476-4e14-ad49-3cb37aeed405" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1018.153697] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-48262726-1476-4e14-ad49-3cb37aeed405" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1018.153697] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-48262726-1476-4e14-ad49-3cb37aeed405" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1018.153697] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1018.153697] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1018.153697] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1018.153697] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1018.153697] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1018.153697] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('48262726-1476-4e14-ad49-3cb37aeed405',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1018.158651] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock port-9fa0d06d-96b2-4001-82ce-062738430164 taken with stack trace [, , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1018.158651] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-9fa0d06d-96b2-4001-82ce-062738430164" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1018.158651] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-9fa0d06d-96b2-4001-82ce-062738430164" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1018.158651] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-9fa0d06d-96b2-4001-82ce-062738430164" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1018.158651] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9fa0d06d-96b2-4001-82ce-062738430164',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1018.272445] env[65370]: INFO networking_nsxv3.common.synchronization [None req-7ed511c6-2ed5-469b-8d00-335df074b913 tempest-AttachVolumeShelveTestJSON-478164993 tempest-AttachVolumeShelveTestJSON-478164993-project-member] Enqueued Resource ID: 154b7e30-9d22-43f4-84bb-7d8dd4d7cc9a with Priority: HIGHEST for action security_group_rules [ 1018.273458] env[65370]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 154b7e30-9d22-43f4-84bb-7d8dd4d7cc9a with Priority: HIGHEST for action security_group_rules [ 1018.274531] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock rules-154b7e30-9d22-43f4-84bb-7d8dd4d7cc9a taken with stack trace [, , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1018.274680] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-154b7e30-9d22-43f4-84bb-7d8dd4d7cc9a" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1018.476755] env[65370]: INFO networking_nsxv3.common.synchronization [req-63b2fc69-191a-4c75-b968-a35be948653d req-d937e032-cc0b-4e6b-8469-2958d93f0512 tempest-ListServerFiltersTestJSON-1679580052 tempest-ListServerFiltersTestJSON-1679580052-project-member] Enqueued Resource ID: 9496f4d5-71fb-471e-bab0-2220819ba7ed with Priority: HIGHEST for action security_group_members [ 1018.477438] env[65370]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9496f4d5-71fb-471e-bab0-2220819ba7ed with Priority: HIGHEST for action security_group_members [ 1018.479023] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock member-9496f4d5-71fb-471e-bab0-2220819ba7ed taken with stack trace [, , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1018.479023] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9496f4d5-71fb-471e-bab0-2220819ba7ed" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1018.524268] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9496f4d5-71fb-471e-bab0-2220819ba7ed in Status: SUCCESS [ 1018.524474] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9496f4d5-71fb-471e-bab0-2220819ba7ed" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1018.524631] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9496f4d5-71fb-471e-bab0-2220819ba7ed" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1018.524843] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9496f4d5-71fb-471e-bab0-2220819ba7ed" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1018.525041] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1018.525177] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1018.525286] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1018.525397] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1018.525513] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1018.525550] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9496f4d5-71fb-471e-bab0-2220819ba7ed" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1018.525631] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('9496f4d5-71fb-471e-bab0-2220819ba7ed',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1018.526490] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9496f4d5-71fb-471e-bab0-2220819ba7ed" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1018.526652] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9496f4d5-71fb-471e-bab0-2220819ba7ed" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1018.526818] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1018.526904] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1018.526962] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1018.527111] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1018.527184] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1018.527293] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9496f4d5-71fb-471e-bab0-2220819ba7ed',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1018.617754] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1018.617902] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1018.617969] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1018.618224] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1018.618332] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1018.618438] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 154b7e30-9d22-43f4-84bb-7d8dd4d7cc9a already deleted. [ 1018.618523] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-154b7e30-9d22-43f4-84bb-7d8dd4d7cc9a" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1018.618668] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-154b7e30-9d22-43f4-84bb-7d8dd4d7cc9a" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1018.619145] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-154b7e30-9d22-43f4-84bb-7d8dd4d7cc9a" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1018.619145] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('154b7e30-9d22-43f4-84bb-7d8dd4d7cc9a',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1018.665990] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 9fa0d06d-96b2-4001-82ce-062738430164 with status ACTIVE [ 1018.666247] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1018.666389] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1018.666451] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1018.666669] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1018.666787] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1018.667339] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1018.667339] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1018.667339] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1018.667339] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1018.667556] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1018.667556] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1018.667660] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1018.667714] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1018.667861] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1018.667935] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1018.668046] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 9fa0d06d-96b2-4001-82ce-062738430164 is going to be updated. [ 1018.671032] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('48262726-1476-4e14-ad49-3cb37aeed405',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1018.671148] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock member-48262726-1476-4e14-ad49-3cb37aeed405 taken with stack trace [, , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1018.671241] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-48262726-1476-4e14-ad49-3cb37aeed405" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1018.705340] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1018.705661] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1018.705756] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1018.706024] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1018.706169] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1018.706352] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-9fa0d06d-96b2-4001-82ce-062738430164" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1018.723673] env[65370]: INFO networking_nsxv3.common.synchronization [None req-157b204f-280a-43d3-9ae3-ad4353740f65 None None] Enqueued Resource ID: 9bd07213-7bb2-47b4-8ec2-ab54c239372f with Priority: HIGHEST for action port [ 1018.724577] env[65370]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9bd07213-7bb2-47b4-8ec2-ab54c239372f with Priority: HIGHEST for action port [ 1018.724987] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock port-9bd07213-7bb2-47b4-8ec2-ab54c239372f taken with stack trace [, , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1018.725897] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-9bd07213-7bb2-47b4-8ec2-ab54c239372f" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1018.725897] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-9bd07213-7bb2-47b4-8ec2-ab54c239372f" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1018.725897] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-9bd07213-7bb2-47b4-8ec2-ab54c239372f" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1018.726053] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9bd07213-7bb2-47b4-8ec2-ab54c239372f',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1018.897035] env[65370]: DEBUG networking_nsxv3.common.locking [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Lock network-392 taken with stack trace [, , , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1018.897035] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquiring lock "network-392" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1018.897035] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquired lock "network-392" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1018.897035] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquired external semaphore "network-392" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1018.897035] env[65370]: DEBUG networking_nsxv3.common.locking [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1018.897035] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquiring lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1018.897035] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquired lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1018.897035] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquired external semaphore "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1018.897035] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Releasing lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1018.897035] env[65370]: DEBUG dogpile.cache.region [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] No value present for key: 'zone-id' {{(pid=65370) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1018.897687] env[65370]: DEBUG dogpile.lock [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] NeedRegenerationException {{(pid=65370) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1018.897993] env[65370]: DEBUG dogpile.lock [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] no value, waiting for create lock {{(pid=65370) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1018.898459] env[65370]: DEBUG dogpile.lock [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] value creation lock acquired {{(pid=65370) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1018.898703] env[65370]: DEBUG dogpile.cache.region [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] No value present for key: 'zone-id' {{(pid=65370) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1018.898914] env[65370]: DEBUG dogpile.lock [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Calling creation function for not-yet-present value {{(pid=65370) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1018.899250] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1018.921758] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1018.921758] env[65370]: DEBUG dogpile.cache.region [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=65370) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1018.921758] env[65370]: DEBUG dogpile.lock [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Released creation lock {{(pid=65370) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1018.921758] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Releasing lock "network-392" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1018.921758] env[65370]: DEBUG networking_nsxv3.common.locking [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Lock port-9dbc455c-39e0-4164-968b-62bb284a89fd taken with stack trace [, , , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1018.921758] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquiring lock "port-9dbc455c-39e0-4164-968b-62bb284a89fd" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1018.921758] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquired lock "port-9dbc455c-39e0-4164-968b-62bb284a89fd" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1018.921758] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquired external semaphore "port-9dbc455c-39e0-4164-968b-62bb284a89fd" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1018.921758] env[65370]: DEBUG networking_nsxv3.api.rpc [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9dbc455c-39e0-4164-968b-62bb284a89fd',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1019.028911] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock member-9496f4d5-71fb-471e-bab0-2220819ba7ed taken with stack trace [, , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1019.029078] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9496f4d5-71fb-471e-bab0-2220819ba7ed" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1019.034207] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('9496f4d5-71fb-471e-bab0-2220819ba7ed',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1019.142445] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1019.142617] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1019.142617] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1019.142892] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1019.142986] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1019.143102] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 154b7e30-9d22-43f4-84bb-7d8dd4d7cc9a already deleted. [ 1019.143183] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-154b7e30-9d22-43f4-84bb-7d8dd4d7cc9a" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1019.173397] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('48262726-1476-4e14-ad49-3cb37aeed405',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1019.229198] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 9bd07213-7bb2-47b4-8ec2-ab54c239372f [ 1019.229272] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1019.229428] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1019.229482] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1019.229882] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1019.230046] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1019.230152] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:9bd07213-7bb2-47b4-8ec2-ab54c239372f already deleted. [ 1019.230238] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-9bd07213-7bb2-47b4-8ec2-ab54c239372f" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1019.424537] env[65370]: DEBUG networking_nsxv3.common.locking [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1019.426505] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquiring lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1019.426505] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquired lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1019.426505] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquired external semaphore "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1019.426505] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Releasing lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1019.426505] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Segment Port 9dbc455c-39e0-4164-968b-62bb284a89fd not found, creating... [ 1019.426505] env[65370]: DEBUG networking_nsxv3.common.locking [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1019.426505] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquiring lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1019.426505] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquired lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1019.426505] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquired external semaphore "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1019.426505] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Releasing lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1019.427187] env[65370]: DEBUG networking_nsxv3.common.locking [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1019.427187] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquiring lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1019.427187] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquired lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1019.427187] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquired external semaphore "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1019.427483] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Releasing lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1019.427483] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Resource: SegmentPort with ID: 9dbc455c-39e0-4164-968b-62bb284a89fd is going to be created. [ 1019.449272] env[65370]: DEBUG networking_nsxv3.common.locking [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1019.449507] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquiring lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1019.449626] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquired lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1019.449883] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquired external semaphore "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1019.450116] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Releasing lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1019.450377] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Releasing lock "port-9dbc455c-39e0-4164-968b-62bb284a89fd" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1019.536914] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('9496f4d5-71fb-471e-bab0-2220819ba7ed',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1019.539133] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a64b2117-cdc3-4b72-a9f3-57dfa8198991 in Status: SUCCESS [ 1019.539327] env[65370]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a64b2117-cdc3-4b72-a9f3-57dfa8198991 deletion is rescheduled due to dependency. [ 1019.539429] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a64b2117-cdc3-4b72-a9f3-57dfa8198991" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1019.676570] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1019.676733] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1019.676834] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1019.678048] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1019.678048] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1019.678048] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 48262726-1476-4e14-ad49-3cb37aeed405 is going to be created. [ 1019.701830] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1019.702040] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1019.702091] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1019.702481] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1019.702670] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1019.715359] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 48262726-1476-4e14-ad49-3cb37aeed405 in Status: UNINITIALIZED for 2s [ 1020.042232] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1020.042232] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1020.042232] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1020.042232] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1020.042232] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1020.042232] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9496f4d5-71fb-471e-bab0-2220819ba7ed is going to be updated. [ 1020.072975] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1020.072975] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1020.072975] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1020.073397] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1020.073513] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1020.086198] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9496f4d5-71fb-471e-bab0-2220819ba7ed in Status: IN_PROGRESS for 2s [ 1020.120678] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 826ed52a-9222-434f-a4f9-e83fd60a5345 in Status: SUCCESS [ 1020.120977] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-826ed52a-9222-434f-a4f9-e83fd60a5345" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1020.121183] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-826ed52a-9222-434f-a4f9-e83fd60a5345" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1020.122611] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-826ed52a-9222-434f-a4f9-e83fd60a5345" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1020.122894] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1020.123071] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1020.123188] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1020.123413] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1020.123528] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1020.123632] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-826ed52a-9222-434f-a4f9-e83fd60a5345" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1020.123830] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('826ed52a-9222-434f-a4f9-e83fd60a5345',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1020.215253] env[65370]: INFO networking_nsxv3.common.synchronization [req-63b2fc69-191a-4c75-b968-a35be948653d req-71ab00b9-5f98-45f7-9607-466d6895fe03 service nova] Enqueued Resource ID: 9496f4d5-71fb-471e-bab0-2220819ba7ed with Priority: HIGHEST for action security_group_rules [ 1020.218593] env[65370]: INFO networking_nsxv3.common.synchronization [req-63b2fc69-191a-4c75-b968-a35be948653d req-71ab00b9-5f98-45f7-9607-466d6895fe03 service nova] Enqueued Resource ID: 9496f4d5-71fb-471e-bab0-2220819ba7ed with Priority: HIGHEST for action security_group_members [ 1020.218593] env[65370]: INFO networking_nsxv3.common.synchronization [req-63b2fc69-191a-4c75-b968-a35be948653d req-71ab00b9-5f98-45f7-9607-466d6895fe03 service nova] Enqueued Resource ID: 9dbc455c-39e0-4164-968b-62bb284a89fd with Priority: HIGHEST for action port [ 1020.218593] env[65370]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9496f4d5-71fb-471e-bab0-2220819ba7ed with Priority: HIGHEST for action security_group_rules [ 1020.218593] env[65370]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9496f4d5-71fb-471e-bab0-2220819ba7ed with Priority: HIGHEST for action security_group_members [ 1020.218593] env[65370]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9dbc455c-39e0-4164-968b-62bb284a89fd with Priority: HIGHEST for action port [ 1020.218593] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock rules-9496f4d5-71fb-471e-bab0-2220819ba7ed taken with stack trace [, , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1020.218593] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-9496f4d5-71fb-471e-bab0-2220819ba7ed" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1020.218593] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock member-9496f4d5-71fb-471e-bab0-2220819ba7ed taken with stack trace [, , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1020.218593] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9496f4d5-71fb-471e-bab0-2220819ba7ed" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1020.218593] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock port-9dbc455c-39e0-4164-968b-62bb284a89fd taken with stack trace [, , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1020.218593] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-9dbc455c-39e0-4164-968b-62bb284a89fd" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1020.218593] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-9dbc455c-39e0-4164-968b-62bb284a89fd" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1020.218593] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-9dbc455c-39e0-4164-968b-62bb284a89fd" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1020.218593] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9dbc455c-39e0-4164-968b-62bb284a89fd',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1020.627018] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock member-826ed52a-9222-434f-a4f9-e83fd60a5345 taken with stack trace [, , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1020.627462] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-826ed52a-9222-434f-a4f9-e83fd60a5345" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1020.627462] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-826ed52a-9222-434f-a4f9-e83fd60a5345" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1020.627724] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-826ed52a-9222-434f-a4f9-e83fd60a5345" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1020.627993] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1020.628198] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1020.628320] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1020.628580] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1020.628715] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1020.628847] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-826ed52a-9222-434f-a4f9-e83fd60a5345" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1020.629118] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock member-826ed52a-9222-434f-a4f9-e83fd60a5345 taken with stack trace [, , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1020.629264] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-826ed52a-9222-434f-a4f9-e83fd60a5345" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1020.629356] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-826ed52a-9222-434f-a4f9-e83fd60a5345" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1020.629583] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-826ed52a-9222-434f-a4f9-e83fd60a5345" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1020.629788] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1020.629922] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1020.630027] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1020.630231] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1020.630349] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1020.630473] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-826ed52a-9222-434f-a4f9-e83fd60a5345" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1020.630629] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('826ed52a-9222-434f-a4f9-e83fd60a5345',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1020.721258] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 9dbc455c-39e0-4164-968b-62bb284a89fd with status ACTIVE [ 1020.721258] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1020.721258] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1020.721258] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1020.721258] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1020.721258] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1020.721541] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1020.721541] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1020.721541] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1020.721696] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1020.721853] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1020.722086] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1020.722288] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1020.722288] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1020.722487] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1020.722487] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1020.722487] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 9dbc455c-39e0-4164-968b-62bb284a89fd is going to be updated. [ 1020.756206] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1020.756557] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1020.756638] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1020.756873] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1020.757026] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1020.757196] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-9dbc455c-39e0-4164-968b-62bb284a89fd" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1020.839172] env[65370]: INFO networking_nsxv3.common.synchronization [req-04088e12-4c3a-4453-bb58-ac95c02aba28 req-b02ff267-82dc-41b3-9c54-70a6b6b7576c tempest-ListServerFiltersTestJSON-1679580052 tempest-ListServerFiltersTestJSON-1679580052-project-member] Enqueued Resource ID: 9496f4d5-71fb-471e-bab0-2220819ba7ed with Priority: HIGHEST for action security_group_members [ 1020.839933] env[65370]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9496f4d5-71fb-471e-bab0-2220819ba7ed with Priority: HIGHEST for action security_group_members [ 1020.840661] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock member-9496f4d5-71fb-471e-bab0-2220819ba7ed taken with stack trace [, , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1020.840661] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9496f4d5-71fb-471e-bab0-2220819ba7ed" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1021.134011] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 826ed52a-9222-434f-a4f9-e83fd60a5345: rpc.has_security_group_logging(os_id): False [ 1021.159365] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1021.159561] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1021.159561] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1021.159859] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1021.159859] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1021.160051] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1021.160128] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1021.160164] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1021.160314] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1021.160391] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1021.160573] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1021.160664] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1021.160726] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1021.160888] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1021.160960] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1021.161572] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1021.161676] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1021.161741] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1021.161888] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1021.161965] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1021.162064] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 826ed52a-9222-434f-a4f9-e83fd60a5345 is going to be created. [ 1021.165884] env[65370]: DEBUG networking_nsxv3.common.locking [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Lock network-392 taken with stack trace [, , , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1021.166148] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquiring lock "network-392" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1021.166275] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquired lock "network-392" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1021.167193] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquired external semaphore "network-392" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1021.167579] env[65370]: DEBUG networking_nsxv3.common.locking [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1021.167754] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquiring lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1021.167870] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquired lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1021.168166] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquired external semaphore "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1021.168386] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Releasing lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1021.168618] env[65370]: DEBUG dogpile.cache.region [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] No value present for key: 'zone-id' {{(pid=65370) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1021.168719] env[65370]: DEBUG dogpile.lock [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] NeedRegenerationException {{(pid=65370) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1021.168930] env[65370]: DEBUG dogpile.lock [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] no value, waiting for create lock {{(pid=65370) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1021.169044] env[65370]: DEBUG dogpile.lock [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] value creation lock acquired {{(pid=65370) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1021.169105] env[65370]: DEBUG dogpile.cache.region [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] No value present for key: 'zone-id' {{(pid=65370) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1021.169368] env[65370]: DEBUG dogpile.lock [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Calling creation function for not-yet-present value {{(pid=65370) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1021.169594] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1021.196654] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1021.196654] env[65370]: DEBUG dogpile.cache.region [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Cache value generated in 0.026 seconds for key(s): 'zone-id' {{(pid=65370) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1021.196654] env[65370]: DEBUG dogpile.lock [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Released creation lock {{(pid=65370) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1021.196654] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Releasing lock "network-392" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1021.196654] env[65370]: DEBUG networking_nsxv3.common.locking [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Lock port-ac0bf02c-a45b-4f24-8fbd-39c68d35ae19 taken with stack trace [, , , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1021.196654] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquiring lock "port-ac0bf02c-a45b-4f24-8fbd-39c68d35ae19" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1021.196654] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquired lock "port-ac0bf02c-a45b-4f24-8fbd-39c68d35ae19" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1021.197164] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquired external semaphore "port-ac0bf02c-a45b-4f24-8fbd-39c68d35ae19" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1021.197164] env[65370]: DEBUG networking_nsxv3.api.rpc [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ac0bf02c-a45b-4f24-8fbd-39c68d35ae19',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1021.242884] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1021.243476] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1021.243476] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1021.243476] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1021.243704] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1021.261711] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 826ed52a-9222-434f-a4f9-e83fd60a5345 in Status: IN_PROGRESS for 2s [ 1021.699958] env[65370]: DEBUG networking_nsxv3.common.locking [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1021.700412] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquiring lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1021.700636] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquired lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1021.701131] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquired external semaphore "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1021.701247] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Releasing lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1021.701493] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Segment Port ac0bf02c-a45b-4f24-8fbd-39c68d35ae19 not found, creating... [ 1021.701880] env[65370]: DEBUG networking_nsxv3.common.locking [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1021.702655] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquiring lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1021.702655] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquired lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1021.702655] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquired external semaphore "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1021.702873] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Releasing lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1021.706024] env[65370]: DEBUG networking_nsxv3.common.locking [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1021.706024] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquiring lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1021.706024] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquired lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1021.706024] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquired external semaphore "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1021.706024] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Releasing lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1021.706024] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Resource: SegmentPort with ID: ac0bf02c-a45b-4f24-8fbd-39c68d35ae19 is going to be created. [ 1021.728167] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 48262726-1476-4e14-ad49-3cb37aeed405 in Status: SUCCESS [ 1021.728558] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-48262726-1476-4e14-ad49-3cb37aeed405" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1021.728767] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-48262726-1476-4e14-ad49-3cb37aeed405" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1021.729015] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-48262726-1476-4e14-ad49-3cb37aeed405" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1021.729219] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1021.729355] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1021.729429] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1021.729699] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1021.729813] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1021.729906] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-48262726-1476-4e14-ad49-3cb37aeed405" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1021.729996] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('48262726-1476-4e14-ad49-3cb37aeed405',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1021.740124] env[65370]: DEBUG networking_nsxv3.common.locking [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1021.740381] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquiring lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1021.740507] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquired lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1021.740815] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquired external semaphore "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1021.741107] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Releasing lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1021.741363] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Releasing lock "port-ac0bf02c-a45b-4f24-8fbd-39c68d35ae19" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1022.098864] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9496f4d5-71fb-471e-bab0-2220819ba7ed in Status: SUCCESS [ 1022.098974] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9496f4d5-71fb-471e-bab0-2220819ba7ed" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1022.099375] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9496f4d5-71fb-471e-bab0-2220819ba7ed" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1022.099479] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9496f4d5-71fb-471e-bab0-2220819ba7ed" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1022.099723] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1022.099895] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1022.099978] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1022.100180] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1022.100275] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1022.100397] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9496f4d5-71fb-471e-bab0-2220819ba7ed" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1022.100625] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock member-9496f4d5-71fb-471e-bab0-2220819ba7ed taken with stack trace [, , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1022.100696] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9496f4d5-71fb-471e-bab0-2220819ba7ed" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1022.100696] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9496f4d5-71fb-471e-bab0-2220819ba7ed" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1022.100865] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9496f4d5-71fb-471e-bab0-2220819ba7ed" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1022.101085] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1022.101270] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1022.101387] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1022.101626] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1022.101850] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1022.101927] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9496f4d5-71fb-471e-bab0-2220819ba7ed" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1022.102134] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('9496f4d5-71fb-471e-bab0-2220819ba7ed',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1022.103350] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9496f4d5-71fb-471e-bab0-2220819ba7ed" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1022.103634] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9496f4d5-71fb-471e-bab0-2220819ba7ed" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1022.103871] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1022.104069] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1022.104194] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1022.104452] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1022.104582] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1022.104728] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9496f4d5-71fb-471e-bab0-2220819ba7ed',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1022.232407] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock member-48262726-1476-4e14-ad49-3cb37aeed405 taken with stack trace [, , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1022.232609] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-48262726-1476-4e14-ad49-3cb37aeed405" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1022.232682] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-48262726-1476-4e14-ad49-3cb37aeed405" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1022.232923] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-48262726-1476-4e14-ad49-3cb37aeed405" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1022.233127] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1022.233232] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1022.233297] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1022.233463] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1022.233537] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1022.233649] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-48262726-1476-4e14-ad49-3cb37aeed405" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1022.233764] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock member-48262726-1476-4e14-ad49-3cb37aeed405 taken with stack trace [, , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1022.234054] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-48262726-1476-4e14-ad49-3cb37aeed405" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1022.234054] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-48262726-1476-4e14-ad49-3cb37aeed405" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1022.234054] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-48262726-1476-4e14-ad49-3cb37aeed405" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1022.234194] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1022.234285] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1022.234347] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1022.234480] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1022.234567] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1022.234653] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-48262726-1476-4e14-ad49-3cb37aeed405" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1022.234740] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('48262726-1476-4e14-ad49-3cb37aeed405',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1022.473514] env[65370]: INFO networking_nsxv3.common.synchronization [req-04088e12-4c3a-4453-bb58-ac95c02aba28 req-1f86d0c4-021c-44b2-9e51-f2ba57d95ae8 service nova] Enqueued Resource ID: 9496f4d5-71fb-471e-bab0-2220819ba7ed with Priority: HIGHEST for action security_group_rules [ 1022.473750] env[65370]: INFO networking_nsxv3.common.synchronization [req-04088e12-4c3a-4453-bb58-ac95c02aba28 req-1f86d0c4-021c-44b2-9e51-f2ba57d95ae8 service nova] Enqueued Resource ID: 9496f4d5-71fb-471e-bab0-2220819ba7ed with Priority: HIGHEST for action security_group_members [ 1022.473818] env[65370]: INFO networking_nsxv3.common.synchronization [req-04088e12-4c3a-4453-bb58-ac95c02aba28 req-1f86d0c4-021c-44b2-9e51-f2ba57d95ae8 service nova] Enqueued Resource ID: ac0bf02c-a45b-4f24-8fbd-39c68d35ae19 with Priority: HIGHEST for action port [ 1022.474365] env[65370]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9496f4d5-71fb-471e-bab0-2220819ba7ed with Priority: HIGHEST for action security_group_rules [ 1022.474761] env[65370]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9496f4d5-71fb-471e-bab0-2220819ba7ed with Priority: HIGHEST for action security_group_members [ 1022.474830] env[65370]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ac0bf02c-a45b-4f24-8fbd-39c68d35ae19 with Priority: HIGHEST for action port [ 1022.475120] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock rules-9496f4d5-71fb-471e-bab0-2220819ba7ed taken with stack trace [, , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1022.475611] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-9496f4d5-71fb-471e-bab0-2220819ba7ed" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1022.475611] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock member-9496f4d5-71fb-471e-bab0-2220819ba7ed taken with stack trace [, , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1022.475611] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9496f4d5-71fb-471e-bab0-2220819ba7ed" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1022.475787] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock port-ac0bf02c-a45b-4f24-8fbd-39c68d35ae19 taken with stack trace [, , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1022.475852] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-ac0bf02c-a45b-4f24-8fbd-39c68d35ae19" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1022.475852] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-ac0bf02c-a45b-4f24-8fbd-39c68d35ae19" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1022.476526] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-ac0bf02c-a45b-4f24-8fbd-39c68d35ae19" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1022.476526] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ac0bf02c-a45b-4f24-8fbd-39c68d35ae19',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1022.608147] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('9496f4d5-71fb-471e-bab0-2220819ba7ed',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1022.609305] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 9496f4d5-71fb-471e-bab0-2220819ba7ed: rpc.has_security_group_logging(os_id): False [ 1022.631117] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1022.631265] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1022.631339] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1022.631560] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1022.631646] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1022.631834] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1022.631932] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1022.631992] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1022.632160] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1022.632236] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1022.632418] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1022.632513] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1022.632592] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1022.632738] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1022.632810] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1022.633013] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1022.633119] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1022.633179] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1022.633317] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1022.633391] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1022.633475] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 9496f4d5-71fb-471e-bab0-2220819ba7ed is going to be created. [ 1022.700712] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1022.701109] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1022.701109] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1022.701207] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1022.701468] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1022.715022] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 9496f4d5-71fb-471e-bab0-2220819ba7ed in Status: IN_PROGRESS for 2s [ 1022.737234] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 48262726-1476-4e14-ad49-3cb37aeed405: rpc.has_security_group_logging(os_id): False [ 1022.755358] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1022.755535] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1022.755581] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1022.755800] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1022.755892] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1022.756124] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1022.756227] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1022.756286] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1022.756485] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1022.756849] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1022.756849] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1022.757151] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1022.757213] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1022.757520] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1022.757625] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1022.757901] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1022.758033] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1022.758101] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1022.758330] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1022.758455] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1022.758605] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 48262726-1476-4e14-ad49-3cb37aeed405 is going to be created. [ 1022.808757] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock all taken with stack trace [, , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1022.808978] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "all" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1022.809059] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "all" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1022.809372] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "all" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1022.809547] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_ports_with_revisions called with arguments (1000, 0) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1022.842181] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1022.842391] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1022.843658] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1022.843658] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1022.843658] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1022.857795] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 48262726-1476-4e14-ad49-3cb37aeed405 in Status: IN_PROGRESS for 2s [ 1022.978646] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port ac0bf02c-a45b-4f24-8fbd-39c68d35ae19 with status ACTIVE [ 1022.978965] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1022.979185] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1022.979264] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1022.979705] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1022.979705] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1022.980475] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1022.980475] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1022.980475] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1022.980475] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1022.980737] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1022.980777] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1022.980895] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1022.980943] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1022.981991] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1022.981991] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1022.981991] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: ac0bf02c-a45b-4f24-8fbd-39c68d35ae19 is going to be updated. [ 1023.011379] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1023.011542] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1023.011607] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1023.012150] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1023.012150] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1023.012150] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-ac0bf02c-a45b-4f24-8fbd-39c68d35ae19" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1023.111883] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('9496f4d5-71fb-471e-bab0-2220819ba7ed',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1023.274424] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 826ed52a-9222-434f-a4f9-e83fd60a5345 in Status: SUCCESS [ 1023.274679] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-826ed52a-9222-434f-a4f9-e83fd60a5345" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1023.312418] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_groups_with_revisions called with arguments (1000, 0) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1023.617676] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1023.617840] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1023.617913] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1023.618155] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1023.618242] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1023.618396] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9496f4d5-71fb-471e-bab0-2220819ba7ed is going to be updated. [ 1023.652234] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1023.652386] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1023.652441] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1023.652735] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1023.652902] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1023.662754] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9496f4d5-71fb-471e-bab0-2220819ba7ed in Status: IN_PROGRESS for 2s [ 1023.814424] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_qos_policies_with_revisions called with arguments (1000, 0) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1024.320508] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Inventory metadata is going to be refreshed. [ 1024.320666] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Segment. [ 1024.731583] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 9496f4d5-71fb-471e-bab0-2220819ba7ed in Status: SUCCESS [ 1024.731834] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-9496f4d5-71fb-471e-bab0-2220819ba7ed" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1024.731999] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-9496f4d5-71fb-471e-bab0-2220819ba7ed" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1024.732274] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-9496f4d5-71fb-471e-bab0-2220819ba7ed" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1024.732327] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('9496f4d5-71fb-471e-bab0-2220819ba7ed',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1024.872600] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 48262726-1476-4e14-ad49-3cb37aeed405 in Status: SUCCESS [ 1024.872915] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-48262726-1476-4e14-ad49-3cb37aeed405" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1025.237984] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock member-9496f4d5-71fb-471e-bab0-2220819ba7ed taken with stack trace [, , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1025.237984] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9496f4d5-71fb-471e-bab0-2220819ba7ed" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1025.264647] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1025.266120] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1025.266276] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1025.266627] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1025.286860] env[65370]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider [-] Duplicate resource with OS_ID: 992 ID: cl2-zone-992 [ 1025.288364] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1025.290489] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:SegmentPort. [ 1025.325623] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1025.325847] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1025.325847] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1025.326082] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1025.339848] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1025.342100] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:SegmentPort Is:0. [ 1025.342100] env[65370]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:SegmentPort Are:set() {{(pid=65370) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 1025.342100] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules). [ 1025.390929] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1025.391121] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1025.391171] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1025.392410] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1025.393253] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1025.393492] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules Remote IP Prefix). [ 1025.476557] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules Remote IP Prefix) taken with stack trace [, , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1025.476706] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules Remote IP Prefix)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1025.476781] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules Remote IP Prefix)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1025.477057] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules Remote IP Prefix)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1025.477381] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules Remote IP Prefix)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1025.477683] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Address Group. [ 1025.571516] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Address Group taken with stack trace [, , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1025.571516] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Address Group" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1025.571799] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Address Group" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1025.571876] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Address Group" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1025.572235] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Address Group" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1025.572853] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Security Group (Rules) Is:47. [ 1025.572853] env[65370]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Security Group (Rules) Are:{'de5a6b9b-a5a9-4ccc-b897-0244548cc5fd', '002e5341-7a4b-4a54-ad04-59531e87f867', '408a8a38-c326-4f43-84a2-818a13f7e124', '237e1a89-daff-4fd5-b02a-97e1d536d9bd', 'feaf18c3-295c-41df-89f1-309931cdeca1', '23979820-ccb5-4fdf-8d1a-316ad4242d32', 'e4c5be7e-6c74-44a0-bf7b-9581ec4636c2', '361130b7-6514-4c56-97c2-909bb5c1a95f', 'ed2131cc-559f-4cd6-b558-72473509c325', '23fa7df4-0993-48e9-9080-1087f76da31c', '1bc5c407-ee61-45f3-a29e-c586a26bcaff', '6f93689f-ae79-496c-bd6b-5fcec0a3824f', '420136f3-91df-4669-b5e3-cee436aeacb9', '8ea97aa8-b2b5-4fb2-ad6c-cbae92dacf23', 'f37147a2-7642-4b7c-a970-ffec078fbee9', '5b2126a9-5b17-4e9d-9c36-75348e49bbe8', 'eba16cc3-e8ee-4772-ba0d-2b7b582b7844', '0cacf152-a4d4-4487-a370-aa2bae090120', 'ae63a79d-837f-4a55-a83c-bcd245828917', 'b8e66f81-0f32-48b8-b81f-542b74cbecd4', 'fe248172-4be4-4d95-a8ca-c9c2ef203894', '1ba7c228-9a96-4f3b-9855-f84e883a5bfd', '8d9c7efa-60b6-44af-830b-f32145b1b403', '14c6c739-bd84-4bc8-9d1c-9bc29741c32d', '21a3b55c-64ce-4782-808a-31350166c184', '9496f4d5-71fb-471e-bab0-2220819ba7ed', '67f4a0c1-3a3c-4ed8-9358-3a9645aba154', 'c26b8d0b-5a65-4082-8dff-404228d547c4', '5c5eea1d-0338-4750-8d40-b5e68d251d49', '5b5e0c25-5d4e-4e13-9670-be19b4122c73', 'e2790d7c-6d0c-45bc-84d1-8cb00d26b9b0', '1eaa763e-4469-4428-92d0-ba20a6c99edc', '78c0a4a2-12c9-4a82-bedc-df813ca8b608', 'd65082c9-0b60-42be-a86a-b728b05e4ca4', '7c93cef4-117c-4bf3-aaf5-07dadeb90a88', 'ade9055b-2ef9-426f-9386-65654700ee06', '2011abd7-ba10-4aae-84fb-1b1bfbd238fa', '4269e0a9-b570-412a-9993-d1965229c186', 'b6c4259c-ea9b-4b2f-84b9-cbedce2ee198', '48262726-1476-4e14-ad49-3cb37aeed405', '00a251e9-7a00-4293-9092-9556bc8b91c2', '1a7b0f53-ef43-4301-97b8-ab12f1f2ae45', '48cb2a6d-3a04-4700-a0e8-ee3e4e1a679c', '84a5376d-c8c0-4dd2-bea4-f01f11567a72', '47d8b360-5d90-42ea-b9c3-ed76fddd03a3', 'a64b2117-cdc3-4b72-a9f3-57dfa8198991', '826ed52a-9222-434f-a4f9-e83fd60a5345'} {{(pid=65370) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 1025.572853] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Segment QoS. [ 1025.593645] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Segment QoS taken with stack trace [, , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1025.593734] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment QoS" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1025.593855] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment QoS" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1025.594042] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment QoS" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1025.594137] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment QoS" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1025.594258] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Segment QoS Is:0. [ 1025.594329] env[65370]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Segment QoS Are:set() {{(pid=65370) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 1025.594400] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Members). [ 1025.677023] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9496f4d5-71fb-471e-bab0-2220819ba7ed in Status: SUCCESS [ 1025.677501] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9496f4d5-71fb-471e-bab0-2220819ba7ed" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1025.677826] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9496f4d5-71fb-471e-bab0-2220819ba7ed" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1025.678102] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9496f4d5-71fb-471e-bab0-2220819ba7ed" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1025.678322] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1025.678455] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1025.678525] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1025.678695] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1025.678862] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1025.678908] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9496f4d5-71fb-471e-bab0-2220819ba7ed',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1025.697401] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1025.697644] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1025.697823] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1025.697940] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1025.699040] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1025.699486] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Security Group (Members) Is:0. [ 1025.699486] env[65370]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Security Group (Members) Are:set() {{(pid=65370) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 1025.699486] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Inventory metadata have been refreshed. [ 1025.699708] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 0/0 resources of Type:Ports [ 1025.699708] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 20/47 resources of Type:Security Group Rules [ 1025.699708] env[65370]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: de5a6b9b-a5a9-4ccc-b897-0244548cc5fd with Priority: HIGH for action security_group_rules [ 1025.699809] env[65370]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 002e5341-7a4b-4a54-ad04-59531e87f867 with Priority: HIGH for action security_group_rules [ 1025.699852] env[65370]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 408a8a38-c326-4f43-84a2-818a13f7e124 with Priority: HIGH for action security_group_rules [ 1025.699896] env[65370]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 237e1a89-daff-4fd5-b02a-97e1d536d9bd with Priority: HIGH for action security_group_rules [ 1025.699953] env[65370]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: feaf18c3-295c-41df-89f1-309931cdeca1 with Priority: HIGH for action security_group_rules [ 1025.700028] env[65370]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 23979820-ccb5-4fdf-8d1a-316ad4242d32 with Priority: HIGH for action security_group_rules [ 1025.700094] env[65370]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: e4c5be7e-6c74-44a0-bf7b-9581ec4636c2 with Priority: HIGH for action security_group_rules [ 1025.700154] env[65370]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 361130b7-6514-4c56-97c2-909bb5c1a95f with Priority: HIGH for action security_group_rules [ 1025.700215] env[65370]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: ed2131cc-559f-4cd6-b558-72473509c325 with Priority: HIGH for action security_group_rules [ 1025.700342] env[65370]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 23fa7df4-0993-48e9-9080-1087f76da31c with Priority: HIGH for action security_group_rules [ 1025.700440] env[65370]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 1bc5c407-ee61-45f3-a29e-c586a26bcaff with Priority: HIGH for action security_group_rules [ 1025.700517] env[65370]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 6f93689f-ae79-496c-bd6b-5fcec0a3824f with Priority: HIGH for action security_group_rules [ 1025.700579] env[65370]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 420136f3-91df-4669-b5e3-cee436aeacb9 with Priority: HIGH for action security_group_rules [ 1025.700641] env[65370]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 8ea97aa8-b2b5-4fb2-ad6c-cbae92dacf23 with Priority: HIGH for action security_group_rules [ 1025.700987] env[65370]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: f37147a2-7642-4b7c-a970-ffec078fbee9 with Priority: HIGH for action security_group_rules [ 1025.700987] env[65370]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 5b2126a9-5b17-4e9d-9c36-75348e49bbe8 with Priority: HIGH for action security_group_rules [ 1025.700987] env[65370]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: eba16cc3-e8ee-4772-ba0d-2b7b582b7844 with Priority: HIGH for action security_group_rules [ 1025.700987] env[65370]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 0cacf152-a4d4-4487-a370-aa2bae090120 with Priority: HIGH for action security_group_rules [ 1025.700987] env[65370]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: ae63a79d-837f-4a55-a83c-bcd245828917 with Priority: HIGH for action security_group_rules [ 1025.700987] env[65370]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: b8e66f81-0f32-48b8-b81f-542b74cbecd4 with Priority: HIGH for action security_group_rules [ 1025.701315] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "all" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1026.182313] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('9496f4d5-71fb-471e-bab0-2220819ba7ed',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1026.684958] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('9496f4d5-71fb-471e-bab0-2220819ba7ed',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1027.187381] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1027.187746] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1027.187746] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1027.187858] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1027.187912] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1027.188045] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9496f4d5-71fb-471e-bab0-2220819ba7ed is going to be updated. [ 1027.222359] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1027.222359] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1027.222502] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1027.222746] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1027.222982] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1027.233718] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9496f4d5-71fb-471e-bab0-2220819ba7ed in Status: IN_PROGRESS for 2s [ 1027.476038] env[65370]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1027.476038] env[65370]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=20], Jobs=4 [ 1027.476038] env[65370]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: de5a6b9b-a5a9-4ccc-b897-0244548cc5fd with Priority: HIGH for action security_group_rules [ 1027.476252] env[65370]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 408a8a38-c326-4f43-84a2-818a13f7e124 with Priority: HIGH for action security_group_rules [ 1027.476252] env[65370]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e4c5be7e-6c74-44a0-bf7b-9581ec4636c2 with Priority: HIGH for action security_group_rules [ 1027.476341] env[65370]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f37147a2-7642-4b7c-a970-ffec078fbee9 with Priority: HIGH for action security_group_rules [ 1027.476389] env[65370]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b8e66f81-0f32-48b8-b81f-542b74cbecd4 with Priority: HIGH for action security_group_rules [ 1027.477042] env[65370]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ae63a79d-837f-4a55-a83c-bcd245828917 with Priority: HIGH for action security_group_rules [ 1027.477042] env[65370]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0cacf152-a4d4-4487-a370-aa2bae090120 with Priority: HIGH for action security_group_rules [ 1027.477042] env[65370]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: eba16cc3-e8ee-4772-ba0d-2b7b582b7844 with Priority: HIGH for action security_group_rules [ 1027.477042] env[65370]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8ea97aa8-b2b5-4fb2-ad6c-cbae92dacf23 with Priority: HIGH for action security_group_rules [ 1027.477042] env[65370]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5b2126a9-5b17-4e9d-9c36-75348e49bbe8 with Priority: HIGH for action security_group_rules [ 1027.477042] env[65370]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 420136f3-91df-4669-b5e3-cee436aeacb9 with Priority: HIGH for action security_group_rules [ 1027.477042] env[65370]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6f93689f-ae79-496c-bd6b-5fcec0a3824f with Priority: HIGH for action security_group_rules [ 1027.477042] env[65370]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1bc5c407-ee61-45f3-a29e-c586a26bcaff with Priority: HIGH for action security_group_rules [ 1027.477453] env[65370]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 23fa7df4-0993-48e9-9080-1087f76da31c with Priority: HIGH for action security_group_rules [ 1027.477453] env[65370]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ed2131cc-559f-4cd6-b558-72473509c325 with Priority: HIGH for action security_group_rules [ 1027.477453] env[65370]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 23979820-ccb5-4fdf-8d1a-316ad4242d32 with Priority: HIGH for action security_group_rules [ 1027.477453] env[65370]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 361130b7-6514-4c56-97c2-909bb5c1a95f with Priority: HIGH for action security_group_rules [ 1027.477579] env[65370]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: feaf18c3-295c-41df-89f1-309931cdeca1 with Priority: HIGH for action security_group_rules [ 1027.477579] env[65370]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 002e5341-7a4b-4a54-ad04-59531e87f867 with Priority: HIGH for action security_group_rules [ 1027.477670] env[65370]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 237e1a89-daff-4fd5-b02a-97e1d536d9bd with Priority: HIGH for action security_group_rules [ 1027.478074] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock rules-de5a6b9b-a5a9-4ccc-b897-0244548cc5fd taken with stack trace [, , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1027.478219] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-de5a6b9b-a5a9-4ccc-b897-0244548cc5fd" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1027.478297] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-de5a6b9b-a5a9-4ccc-b897-0244548cc5fd" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1027.478522] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-de5a6b9b-a5a9-4ccc-b897-0244548cc5fd" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1027.478603] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('de5a6b9b-a5a9-4ccc-b897-0244548cc5fd',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1027.480905] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock rules-408a8a38-c326-4f43-84a2-818a13f7e124 taken with stack trace [, , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1027.481032] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-408a8a38-c326-4f43-84a2-818a13f7e124" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1027.481102] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-408a8a38-c326-4f43-84a2-818a13f7e124" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1027.481384] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-408a8a38-c326-4f43-84a2-818a13f7e124" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1027.481480] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('408a8a38-c326-4f43-84a2-818a13f7e124',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1027.485445] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e4c5be7e-6c74-44a0-bf7b-9581ec4636c2 taken with stack trace [, , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1027.485614] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e4c5be7e-6c74-44a0-bf7b-9581ec4636c2" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1027.485670] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e4c5be7e-6c74-44a0-bf7b-9581ec4636c2" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1027.485852] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e4c5be7e-6c74-44a0-bf7b-9581ec4636c2" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1027.485938] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e4c5be7e-6c74-44a0-bf7b-9581ec4636c2',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1027.486914] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock rules-f37147a2-7642-4b7c-a970-ffec078fbee9 taken with stack trace [, , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1027.487767] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-f37147a2-7642-4b7c-a970-ffec078fbee9" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1027.487876] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-f37147a2-7642-4b7c-a970-ffec078fbee9" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1027.488075] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-f37147a2-7642-4b7c-a970-ffec078fbee9" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1027.488161] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('f37147a2-7642-4b7c-a970-ffec078fbee9',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1027.491226] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock rules-b8e66f81-0f32-48b8-b81f-542b74cbecd4 taken with stack trace [, , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1027.491226] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-b8e66f81-0f32-48b8-b81f-542b74cbecd4" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1027.491226] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-b8e66f81-0f32-48b8-b81f-542b74cbecd4" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1027.491226] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-b8e66f81-0f32-48b8-b81f-542b74cbecd4" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1027.491226] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('b8e66f81-0f32-48b8-b81f-542b74cbecd4',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1027.491660] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock rules-ae63a79d-837f-4a55-a83c-bcd245828917 taken with stack trace [, , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1027.491732] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-ae63a79d-837f-4a55-a83c-bcd245828917" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1027.491767] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-ae63a79d-837f-4a55-a83c-bcd245828917" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1027.491959] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-ae63a79d-837f-4a55-a83c-bcd245828917" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1027.492050] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('ae63a79d-837f-4a55-a83c-bcd245828917',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1027.492907] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock rules-0cacf152-a4d4-4487-a370-aa2bae090120 taken with stack trace [, , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1027.493298] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-0cacf152-a4d4-4487-a370-aa2bae090120" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1027.493392] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-0cacf152-a4d4-4487-a370-aa2bae090120" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1027.493560] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-0cacf152-a4d4-4487-a370-aa2bae090120" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1027.493647] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('0cacf152-a4d4-4487-a370-aa2bae090120',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1027.494962] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock rules-eba16cc3-e8ee-4772-ba0d-2b7b582b7844 taken with stack trace [, , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1027.495118] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-eba16cc3-e8ee-4772-ba0d-2b7b582b7844" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1027.495179] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-eba16cc3-e8ee-4772-ba0d-2b7b582b7844" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1027.495403] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-eba16cc3-e8ee-4772-ba0d-2b7b582b7844" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1027.495559] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('eba16cc3-e8ee-4772-ba0d-2b7b582b7844',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1027.497271] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock rules-8ea97aa8-b2b5-4fb2-ad6c-cbae92dacf23 taken with stack trace [, , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1027.497434] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-8ea97aa8-b2b5-4fb2-ad6c-cbae92dacf23" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1027.497497] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-8ea97aa8-b2b5-4fb2-ad6c-cbae92dacf23" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1027.497675] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-8ea97aa8-b2b5-4fb2-ad6c-cbae92dacf23" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1027.497788] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('8ea97aa8-b2b5-4fb2-ad6c-cbae92dacf23',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1027.503653] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock rules-5b2126a9-5b17-4e9d-9c36-75348e49bbe8 taken with stack trace [, , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1027.503780] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-5b2126a9-5b17-4e9d-9c36-75348e49bbe8" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1027.503878] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-5b2126a9-5b17-4e9d-9c36-75348e49bbe8" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1027.507542] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-5b2126a9-5b17-4e9d-9c36-75348e49bbe8" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1027.507542] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('5b2126a9-5b17-4e9d-9c36-75348e49bbe8',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1027.508794] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock rules-420136f3-91df-4669-b5e3-cee436aeacb9 taken with stack trace [, , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1027.512030] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-420136f3-91df-4669-b5e3-cee436aeacb9" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1027.512030] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-420136f3-91df-4669-b5e3-cee436aeacb9" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1027.512030] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-420136f3-91df-4669-b5e3-cee436aeacb9" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1027.512030] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('420136f3-91df-4669-b5e3-cee436aeacb9',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1027.512030] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock rules-6f93689f-ae79-496c-bd6b-5fcec0a3824f taken with stack trace [, , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1027.512030] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-6f93689f-ae79-496c-bd6b-5fcec0a3824f" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1027.512030] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-6f93689f-ae79-496c-bd6b-5fcec0a3824f" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1027.512030] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-6f93689f-ae79-496c-bd6b-5fcec0a3824f" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1027.512030] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('6f93689f-ae79-496c-bd6b-5fcec0a3824f',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1027.512576] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock rules-1bc5c407-ee61-45f3-a29e-c586a26bcaff taken with stack trace [, , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1027.512576] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-1bc5c407-ee61-45f3-a29e-c586a26bcaff" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1027.512576] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-1bc5c407-ee61-45f3-a29e-c586a26bcaff" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1027.512576] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-1bc5c407-ee61-45f3-a29e-c586a26bcaff" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1027.512775] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('1bc5c407-ee61-45f3-a29e-c586a26bcaff',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1027.513609] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock rules-23fa7df4-0993-48e9-9080-1087f76da31c taken with stack trace [, , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1027.513755] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-23fa7df4-0993-48e9-9080-1087f76da31c" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1027.513835] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-23fa7df4-0993-48e9-9080-1087f76da31c" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1027.514313] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-23fa7df4-0993-48e9-9080-1087f76da31c" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1027.514313] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('23fa7df4-0993-48e9-9080-1087f76da31c',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1027.515192] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock rules-ed2131cc-559f-4cd6-b558-72473509c325 taken with stack trace [, , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1027.515316] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-ed2131cc-559f-4cd6-b558-72473509c325" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1027.515432] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-ed2131cc-559f-4cd6-b558-72473509c325" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1027.515600] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-ed2131cc-559f-4cd6-b558-72473509c325" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1027.515714] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('ed2131cc-559f-4cd6-b558-72473509c325',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1027.516761] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock rules-23979820-ccb5-4fdf-8d1a-316ad4242d32 taken with stack trace [, , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1027.516903] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-23979820-ccb5-4fdf-8d1a-316ad4242d32" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1027.516965] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-23979820-ccb5-4fdf-8d1a-316ad4242d32" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1027.517168] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-23979820-ccb5-4fdf-8d1a-316ad4242d32" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1027.517240] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('23979820-ccb5-4fdf-8d1a-316ad4242d32',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1027.518079] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock rules-361130b7-6514-4c56-97c2-909bb5c1a95f taken with stack trace [, , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1027.518213] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-361130b7-6514-4c56-97c2-909bb5c1a95f" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1027.518280] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-361130b7-6514-4c56-97c2-909bb5c1a95f" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1027.518400] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-361130b7-6514-4c56-97c2-909bb5c1a95f" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1027.518471] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('361130b7-6514-4c56-97c2-909bb5c1a95f',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1027.519231] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock rules-feaf18c3-295c-41df-89f1-309931cdeca1 taken with stack trace [, , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1027.519334] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-feaf18c3-295c-41df-89f1-309931cdeca1" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1027.519398] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-feaf18c3-295c-41df-89f1-309931cdeca1" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1027.520138] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-feaf18c3-295c-41df-89f1-309931cdeca1" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1027.520138] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('feaf18c3-295c-41df-89f1-309931cdeca1',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1027.521147] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock rules-002e5341-7a4b-4a54-ad04-59531e87f867 taken with stack trace [, , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1027.521147] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-002e5341-7a4b-4a54-ad04-59531e87f867" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1027.521147] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-002e5341-7a4b-4a54-ad04-59531e87f867" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1027.521147] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-002e5341-7a4b-4a54-ad04-59531e87f867" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1027.521572] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('002e5341-7a4b-4a54-ad04-59531e87f867',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1027.524843] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock rules-237e1a89-daff-4fd5-b02a-97e1d536d9bd taken with stack trace [, , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1027.524843] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-237e1a89-daff-4fd5-b02a-97e1d536d9bd" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1027.524843] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-237e1a89-daff-4fd5-b02a-97e1d536d9bd" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1027.524843] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-237e1a89-daff-4fd5-b02a-97e1d536d9bd" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1027.524843] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('237e1a89-daff-4fd5-b02a-97e1d536d9bd',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1027.554587] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1027.554781] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1027.554861] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1027.556946] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1027.558099] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1027.558262] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1027.589461] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1027.589647] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e4c5be7e-6c74-44a0-bf7b-9581ec4636c2 is going to be deleted. [ 1027.590786] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1027.591017] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1027.635924] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1027.636136] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: de5a6b9b-a5a9-4ccc-b897-0244548cc5fd is going to be deleted. [ 1027.679597] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1027.679597] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1027.679597] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1027.679597] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1027.679597] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1027.679597] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e4c5be7e-6c74-44a0-bf7b-9581ec4636c2" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1027.735423] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1027.735423] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1027.735423] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1027.735423] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1027.735423] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1027.735423] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-de5a6b9b-a5a9-4ccc-b897-0244548cc5fd" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1027.999995] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock member-eba16cc3-e8ee-4772-ba0d-2b7b582b7844 taken with stack trace [, , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1028.000189] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-eba16cc3-e8ee-4772-ba0d-2b7b582b7844" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1028.000259] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-eba16cc3-e8ee-4772-ba0d-2b7b582b7844" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1028.000484] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-eba16cc3-e8ee-4772-ba0d-2b7b582b7844" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1028.000659] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1028.000769] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1028.000821] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1028.000985] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1028.001073] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1028.001159] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-eba16cc3-e8ee-4772-ba0d-2b7b582b7844" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1028.001242] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('eba16cc3-e8ee-4772-ba0d-2b7b582b7844',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1028.014177] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1028.014357] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1028.014471] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1028.015023] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1028.017549] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1028.017549] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1028.031321] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock member-23fa7df4-0993-48e9-9080-1087f76da31c taken with stack trace [, , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1028.031321] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-23fa7df4-0993-48e9-9080-1087f76da31c" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1028.031321] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-23fa7df4-0993-48e9-9080-1087f76da31c" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1028.031321] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-23fa7df4-0993-48e9-9080-1087f76da31c" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1028.031321] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1028.031321] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1028.031835] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1028.031835] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1028.031835] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1028.031835] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-23fa7df4-0993-48e9-9080-1087f76da31c" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1028.031835] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('23fa7df4-0993-48e9-9080-1087f76da31c',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1028.034854] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock member-408a8a38-c326-4f43-84a2-818a13f7e124 taken with stack trace [, , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1028.034854] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-408a8a38-c326-4f43-84a2-818a13f7e124" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1028.034854] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-408a8a38-c326-4f43-84a2-818a13f7e124" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1028.034854] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-408a8a38-c326-4f43-84a2-818a13f7e124" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1028.034854] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1028.034854] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1028.034854] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1028.034854] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1028.034854] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1028.034854] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-408a8a38-c326-4f43-84a2-818a13f7e124" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1028.034854] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('408a8a38-c326-4f43-84a2-818a13f7e124',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1028.042505] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock member-420136f3-91df-4669-b5e3-cee436aeacb9 taken with stack trace [, , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1028.042730] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-420136f3-91df-4669-b5e3-cee436aeacb9" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1028.042730] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-420136f3-91df-4669-b5e3-cee436aeacb9" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1028.042931] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-420136f3-91df-4669-b5e3-cee436aeacb9" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1028.043144] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1028.043281] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1028.043281] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1028.043500] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1028.043500] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1028.043668] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-420136f3-91df-4669-b5e3-cee436aeacb9" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1028.043668] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('420136f3-91df-4669-b5e3-cee436aeacb9',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1028.050947] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock member-237e1a89-daff-4fd5-b02a-97e1d536d9bd taken with stack trace [, , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1028.050947] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-237e1a89-daff-4fd5-b02a-97e1d536d9bd" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1028.050947] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-237e1a89-daff-4fd5-b02a-97e1d536d9bd" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1028.050947] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-237e1a89-daff-4fd5-b02a-97e1d536d9bd" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1028.050947] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1028.050947] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1028.050947] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1028.050947] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1028.050947] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1028.050947] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-237e1a89-daff-4fd5-b02a-97e1d536d9bd" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1028.050947] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('237e1a89-daff-4fd5-b02a-97e1d536d9bd',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1028.059570] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1028.059743] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: f37147a2-7642-4b7c-a970-ffec078fbee9 is going to be deleted. [ 1028.064991] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1028.065432] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1028.086649] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1028.086957] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1028.104176] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1028.104382] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1028.105271] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1028.105391] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1028.106259] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1028.106356] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1028.107193] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1028.107298] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1028.108135] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1028.108231] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1028.109096] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1028.109196] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1028.123035] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1028.123505] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1028.124937] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1028.125017] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: b8e66f81-0f32-48b8-b81f-542b74cbecd4 is going to be deleted. [ 1028.127882] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1028.128980] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1028.129143] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1028.130334] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1028.135879] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1028.135879] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1028.135879] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1028.135879] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1028.161382] env[65370]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1028.161808] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1028.162350] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1028.164131] env[65370]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1028.164462] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1028.164636] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 23979820-ccb5-4fdf-8d1a-316ad4242d32 is going to be deleted. [ 1028.165721] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1028.165984] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1028.188615] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1028.188995] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: feaf18c3-295c-41df-89f1-309931cdeca1 is going to be deleted. [ 1028.189866] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1028.190228] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1028.207238] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1028.207445] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1028.243793] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1028.243982] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: ae63a79d-837f-4a55-a83c-bcd245828917 is going to be deleted. [ 1028.244970] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1028.245160] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1028.273422] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1028.273623] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1028.287099] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1028.287269] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 6f93689f-ae79-496c-bd6b-5fcec0a3824f is going to be deleted. [ 1028.288285] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1028.288523] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1028.329981] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1028.330135] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1028.353338] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1028.353521] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: ed2131cc-559f-4cd6-b558-72473509c325 is going to be deleted. [ 1028.354428] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1028.354644] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1028.382871] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1028.383363] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1028.409299] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1028.409299] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1028.438594] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1028.439380] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 0cacf152-a4d4-4487-a370-aa2bae090120 is going to be deleted. [ 1028.440299] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1028.440543] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1028.497612] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1028.497800] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 8ea97aa8-b2b5-4fb2-ad6c-cbae92dacf23 is going to be deleted. [ 1028.498943] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1028.499473] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1028.506928] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock member-eba16cc3-e8ee-4772-ba0d-2b7b582b7844 taken with stack trace [, , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1028.506928] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-eba16cc3-e8ee-4772-ba0d-2b7b582b7844" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1028.506928] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-eba16cc3-e8ee-4772-ba0d-2b7b582b7844" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1028.506928] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-eba16cc3-e8ee-4772-ba0d-2b7b582b7844" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1028.506928] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1028.506928] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1028.506928] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1028.506928] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1028.506928] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1028.506928] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-eba16cc3-e8ee-4772-ba0d-2b7b582b7844" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1028.506928] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock member-eba16cc3-e8ee-4772-ba0d-2b7b582b7844 taken with stack trace [, , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1028.506928] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-eba16cc3-e8ee-4772-ba0d-2b7b582b7844" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1028.506928] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-eba16cc3-e8ee-4772-ba0d-2b7b582b7844" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1028.506928] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-eba16cc3-e8ee-4772-ba0d-2b7b582b7844" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1028.506928] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1028.506928] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1028.507876] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1028.507876] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1028.507876] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1028.507876] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-eba16cc3-e8ee-4772-ba0d-2b7b582b7844" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1028.507876] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('eba16cc3-e8ee-4772-ba0d-2b7b582b7844',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1028.538455] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('23fa7df4-0993-48e9-9080-1087f76da31c',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1028.540438] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('408a8a38-c326-4f43-84a2-818a13f7e124',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1028.544015] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1028.544015] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1028.553925] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1028.554165] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1028.554738] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock member-420136f3-91df-4669-b5e3-cee436aeacb9 taken with stack trace [, , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1028.554868] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-420136f3-91df-4669-b5e3-cee436aeacb9" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1028.554949] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-420136f3-91df-4669-b5e3-cee436aeacb9" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1028.555188] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-420136f3-91df-4669-b5e3-cee436aeacb9" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1028.555374] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1028.555525] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1028.555604] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1028.555782] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1028.555887] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1028.555963] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-420136f3-91df-4669-b5e3-cee436aeacb9" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1028.556130] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock member-420136f3-91df-4669-b5e3-cee436aeacb9 taken with stack trace [, , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1028.556227] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-420136f3-91df-4669-b5e3-cee436aeacb9" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1028.556283] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-420136f3-91df-4669-b5e3-cee436aeacb9" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1028.556438] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-420136f3-91df-4669-b5e3-cee436aeacb9" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1028.556580] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1028.556676] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1028.556738] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1028.556849] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1028.556924] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1028.557013] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-420136f3-91df-4669-b5e3-cee436aeacb9" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1028.557107] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('420136f3-91df-4669-b5e3-cee436aeacb9',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1028.560192] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1028.560339] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 002e5341-7a4b-4a54-ad04-59531e87f867 is going to be deleted. [ 1028.561601] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1028.561814] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1028.562880] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock member-237e1a89-daff-4fd5-b02a-97e1d536d9bd taken with stack trace [, , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1028.563037] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-237e1a89-daff-4fd5-b02a-97e1d536d9bd" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1028.563082] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-237e1a89-daff-4fd5-b02a-97e1d536d9bd" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1028.563404] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-237e1a89-daff-4fd5-b02a-97e1d536d9bd" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1028.563404] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1028.563548] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1028.563548] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1028.563708] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1028.563794] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1028.563879] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-237e1a89-daff-4fd5-b02a-97e1d536d9bd" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1028.564047] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock member-237e1a89-daff-4fd5-b02a-97e1d536d9bd taken with stack trace [, , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1028.564152] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-237e1a89-daff-4fd5-b02a-97e1d536d9bd" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1028.564229] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-237e1a89-daff-4fd5-b02a-97e1d536d9bd" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1028.564390] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-237e1a89-daff-4fd5-b02a-97e1d536d9bd" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1028.564556] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1028.564816] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1028.564816] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1028.565190] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1028.565190] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1028.565190] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-237e1a89-daff-4fd5-b02a-97e1d536d9bd" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1028.565190] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('237e1a89-daff-4fd5-b02a-97e1d536d9bd',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1028.627872] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1028.628162] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 5b2126a9-5b17-4e9d-9c36-75348e49bbe8 is going to be deleted. [ 1028.629644] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1028.630011] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1028.694482] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1028.694482] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1028.731264] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1028.732366] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 1bc5c407-ee61-45f3-a29e-c586a26bcaff is going to be deleted. [ 1028.732366] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1028.733222] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1028.787674] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1028.787674] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1028.791070] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1028.791365] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 361130b7-6514-4c56-97c2-909bb5c1a95f is going to be deleted. [ 1028.792528] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1028.792743] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1028.792842] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1028.793331] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-f37147a2-7642-4b7c-a970-ffec078fbee9" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1028.795080] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1028.795080] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1028.795080] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1028.795080] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-b8e66f81-0f32-48b8-b81f-542b74cbecd4" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1028.796517] env[65370]: INFO networking_nsxv3.common.synchronization [req-c8149227-1abc-4741-922f-987e7aa035dd req-66ebb840-f5b8-4b84-9236-a15331a41ebe tempest-ServerRescueNegativeTestJSON-807527939 tempest-ServerRescueNegativeTestJSON-807527939-project-member] Enqueued Resource ID: 5c5eea1d-0338-4750-8d40-b5e68d251d49 with Priority: HIGHEST for action security_group_members [ 1028.796810] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1028.797456] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1028.797456] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1028.797660] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-23979820-ccb5-4fdf-8d1a-316ad4242d32" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1028.798956] env[65370]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5c5eea1d-0338-4750-8d40-b5e68d251d49 with Priority: HIGHEST for action security_group_members [ 1028.798956] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1028.798956] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1028.798956] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1028.798956] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-feaf18c3-295c-41df-89f1-309931cdeca1" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1028.799387] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock member-5c5eea1d-0338-4750-8d40-b5e68d251d49 taken with stack trace [, , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1028.799387] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5c5eea1d-0338-4750-8d40-b5e68d251d49" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1028.799387] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5c5eea1d-0338-4750-8d40-b5e68d251d49" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1028.799511] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5c5eea1d-0338-4750-8d40-b5e68d251d49" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1028.799564] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1028.799666] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1028.799752] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1028.800176] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1028.800176] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1028.800354] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5c5eea1d-0338-4750-8d40-b5e68d251d49',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1028.803775] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1028.804129] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1028.804322] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1028.804499] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-ae63a79d-837f-4a55-a83c-bcd245828917" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1028.805727] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1028.806329] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1028.806526] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1028.806701] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-6f93689f-ae79-496c-bd6b-5fcec0a3824f" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1028.806906] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1028.807222] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1028.807269] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1028.807833] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-ed2131cc-559f-4cd6-b558-72473509c325" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1028.807833] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1028.807833] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1028.809427] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1028.809427] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-0cacf152-a4d4-4487-a370-aa2bae090120" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1028.809954] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1028.810256] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1028.810881] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1028.810881] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-8ea97aa8-b2b5-4fb2-ad6c-cbae92dacf23" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1028.811129] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1028.811384] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1028.811384] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1028.811510] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-002e5341-7a4b-4a54-ad04-59531e87f867" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1028.840346] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1028.840346] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1028.840658] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1028.840658] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1028.840933] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1028.840933] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-5b2126a9-5b17-4e9d-9c36-75348e49bbe8" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1028.905595] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1028.905595] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1028.905595] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1028.906310] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1028.906310] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1028.906310] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-1bc5c407-ee61-45f3-a29e-c586a26bcaff" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1028.984813] env[65370]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1028.990678] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1028.990966] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1028.991393] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1028.993444] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1028.993444] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1028.993444] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-361130b7-6514-4c56-97c2-909bb5c1a95f" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1029.011039] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for eba16cc3-e8ee-4772-ba0d-2b7b582b7844: rpc.has_security_group_logging(os_id): False [ 1029.043310] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1029.043471] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1029.043576] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1029.043894] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1029.045037] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 23fa7df4-0993-48e9-9080-1087f76da31c: rpc.has_security_group_logging(os_id): False [ 1029.047094] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 408a8a38-c326-4f43-84a2-818a13f7e124: rpc.has_security_group_logging(os_id): False [ 1029.059362] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 420136f3-91df-4669-b5e3-cee436aeacb9: rpc.has_security_group_logging(os_id): False [ 1029.069160] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 237e1a89-daff-4fd5-b02a-97e1d536d9bd: rpc.has_security_group_logging(os_id): False [ 1029.079768] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1029.080222] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1029.087905] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1029.088098] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1029.101858] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1029.102419] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1029.106656] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1029.106911] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1029.107115] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1029.107115] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1029.107304] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1029.107447] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1029.107689] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1029.107978] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1029.107978] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1029.108155] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1029.108232] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1029.108419] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1029.108577] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1029.108577] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1029.108717] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1029.109332] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1029.109477] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: eba16cc3-e8ee-4772-ba0d-2b7b582b7844 is going to be updated. [ 1029.110622] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1029.111199] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1029.113398] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1029.113544] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1029.146759] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1029.147197] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1029.147197] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1029.147197] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1029.147548] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1029.147548] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1029.147640] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 23fa7df4-0993-48e9-9080-1087f76da31c is going to be updated. [ 1029.151325] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1029.151635] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1029.200674] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1029.200674] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1029.200674] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1029.200674] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1029.200674] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1029.200674] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1029.200674] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1029.200674] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1029.200674] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1029.200674] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1029.200674] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1029.200674] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1029.200674] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1029.200674] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1029.201802] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1029.201802] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1029.201802] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 420136f3-91df-4669-b5e3-cee436aeacb9 is going to be updated. [ 1029.202204] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1029.202365] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1029.227884] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1029.231173] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1029.231367] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1029.231445] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1029.231647] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1029.231776] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1029.232130] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1029.232260] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1029.232322] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1029.232536] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1029.236489] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1029.236489] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1029.236489] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1029.236489] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1029.236489] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1029.236489] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1029.236489] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 237e1a89-daff-4fd5-b02a-97e1d536d9bd is going to be updated. [ 1029.236489] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1029.236489] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1029.241292] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1029.241463] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1029.268607] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9496f4d5-71fb-471e-bab0-2220819ba7ed in Status: SUCCESS [ 1029.269567] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9496f4d5-71fb-471e-bab0-2220819ba7ed" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1029.269698] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9496f4d5-71fb-471e-bab0-2220819ba7ed" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1029.269831] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9496f4d5-71fb-471e-bab0-2220819ba7ed" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1029.270082] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1029.270212] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1029.271111] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1029.271111] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1029.271111] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1029.271111] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9496f4d5-71fb-471e-bab0-2220819ba7ed',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1029.286547] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1029.286923] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1029.287101] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1029.287101] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1029.287431] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1029.287431] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1029.287629] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 408a8a38-c326-4f43-84a2-818a13f7e124 is going to be updated. [ 1029.289551] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1029.289803] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1029.289933] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1029.293926] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1029.294142] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1029.294279] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1029.294363] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1029.294500] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1029.306871] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1029.307229] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1029.307345] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1029.307652] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1029.350321] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: eba16cc3-e8ee-4772-ba0d-2b7b582b7844 in Status: IN_PROGRESS for 2s [ 1029.351083] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 23fa7df4-0993-48e9-9080-1087f76da31c in Status: IN_PROGRESS for 2s [ 1029.357022] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1029.357251] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1029.365662] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1029.366077] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1029.366237] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1029.366279] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1029.366699] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1029.366699] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1029.366699] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5c5eea1d-0338-4750-8d40-b5e68d251d49 is going to be updated. [ 1029.368700] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1029.369020] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1029.369202] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1029.402114] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 420136f3-91df-4669-b5e3-cee436aeacb9 in Status: IN_PROGRESS for 2s [ 1029.416342] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1029.416342] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1029.416342] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1029.416342] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1029.416854] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1029.432774] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1029.433279] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1029.433279] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1029.433406] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1029.433590] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1029.446378] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 237e1a89-daff-4fd5-b02a-97e1d536d9bd in Status: IN_PROGRESS for 2s [ 1029.460064] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5c5eea1d-0338-4750-8d40-b5e68d251d49 in Status: IN_PROGRESS for 2s [ 1029.499074] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1029.499806] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1029.499908] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1029.500161] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1029.500404] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1029.521706] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 408a8a38-c326-4f43-84a2-818a13f7e124 in Status: IN_PROGRESS for 2s [ 1029.775802] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('9496f4d5-71fb-471e-bab0-2220819ba7ed',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1029.876157] env[65370]: INFO networking_nsxv3.common.synchronization [req-5a634e49-1a96-4e86-b263-d1e74876db6b req-6ec060d6-68c7-45fc-98c9-c9dfb07845aa tempest-ServersNegativeTestJSON-226836032 tempest-ServersNegativeTestJSON-226836032-project-member] Enqueued Resource ID: eba16cc3-e8ee-4772-ba0d-2b7b582b7844 with Priority: HIGHEST for action security_group_members [ 1029.877133] env[65370]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: eba16cc3-e8ee-4772-ba0d-2b7b582b7844 with Priority: HIGHEST for action security_group_members [ 1029.877256] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock member-eba16cc3-e8ee-4772-ba0d-2b7b582b7844 taken with stack trace [, , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1029.877350] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-eba16cc3-e8ee-4772-ba0d-2b7b582b7844" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1029.877637] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-eba16cc3-e8ee-4772-ba0d-2b7b582b7844" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1029.877637] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-eba16cc3-e8ee-4772-ba0d-2b7b582b7844" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1029.877785] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1029.878510] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1029.878510] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1029.878510] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1029.878510] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1029.878510] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('eba16cc3-e8ee-4772-ba0d-2b7b582b7844',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1030.278092] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('9496f4d5-71fb-471e-bab0-2220819ba7ed',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1030.375681] env[65370]: DEBUG networking_nsxv3.common.locking [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Lock network-611 taken with stack trace [, , , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1030.375681] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquiring lock "network-611" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1030.375681] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquired lock "network-611" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1030.375681] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquired external semaphore "network-611" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1030.376161] env[65370]: DEBUG networking_nsxv3.common.locking [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1030.376446] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquiring lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1030.376537] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquired lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1030.377133] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquired external semaphore "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1030.377133] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Releasing lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1030.377418] env[65370]: DEBUG dogpile.cache.region [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] No value present for key: 'zone-id' {{(pid=65370) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1030.377418] env[65370]: DEBUG dogpile.lock [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] NeedRegenerationException {{(pid=65370) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1030.378686] env[65370]: DEBUG dogpile.lock [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] no value, waiting for create lock {{(pid=65370) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1030.378686] env[65370]: DEBUG dogpile.lock [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] value creation lock acquired {{(pid=65370) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1030.378686] env[65370]: DEBUG dogpile.cache.region [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] No value present for key: 'zone-id' {{(pid=65370) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1030.378686] env[65370]: DEBUG dogpile.lock [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Calling creation function for not-yet-present value {{(pid=65370) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1030.378686] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1030.383939] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('eba16cc3-e8ee-4772-ba0d-2b7b582b7844',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1030.391469] env[65370]: INFO networking_nsxv3.common.synchronization [req-f47bd005-831a-4619-a46d-9de9c2c373b9 req-eff3c1ab-3995-48c6-b70f-5b080aaecd99 tempest-AttachInterfacesTestJSON-315686657 tempest-AttachInterfacesTestJSON-315686657-project-member] Enqueued Resource ID: 826ed52a-9222-434f-a4f9-e83fd60a5345 with Priority: HIGHEST for action security_group_members [ 1030.394048] env[65370]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 826ed52a-9222-434f-a4f9-e83fd60a5345 with Priority: HIGHEST for action security_group_members [ 1030.394048] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock member-826ed52a-9222-434f-a4f9-e83fd60a5345 taken with stack trace [, , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1030.394048] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-826ed52a-9222-434f-a4f9-e83fd60a5345" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1030.394048] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-826ed52a-9222-434f-a4f9-e83fd60a5345" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1030.394048] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-826ed52a-9222-434f-a4f9-e83fd60a5345" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1030.394048] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1030.394048] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1030.394048] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1030.394672] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1030.394672] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1030.394771] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('826ed52a-9222-434f-a4f9-e83fd60a5345',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1030.399058] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1030.399259] env[65370]: DEBUG dogpile.cache.region [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=65370) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1030.399406] env[65370]: DEBUG dogpile.lock [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Released creation lock {{(pid=65370) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1030.399582] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Releasing lock "network-611" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1030.399879] env[65370]: DEBUG networking_nsxv3.common.locking [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Lock port-9437e872-2d0c-431d-82a8-8148e9be91cf taken with stack trace [, , , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1030.400063] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquiring lock "port-9437e872-2d0c-431d-82a8-8148e9be91cf" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1030.400200] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquired lock "port-9437e872-2d0c-431d-82a8-8148e9be91cf" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1030.400514] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquired external semaphore "port-9437e872-2d0c-431d-82a8-8148e9be91cf" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1030.400654] env[65370]: DEBUG networking_nsxv3.api.rpc [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9437e872-2d0c-431d-82a8-8148e9be91cf',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1030.780846] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1030.781058] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1030.781177] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1030.781380] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1030.781475] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1030.781579] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9496f4d5-71fb-471e-bab0-2220819ba7ed is going to be updated. [ 1030.817892] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1030.818136] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1030.818136] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1030.818446] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1030.818556] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1030.859750] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9496f4d5-71fb-471e-bab0-2220819ba7ed in Status: IN_PROGRESS for 2s [ 1030.887327] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('eba16cc3-e8ee-4772-ba0d-2b7b582b7844',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1030.897888] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1030.898156] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1030.898286] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1030.898815] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1030.903150] env[65370]: DEBUG networking_nsxv3.common.locking [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1030.903450] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquiring lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1030.903637] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquired lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1030.904055] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquired external semaphore "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1030.904253] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Releasing lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1030.904472] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Segment Port 9437e872-2d0c-431d-82a8-8148e9be91cf not found, creating... [ 1030.905063] env[65370]: DEBUG networking_nsxv3.common.locking [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1030.905547] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquiring lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1030.905708] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquired lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1030.905983] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquired external semaphore "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1030.906167] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Releasing lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1030.906694] env[65370]: DEBUG networking_nsxv3.common.locking [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1030.906845] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquiring lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1030.907021] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquired lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1030.907671] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquired external semaphore "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1030.907671] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Releasing lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1030.908863] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Resource: SegmentPort with ID: 9437e872-2d0c-431d-82a8-8148e9be91cf is going to be created. [ 1030.925098] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1030.925098] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1030.925098] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1030.925342] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1030.925554] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1030.925677] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1030.925821] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 826ed52a-9222-434f-a4f9-e83fd60a5345 is going to be updated. [ 1030.949139] env[65370]: DEBUG networking_nsxv3.common.locking [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1030.949489] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquiring lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1030.949576] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquired lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1030.949860] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquired external semaphore "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1030.950145] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Releasing lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1030.950433] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Releasing lock "port-9437e872-2d0c-431d-82a8-8148e9be91cf" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1031.003951] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1031.003951] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1031.003951] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1031.003951] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1031.003951] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1031.013785] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 826ed52a-9222-434f-a4f9-e83fd60a5345 in Status: IN_PROGRESS for 2s [ 1031.369608] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: eba16cc3-e8ee-4772-ba0d-2b7b582b7844 in Status: SUCCESS [ 1031.370139] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-eba16cc3-e8ee-4772-ba0d-2b7b582b7844" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1031.370621] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 23fa7df4-0993-48e9-9080-1087f76da31c in Status: SUCCESS [ 1031.370876] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-23fa7df4-0993-48e9-9080-1087f76da31c" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1031.390569] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1031.390805] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1031.390874] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1031.391488] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1031.391488] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1031.391488] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: eba16cc3-e8ee-4772-ba0d-2b7b582b7844 is going to be updated. [ 1031.431593] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 420136f3-91df-4669-b5e3-cee436aeacb9 in Status: SUCCESS [ 1031.431895] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-420136f3-91df-4669-b5e3-cee436aeacb9" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1031.455146] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1031.455386] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1031.455467] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1031.455650] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1031.455811] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1031.460347] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 237e1a89-daff-4fd5-b02a-97e1d536d9bd in Status: SUCCESS [ 1031.460657] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-237e1a89-daff-4fd5-b02a-97e1d536d9bd" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1031.474503] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: eba16cc3-e8ee-4772-ba0d-2b7b582b7844 in Status: IN_PROGRESS for 2s [ 1031.475359] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5c5eea1d-0338-4750-8d40-b5e68d251d49 in Status: SUCCESS [ 1031.475595] env[65370]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5c5eea1d-0338-4750-8d40-b5e68d251d49 deletion is rescheduled due to dependency. [ 1031.475647] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5c5eea1d-0338-4750-8d40-b5e68d251d49" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1031.538108] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 408a8a38-c326-4f43-84a2-818a13f7e124 in Status: SUCCESS [ 1031.538352] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-408a8a38-c326-4f43-84a2-818a13f7e124" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1031.685598] env[65370]: INFO networking_nsxv3.common.synchronization [req-5a634e49-1a96-4e86-b263-d1e74876db6b req-a813d35b-e4c2-4fc6-ace5-8ccc1ea567a5 service nova] Enqueued Resource ID: eba16cc3-e8ee-4772-ba0d-2b7b582b7844 with Priority: HIGHEST for action security_group_rules [ 1031.685861] env[65370]: INFO networking_nsxv3.common.synchronization [req-5a634e49-1a96-4e86-b263-d1e74876db6b req-a813d35b-e4c2-4fc6-ace5-8ccc1ea567a5 service nova] Enqueued Resource ID: eba16cc3-e8ee-4772-ba0d-2b7b582b7844 with Priority: HIGHEST for action security_group_members [ 1031.686168] env[65370]: INFO networking_nsxv3.common.synchronization [req-5a634e49-1a96-4e86-b263-d1e74876db6b req-a813d35b-e4c2-4fc6-ace5-8ccc1ea567a5 service nova] Enqueued Resource ID: 9437e872-2d0c-431d-82a8-8148e9be91cf with Priority: HIGHEST for action port [ 1031.686790] env[65370]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: eba16cc3-e8ee-4772-ba0d-2b7b582b7844 with Priority: HIGHEST for action security_group_rules [ 1031.686985] env[65370]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: eba16cc3-e8ee-4772-ba0d-2b7b582b7844 with Priority: HIGHEST for action security_group_members [ 1031.686985] env[65370]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9437e872-2d0c-431d-82a8-8148e9be91cf with Priority: HIGHEST for action port [ 1031.687331] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock rules-eba16cc3-e8ee-4772-ba0d-2b7b582b7844 taken with stack trace [, , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1031.687527] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-eba16cc3-e8ee-4772-ba0d-2b7b582b7844" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1031.687606] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-eba16cc3-e8ee-4772-ba0d-2b7b582b7844" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1031.687965] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-eba16cc3-e8ee-4772-ba0d-2b7b582b7844" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1031.687965] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('eba16cc3-e8ee-4772-ba0d-2b7b582b7844',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1031.688972] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock member-eba16cc3-e8ee-4772-ba0d-2b7b582b7844 taken with stack trace [, , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1031.689326] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-eba16cc3-e8ee-4772-ba0d-2b7b582b7844" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1031.689451] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock port-9437e872-2d0c-431d-82a8-8148e9be91cf taken with stack trace [, , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1031.689569] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-9437e872-2d0c-431d-82a8-8148e9be91cf" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1031.689634] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-9437e872-2d0c-431d-82a8-8148e9be91cf" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1031.689859] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-9437e872-2d0c-431d-82a8-8148e9be91cf" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1031.689945] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9437e872-2d0c-431d-82a8-8148e9be91cf',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1032.195024] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock member-eba16cc3-e8ee-4772-ba0d-2b7b582b7844 taken with stack trace [, , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1032.195024] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-eba16cc3-e8ee-4772-ba0d-2b7b582b7844" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1032.195024] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 9437e872-2d0c-431d-82a8-8148e9be91cf with status ACTIVE [ 1032.195024] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1032.195024] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1032.195024] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1032.195024] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1032.195024] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1032.195024] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1032.195024] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1032.195024] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1032.195024] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1032.195024] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1032.195024] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1032.196029] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1032.196029] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1032.196029] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1032.196029] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1032.196029] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 9437e872-2d0c-431d-82a8-8148e9be91cf is going to be updated. [ 1032.225080] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1032.225080] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1032.225080] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1032.225937] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1032.225937] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1032.225937] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-9437e872-2d0c-431d-82a8-8148e9be91cf" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1032.512157] env[65370]: INFO networking_nsxv3.common.synchronization [req-3d546c30-cf08-4d1e-bba2-06d9be130902 req-12bbfee0-09aa-4df4-9bd0-b908178f323b tempest-AttachVolumeTestJSON-1795434373 tempest-AttachVolumeTestJSON-1795434373-project-member] Enqueued Resource ID: aa619879-3f9d-4aea-b1cb-1e5adfe92cfd with Priority: HIGHEST for action security_group_members [ 1032.512955] env[65370]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: aa619879-3f9d-4aea-b1cb-1e5adfe92cfd with Priority: HIGHEST for action security_group_members [ 1032.513426] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock member-aa619879-3f9d-4aea-b1cb-1e5adfe92cfd taken with stack trace [, , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1032.513942] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-aa619879-3f9d-4aea-b1cb-1e5adfe92cfd" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1032.513942] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-aa619879-3f9d-4aea-b1cb-1e5adfe92cfd" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1032.514175] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-aa619879-3f9d-4aea-b1cb-1e5adfe92cfd" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1032.514304] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1032.514459] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1032.514555] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1032.517832] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1032.517832] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1032.517832] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('aa619879-3f9d-4aea-b1cb-1e5adfe92cfd',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1032.661994] env[65370]: INFO networking_nsxv3.common.synchronization [None req-a8391e5c-c371-455a-a177-9bef8879e630 None None] Enqueued Resource ID: 6020427f-b3bd-4b47-9909-e9eb1447d42c with Priority: HIGHEST for action port [ 1032.662560] env[65370]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6020427f-b3bd-4b47-9909-e9eb1447d42c with Priority: HIGHEST for action port [ 1032.662884] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock port-6020427f-b3bd-4b47-9909-e9eb1447d42c taken with stack trace [, , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1032.663016] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-6020427f-b3bd-4b47-9909-e9eb1447d42c" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1032.663299] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-6020427f-b3bd-4b47-9909-e9eb1447d42c" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1032.663775] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-6020427f-b3bd-4b47-9909-e9eb1447d42c" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1032.663884] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6020427f-b3bd-4b47-9909-e9eb1447d42c',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1032.870580] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9496f4d5-71fb-471e-bab0-2220819ba7ed in Status: SUCCESS [ 1032.870828] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9496f4d5-71fb-471e-bab0-2220819ba7ed" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1032.870989] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9496f4d5-71fb-471e-bab0-2220819ba7ed" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1032.871256] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9496f4d5-71fb-471e-bab0-2220819ba7ed" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1032.871475] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1032.871603] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1032.871661] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1032.872031] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1032.872031] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1032.872031] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9496f4d5-71fb-471e-bab0-2220819ba7ed" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1032.872169] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('9496f4d5-71fb-471e-bab0-2220819ba7ed',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1032.969792] env[65370]: DEBUG networking_nsxv3.common.locking [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Lock network-455 taken with stack trace [, , , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1032.970020] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquiring lock "network-455" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1032.971345] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquired lock "network-455" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1032.971345] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquired external semaphore "network-455" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1032.971345] env[65370]: DEBUG networking_nsxv3.common.locking [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1032.971345] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquiring lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1032.971345] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquired lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1032.971345] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquired external semaphore "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1032.971691] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Releasing lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1032.971691] env[65370]: DEBUG dogpile.cache.region [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] No value present for key: 'zone-id' {{(pid=65370) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1032.971772] env[65370]: DEBUG dogpile.lock [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] NeedRegenerationException {{(pid=65370) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1032.971809] env[65370]: DEBUG dogpile.lock [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] no value, waiting for create lock {{(pid=65370) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1032.971949] env[65370]: DEBUG dogpile.lock [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] value creation lock acquired {{(pid=65370) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1032.972019] env[65370]: DEBUG dogpile.cache.region [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] No value present for key: 'zone-id' {{(pid=65370) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1032.972132] env[65370]: DEBUG dogpile.lock [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Calling creation function for not-yet-present value {{(pid=65370) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1032.972259] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1032.992402] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1032.993917] env[65370]: DEBUG dogpile.cache.region [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=65370) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1032.993917] env[65370]: DEBUG dogpile.lock [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Released creation lock {{(pid=65370) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1032.993917] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Releasing lock "network-455" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1032.993917] env[65370]: DEBUG networking_nsxv3.common.locking [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Lock port-af54171e-667a-4abe-a588-1cb7a84d6e12 taken with stack trace [, , , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1032.993917] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquiring lock "port-af54171e-667a-4abe-a588-1cb7a84d6e12" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1032.993917] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquired lock "port-af54171e-667a-4abe-a588-1cb7a84d6e12" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1032.993917] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquired external semaphore "port-af54171e-667a-4abe-a588-1cb7a84d6e12" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1032.994469] env[65370]: DEBUG networking_nsxv3.api.rpc [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('af54171e-667a-4abe-a588-1cb7a84d6e12',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1033.019179] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1033.019324] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1033.019391] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1033.019617] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1033.019701] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1033.019903] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1033.020010] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1033.020098] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1033.020195] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1033.020267] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1033.020347] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: aa619879-3f9d-4aea-b1cb-1e5adfe92cfd already deleted. [ 1033.020433] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-aa619879-3f9d-4aea-b1cb-1e5adfe92cfd" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1033.025011] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 826ed52a-9222-434f-a4f9-e83fd60a5345 in Status: SUCCESS [ 1033.025011] env[65370]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 826ed52a-9222-434f-a4f9-e83fd60a5345 deletion is rescheduled due to dependency. [ 1033.025011] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-826ed52a-9222-434f-a4f9-e83fd60a5345" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1033.165978] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 6020427f-b3bd-4b47-9909-e9eb1447d42c [ 1033.166234] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1033.166467] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1033.166467] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1033.166653] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1033.166743] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1033.166839] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:6020427f-b3bd-4b47-9909-e9eb1447d42c already deleted. [ 1033.166920] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-6020427f-b3bd-4b47-9909-e9eb1447d42c" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1033.338326] env[65370]: INFO networking_nsxv3.common.synchronization [req-57d1bb9e-3b67-4eb4-994c-00292d8d731d req-a74f725d-a44e-4994-abda-5e74875b2182 tempest-ServerAddressesTestJSON-1719711035 tempest-ServerAddressesTestJSON-1719711035-project-member] Enqueued Resource ID: 48262726-1476-4e14-ad49-3cb37aeed405 with Priority: HIGHEST for action security_group_members [ 1033.339046] env[65370]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 48262726-1476-4e14-ad49-3cb37aeed405 with Priority: HIGHEST for action security_group_members [ 1033.339385] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock member-48262726-1476-4e14-ad49-3cb37aeed405 taken with stack trace [, , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1033.339541] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-48262726-1476-4e14-ad49-3cb37aeed405" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1033.339614] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-48262726-1476-4e14-ad49-3cb37aeed405" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1033.339999] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-48262726-1476-4e14-ad49-3cb37aeed405" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1033.339999] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1033.339999] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1033.340210] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1033.340210] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1033.340283] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1033.340389] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('48262726-1476-4e14-ad49-3cb37aeed405',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1033.374451] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock member-9496f4d5-71fb-471e-bab0-2220819ba7ed taken with stack trace [, , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1033.374662] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9496f4d5-71fb-471e-bab0-2220819ba7ed" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1033.374713] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9496f4d5-71fb-471e-bab0-2220819ba7ed" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1033.375218] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9496f4d5-71fb-471e-bab0-2220819ba7ed" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1033.375317] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1033.375387] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1033.375434] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1033.375556] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1033.375644] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1033.375730] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9496f4d5-71fb-471e-bab0-2220819ba7ed" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1033.376202] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock member-9496f4d5-71fb-471e-bab0-2220819ba7ed taken with stack trace [, , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1033.376202] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9496f4d5-71fb-471e-bab0-2220819ba7ed" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1033.376202] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9496f4d5-71fb-471e-bab0-2220819ba7ed" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1033.376202] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9496f4d5-71fb-471e-bab0-2220819ba7ed" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1033.376393] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1033.376393] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1033.376484] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1033.376565] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1033.376637] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1033.376716] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9496f4d5-71fb-471e-bab0-2220819ba7ed" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1033.376814] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('9496f4d5-71fb-471e-bab0-2220819ba7ed',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1033.484157] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: eba16cc3-e8ee-4772-ba0d-2b7b582b7844 in Status: SUCCESS [ 1033.484410] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-eba16cc3-e8ee-4772-ba0d-2b7b582b7844" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1033.484575] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-eba16cc3-e8ee-4772-ba0d-2b7b582b7844" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1033.484800] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-eba16cc3-e8ee-4772-ba0d-2b7b582b7844" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1033.484983] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1033.485111] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1033.485170] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1033.485321] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1033.485428] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1033.485525] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('eba16cc3-e8ee-4772-ba0d-2b7b582b7844',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1033.497201] env[65370]: DEBUG networking_nsxv3.common.locking [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1033.497572] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquiring lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1033.497707] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquired lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1033.497973] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquired external semaphore "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1033.498126] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Releasing lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1033.498271] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Segment Port af54171e-667a-4abe-a588-1cb7a84d6e12 not found, creating... [ 1033.498547] env[65370]: DEBUG networking_nsxv3.common.locking [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1033.498708] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquiring lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1033.498814] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquired lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1033.499061] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquired external semaphore "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1033.499199] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Releasing lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1033.499489] env[65370]: DEBUG networking_nsxv3.common.locking [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1033.499665] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquiring lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1033.499792] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquired lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1033.499996] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquired external semaphore "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1033.501411] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Releasing lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1033.501559] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Resource: SegmentPort with ID: af54171e-667a-4abe-a588-1cb7a84d6e12 is going to be created. [ 1033.523308] env[65370]: DEBUG networking_nsxv3.common.locking [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1033.523577] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquiring lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1033.523577] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquired lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1033.523844] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquired external semaphore "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1033.524089] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Releasing lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1033.524346] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Releasing lock "port-af54171e-667a-4abe-a588-1cb7a84d6e12" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1033.842489] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1033.842826] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1033.842826] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1033.843033] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1033.865831] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1033.866138] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1033.866349] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1033.866437] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1033.866634] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1033.866718] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1033.866810] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 48262726-1476-4e14-ad49-3cb37aeed405 is going to be updated. [ 1033.879194] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 9496f4d5-71fb-471e-bab0-2220819ba7ed: rpc.has_security_group_logging(os_id): False [ 1033.897916] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1033.898123] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1033.898123] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1033.898610] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1033.900607] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1033.900778] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1033.900778] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1033.900892] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1033.901046] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1033.912533] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 48262726-1476-4e14-ad49-3cb37aeed405 in Status: IN_PROGRESS for 2s [ 1033.927203] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1033.927203] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1033.927203] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1033.927203] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1033.927203] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1033.927203] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1033.927203] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1033.927203] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1033.927203] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1033.927603] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1033.927603] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1033.927676] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1033.927798] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1033.927865] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1033.928058] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1033.928171] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1033.928267] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 9496f4d5-71fb-471e-bab0-2220819ba7ed is going to be updated. [ 1033.987697] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('eba16cc3-e8ee-4772-ba0d-2b7b582b7844',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1034.018798] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1034.018961] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1034.019055] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1034.019310] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1034.019465] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1034.062858] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 9496f4d5-71fb-471e-bab0-2220819ba7ed in Status: IN_PROGRESS for 2s [ 1034.319380] env[65370]: INFO networking_nsxv3.common.synchronization [req-3d546c30-cf08-4d1e-bba2-06d9be130902 req-c69ca531-6386-421a-a141-a3bae67e301d service nova] Enqueued Resource ID: aa619879-3f9d-4aea-b1cb-1e5adfe92cfd with Priority: HIGHEST for action security_group_rules [ 1034.319380] env[65370]: INFO networking_nsxv3.common.synchronization [req-3d546c30-cf08-4d1e-bba2-06d9be130902 req-c69ca531-6386-421a-a141-a3bae67e301d service nova] Enqueued Resource ID: aa619879-3f9d-4aea-b1cb-1e5adfe92cfd with Priority: HIGHEST for action security_group_members [ 1034.319380] env[65370]: INFO networking_nsxv3.common.synchronization [req-3d546c30-cf08-4d1e-bba2-06d9be130902 req-c69ca531-6386-421a-a141-a3bae67e301d service nova] Enqueued Resource ID: af54171e-667a-4abe-a588-1cb7a84d6e12 with Priority: HIGHEST for action port [ 1034.319380] env[65370]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: aa619879-3f9d-4aea-b1cb-1e5adfe92cfd with Priority: HIGHEST for action security_group_rules [ 1034.319902] env[65370]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: aa619879-3f9d-4aea-b1cb-1e5adfe92cfd with Priority: HIGHEST for action security_group_members [ 1034.320086] env[65370]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: af54171e-667a-4abe-a588-1cb7a84d6e12 with Priority: HIGHEST for action port [ 1034.320577] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock rules-aa619879-3f9d-4aea-b1cb-1e5adfe92cfd taken with stack trace [, , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1034.320743] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-aa619879-3f9d-4aea-b1cb-1e5adfe92cfd" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1034.320835] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-aa619879-3f9d-4aea-b1cb-1e5adfe92cfd" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1034.321645] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-aa619879-3f9d-4aea-b1cb-1e5adfe92cfd" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1034.321645] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('aa619879-3f9d-4aea-b1cb-1e5adfe92cfd',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1034.322383] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock member-aa619879-3f9d-4aea-b1cb-1e5adfe92cfd taken with stack trace [, , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1034.322535] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-aa619879-3f9d-4aea-b1cb-1e5adfe92cfd" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1034.322611] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-aa619879-3f9d-4aea-b1cb-1e5adfe92cfd" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1034.322922] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-aa619879-3f9d-4aea-b1cb-1e5adfe92cfd" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1034.323119] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1034.324079] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1034.324079] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1034.324079] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1034.324410] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1034.324558] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('aa619879-3f9d-4aea-b1cb-1e5adfe92cfd',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1034.325657] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock port-af54171e-667a-4abe-a588-1cb7a84d6e12 taken with stack trace [, , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1034.325786] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-af54171e-667a-4abe-a588-1cb7a84d6e12" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1034.325856] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-af54171e-667a-4abe-a588-1cb7a84d6e12" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1034.326064] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-af54171e-667a-4abe-a588-1cb7a84d6e12" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1034.326808] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('af54171e-667a-4abe-a588-1cb7a84d6e12',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1034.490376] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('eba16cc3-e8ee-4772-ba0d-2b7b582b7844',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1034.828203] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('aa619879-3f9d-4aea-b1cb-1e5adfe92cfd',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1034.830180] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock member-aa619879-3f9d-4aea-b1cb-1e5adfe92cfd taken with stack trace [, , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1034.830324] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-aa619879-3f9d-4aea-b1cb-1e5adfe92cfd" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1034.831009] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port af54171e-667a-4abe-a588-1cb7a84d6e12 with status ACTIVE [ 1034.831009] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1034.831009] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1034.831281] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1034.831281] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1034.831399] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1034.831514] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1034.831610] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1034.831669] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1034.831808] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1034.831881] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1034.832088] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1034.832184] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1034.832240] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1034.832349] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1034.832417] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1034.832496] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: af54171e-667a-4abe-a588-1cb7a84d6e12 is going to be updated. [ 1034.856262] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1034.856652] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1034.857378] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1034.857378] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1034.857378] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1034.857378] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-af54171e-667a-4abe-a588-1cb7a84d6e12" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1034.992738] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1034.992887] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1034.992978] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1034.993234] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1034.993303] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1034.993378] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: eba16cc3-e8ee-4772-ba0d-2b7b582b7844 is going to be updated. [ 1035.025276] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1035.025458] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1035.025604] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1035.025851] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1035.026011] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1035.037541] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: eba16cc3-e8ee-4772-ba0d-2b7b582b7844 in Status: IN_PROGRESS for 2s [ 1035.332137] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('aa619879-3f9d-4aea-b1cb-1e5adfe92cfd',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1035.465599] env[65370]: INFO networking_nsxv3.common.synchronization [None req-177acaa6-0f4b-44f8-b9b5-c84784b643b8 None None] Enqueued Resource ID: bed2330a-ffa6-4234-b0a1-031d74473a31 with Priority: HIGHEST for action port [ 1035.466017] env[65370]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bed2330a-ffa6-4234-b0a1-031d74473a31 with Priority: HIGHEST for action port [ 1035.468653] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock port-bed2330a-ffa6-4234-b0a1-031d74473a31 taken with stack trace [, , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1035.468880] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-bed2330a-ffa6-4234-b0a1-031d74473a31" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1035.469267] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-bed2330a-ffa6-4234-b0a1-031d74473a31" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1035.472145] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-bed2330a-ffa6-4234-b0a1-031d74473a31" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1035.472235] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('bed2330a-ffa6-4234-b0a1-031d74473a31',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1035.835574] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1035.836025] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1035.836025] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1035.836112] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1035.836205] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1035.836362] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: aa619879-3f9d-4aea-b1cb-1e5adfe92cfd is going to be created. [ 1035.880040] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1035.880040] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1035.880210] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1035.880488] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1035.880959] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1035.895270] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: aa619879-3f9d-4aea-b1cb-1e5adfe92cfd in Status: UNINITIALIZED for 2s [ 1035.932471] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 48262726-1476-4e14-ad49-3cb37aeed405 in Status: SUCCESS [ 1035.932581] env[65370]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 48262726-1476-4e14-ad49-3cb37aeed405 deletion is rescheduled due to dependency. [ 1035.932624] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-48262726-1476-4e14-ad49-3cb37aeed405" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1035.977549] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port bed2330a-ffa6-4234-b0a1-031d74473a31 [ 1035.977821] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1035.977961] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1035.978043] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1035.978269] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1035.978351] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1035.978457] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:bed2330a-ffa6-4234-b0a1-031d74473a31 already deleted. [ 1035.978544] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-bed2330a-ffa6-4234-b0a1-031d74473a31" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1036.080401] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 9496f4d5-71fb-471e-bab0-2220819ba7ed in Status: SUCCESS [ 1036.080466] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-9496f4d5-71fb-471e-bab0-2220819ba7ed" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1036.080636] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-9496f4d5-71fb-471e-bab0-2220819ba7ed" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1036.080989] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-9496f4d5-71fb-471e-bab0-2220819ba7ed" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1036.081135] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('9496f4d5-71fb-471e-bab0-2220819ba7ed',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1036.440914] env[65370]: INFO networking_nsxv3.common.synchronization [req-9c629a13-d39b-4c01-9fce-3bf18814d24b req-c8c013be-4a64-4c52-9d0f-09dae9bda9d4 tempest-AttachInterfacesTestJSON-315686657 tempest-AttachInterfacesTestJSON-315686657-project-member] Enqueued Resource ID: 47d8b360-5d90-42ea-b9c3-ed76fddd03a3 with Priority: HIGHEST for action security_group_members [ 1036.441713] env[65370]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 47d8b360-5d90-42ea-b9c3-ed76fddd03a3 with Priority: HIGHEST for action security_group_members [ 1036.441860] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock member-47d8b360-5d90-42ea-b9c3-ed76fddd03a3 taken with stack trace [, , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1036.441945] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-47d8b360-5d90-42ea-b9c3-ed76fddd03a3" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1036.445022] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-47d8b360-5d90-42ea-b9c3-ed76fddd03a3" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1036.445022] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-47d8b360-5d90-42ea-b9c3-ed76fddd03a3" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1036.445022] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1036.445022] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1036.445022] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1036.445022] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1036.445022] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1036.445022] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('47d8b360-5d90-42ea-b9c3-ed76fddd03a3',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1036.585901] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock member-9496f4d5-71fb-471e-bab0-2220819ba7ed taken with stack trace [, , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1036.585901] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9496f4d5-71fb-471e-bab0-2220819ba7ed" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1036.585901] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9496f4d5-71fb-471e-bab0-2220819ba7ed" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1036.585901] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9496f4d5-71fb-471e-bab0-2220819ba7ed" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1036.585901] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1036.585901] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1036.585901] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1036.585901] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1036.585901] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1036.585901] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9496f4d5-71fb-471e-bab0-2220819ba7ed" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1036.585901] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('9496f4d5-71fb-471e-bab0-2220819ba7ed',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1036.592372] env[65370]: INFO networking_nsxv3.common.synchronization [None req-7a837107-d936-4664-a771-473201dfc8d8 tempest-AttachVolumeNegativeTest-719365731 tempest-AttachVolumeNegativeTest-719365731-project-member] Enqueued Resource ID: ff03ba53-594b-4bc2-b51c-5c04df76011d with Priority: HIGHEST for action security_group_rules [ 1036.592372] env[65370]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ff03ba53-594b-4bc2-b51c-5c04df76011d with Priority: HIGHEST for action security_group_rules [ 1036.592372] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock rules-ff03ba53-594b-4bc2-b51c-5c04df76011d taken with stack trace [, , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1036.592372] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-ff03ba53-594b-4bc2-b51c-5c04df76011d" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1036.592825] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-ff03ba53-594b-4bc2-b51c-5c04df76011d" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1036.593214] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-ff03ba53-594b-4bc2-b51c-5c04df76011d" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1036.593530] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('ff03ba53-594b-4bc2-b51c-5c04df76011d',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1036.723393] env[65370]: INFO networking_nsxv3.common.synchronization [None req-6a6f92be-bd2b-4fdb-8712-4971940b0720 tempest-AttachVolumeNegativeTest-719365731 tempest-AttachVolumeNegativeTest-719365731-project-member] Enqueued Resource ID: ff03ba53-594b-4bc2-b51c-5c04df76011d with Priority: HIGHEST for action security_group_rules [ 1036.724158] env[65370]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ff03ba53-594b-4bc2-b51c-5c04df76011d with Priority: HIGHEST for action security_group_rules [ 1036.724604] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock rules-ff03ba53-594b-4bc2-b51c-5c04df76011d taken with stack trace [, , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1036.724782] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-ff03ba53-594b-4bc2-b51c-5c04df76011d" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1036.945562] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1036.945895] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1036.945895] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1036.946181] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1036.971536] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1036.971805] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1036.971967] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1036.972849] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1036.972849] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1036.972849] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1036.972849] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 47d8b360-5d90-42ea-b9c3-ed76fddd03a3 is going to be updated. [ 1037.002980] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1037.003205] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1037.003205] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1037.003465] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1037.003653] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1037.013724] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 47d8b360-5d90-42ea-b9c3-ed76fddd03a3 in Status: IN_PROGRESS for 2s [ 1037.060768] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: eba16cc3-e8ee-4772-ba0d-2b7b582b7844 in Status: SUCCESS [ 1037.061033] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-eba16cc3-e8ee-4772-ba0d-2b7b582b7844" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1037.061205] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-eba16cc3-e8ee-4772-ba0d-2b7b582b7844" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1037.061452] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-eba16cc3-e8ee-4772-ba0d-2b7b582b7844" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1037.061693] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1037.061799] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1037.061799] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1037.062074] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1037.062160] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1037.062337] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-eba16cc3-e8ee-4772-ba0d-2b7b582b7844" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1037.062337] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('eba16cc3-e8ee-4772-ba0d-2b7b582b7844',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1037.090705] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock member-9496f4d5-71fb-471e-bab0-2220819ba7ed taken with stack trace [, , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1037.090705] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9496f4d5-71fb-471e-bab0-2220819ba7ed" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1037.090705] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9496f4d5-71fb-471e-bab0-2220819ba7ed" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1037.090705] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9496f4d5-71fb-471e-bab0-2220819ba7ed" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1037.090957] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1037.090957] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1037.091164] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1037.092376] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1037.092376] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1037.092376] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9496f4d5-71fb-471e-bab0-2220819ba7ed" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1037.092376] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock member-9496f4d5-71fb-471e-bab0-2220819ba7ed taken with stack trace [, , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1037.092376] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9496f4d5-71fb-471e-bab0-2220819ba7ed" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1037.092376] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9496f4d5-71fb-471e-bab0-2220819ba7ed" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1037.092376] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9496f4d5-71fb-471e-bab0-2220819ba7ed" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1037.092376] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1037.092376] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1037.092376] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1037.092840] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1037.092840] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1037.092840] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9496f4d5-71fb-471e-bab0-2220819ba7ed" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1037.092840] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('9496f4d5-71fb-471e-bab0-2220819ba7ed',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1037.118194] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1037.118383] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1037.118456] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1037.118689] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1037.118780] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1037.118882] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: ff03ba53-594b-4bc2-b51c-5c04df76011d already deleted. [ 1037.118968] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-ff03ba53-594b-4bc2-b51c-5c04df76011d" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1037.119539] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-ff03ba53-594b-4bc2-b51c-5c04df76011d" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1037.119731] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-ff03ba53-594b-4bc2-b51c-5c04df76011d" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1037.119820] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('ff03ba53-594b-4bc2-b51c-5c04df76011d',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1037.568056] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock member-eba16cc3-e8ee-4772-ba0d-2b7b582b7844 taken with stack trace [, , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1037.568056] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-eba16cc3-e8ee-4772-ba0d-2b7b582b7844" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1037.568056] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-eba16cc3-e8ee-4772-ba0d-2b7b582b7844" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1037.568056] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-eba16cc3-e8ee-4772-ba0d-2b7b582b7844" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1037.568056] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1037.568056] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1037.568056] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1037.568056] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1037.568056] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1037.568056] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-eba16cc3-e8ee-4772-ba0d-2b7b582b7844" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1037.568056] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock member-eba16cc3-e8ee-4772-ba0d-2b7b582b7844 taken with stack trace [, , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1037.568056] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-eba16cc3-e8ee-4772-ba0d-2b7b582b7844" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1037.568056] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-eba16cc3-e8ee-4772-ba0d-2b7b582b7844" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1037.568056] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-eba16cc3-e8ee-4772-ba0d-2b7b582b7844" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1037.568056] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1037.568056] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1037.568901] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1037.568901] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1037.568901] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1037.568901] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-eba16cc3-e8ee-4772-ba0d-2b7b582b7844" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1037.568901] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('eba16cc3-e8ee-4772-ba0d-2b7b582b7844',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1037.595807] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 9496f4d5-71fb-471e-bab0-2220819ba7ed: rpc.has_security_group_logging(os_id): False [ 1037.605909] env[65370]: INFO networking_nsxv3.common.synchronization [req-b13c7c03-fcfe-4318-83d4-77cc9475473e req-7f240257-ded6-447e-a0d5-c55365a6d34a tempest-AttachVolumeShelveTestJSON-478164993 tempest-AttachVolumeShelveTestJSON-478164993-project-member] Enqueued Resource ID: 154b7e30-9d22-43f4-84bb-7d8dd4d7cc9a with Priority: HIGHEST for action security_group_members [ 1037.606755] env[65370]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 154b7e30-9d22-43f4-84bb-7d8dd4d7cc9a with Priority: HIGHEST for action security_group_members [ 1037.606855] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock member-154b7e30-9d22-43f4-84bb-7d8dd4d7cc9a taken with stack trace [, , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1037.607868] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-154b7e30-9d22-43f4-84bb-7d8dd4d7cc9a" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1037.607958] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-154b7e30-9d22-43f4-84bb-7d8dd4d7cc9a" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1037.610223] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-154b7e30-9d22-43f4-84bb-7d8dd4d7cc9a" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1037.610322] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1037.610435] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1037.610494] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1037.610695] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1037.610771] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1037.610860] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('154b7e30-9d22-43f4-84bb-7d8dd4d7cc9a',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1037.615053] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1037.615053] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1037.615053] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1037.615053] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1037.615053] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1037.615725] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1037.615725] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1037.615725] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1037.615725] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1037.615725] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1037.616306] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1037.616306] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1037.616306] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1037.616306] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1037.616306] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1037.616743] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1037.616743] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1037.616743] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1037.616743] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1037.616743] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1037.617061] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 9496f4d5-71fb-471e-bab0-2220819ba7ed is going to be updated. [ 1037.640118] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1037.640257] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1037.640304] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1037.640715] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1037.640838] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1037.640940] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: ff03ba53-594b-4bc2-b51c-5c04df76011d already deleted. [ 1037.641033] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-ff03ba53-594b-4bc2-b51c-5c04df76011d" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1037.726670] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1037.726828] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1037.726897] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1037.727151] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1037.727305] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1037.755558] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 9496f4d5-71fb-471e-bab0-2220819ba7ed in Status: IN_PROGRESS for 2s [ 1037.905673] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: aa619879-3f9d-4aea-b1cb-1e5adfe92cfd in Status: SUCCESS [ 1037.905907] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-aa619879-3f9d-4aea-b1cb-1e5adfe92cfd" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1037.906113] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-aa619879-3f9d-4aea-b1cb-1e5adfe92cfd" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1037.906403] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-aa619879-3f9d-4aea-b1cb-1e5adfe92cfd" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1037.906645] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1037.906795] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1037.906863] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1037.907044] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1037.907128] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1037.907216] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-aa619879-3f9d-4aea-b1cb-1e5adfe92cfd" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1037.907306] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('aa619879-3f9d-4aea-b1cb-1e5adfe92cfd',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1037.978770] env[65370]: DEBUG networking_nsxv3.common.locking [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Lock network-745 taken with stack trace [, , , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1037.979145] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquiring lock "network-745" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1037.979145] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquired lock "network-745" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1037.979432] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquired external semaphore "network-745" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1037.979686] env[65370]: DEBUG networking_nsxv3.common.locking [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1037.979879] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquiring lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1037.979952] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquired lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1037.980984] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquired external semaphore "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1037.981157] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Releasing lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1037.981369] env[65370]: DEBUG dogpile.cache.region [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] No value present for key: 'zone-id' {{(pid=65370) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1037.981484] env[65370]: DEBUG dogpile.lock [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] NeedRegenerationException {{(pid=65370) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1037.981594] env[65370]: DEBUG dogpile.lock [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] no value, waiting for create lock {{(pid=65370) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1037.981702] env[65370]: DEBUG dogpile.lock [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] value creation lock acquired {{(pid=65370) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1037.981812] env[65370]: DEBUG dogpile.cache.region [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] No value present for key: 'zone-id' {{(pid=65370) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1037.981917] env[65370]: DEBUG dogpile.lock [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Calling creation function for not-yet-present value {{(pid=65370) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1037.982073] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1038.006491] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1038.009029] env[65370]: DEBUG dogpile.cache.region [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Cache value generated in 0.025 seconds for key(s): 'zone-id' {{(pid=65370) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1038.009029] env[65370]: DEBUG dogpile.lock [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Released creation lock {{(pid=65370) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1038.009029] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Releasing lock "network-745" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1038.009029] env[65370]: DEBUG networking_nsxv3.common.locking [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Lock port-96286831-489e-48b7-be37-b5399f00007b taken with stack trace [, , , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1038.009029] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquiring lock "port-96286831-489e-48b7-be37-b5399f00007b" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1038.009029] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquired lock "port-96286831-489e-48b7-be37-b5399f00007b" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1038.009029] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquired external semaphore "port-96286831-489e-48b7-be37-b5399f00007b" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1038.009029] env[65370]: DEBUG networking_nsxv3.api.rpc [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('96286831-489e-48b7-be37-b5399f00007b',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1038.073322] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for eba16cc3-e8ee-4772-ba0d-2b7b582b7844: rpc.has_security_group_logging(os_id): False [ 1038.102902] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1038.103134] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1038.103134] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1038.103421] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1038.103536] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1038.103793] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1038.103906] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1038.103993] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1038.104180] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1038.104254] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1038.104584] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1038.104685] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1038.104802] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1038.104975] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1038.105110] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1038.105440] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1038.105547] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1038.105596] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1038.105761] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1038.105842] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1038.105929] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: eba16cc3-e8ee-4772-ba0d-2b7b582b7844 is going to be updated. [ 1038.113107] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1038.113279] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1038.113329] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1038.113485] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1038.113573] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1038.113793] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1038.113883] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1038.113926] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1038.114056] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1038.114132] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1038.114200] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 154b7e30-9d22-43f4-84bb-7d8dd4d7cc9a already deleted. [ 1038.114277] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-154b7e30-9d22-43f4-84bb-7d8dd4d7cc9a" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1038.188965] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1038.189224] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1038.189224] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1038.189478] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1038.189655] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1038.208767] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: eba16cc3-e8ee-4772-ba0d-2b7b582b7844 in Status: IN_PROGRESS for 2s [ 1038.411369] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('aa619879-3f9d-4aea-b1cb-1e5adfe92cfd',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1038.512592] env[65370]: DEBUG networking_nsxv3.common.locking [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1038.512893] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquiring lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1038.512987] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquired lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1038.513303] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquired external semaphore "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1038.513453] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Releasing lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1038.513607] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Segment Port 96286831-489e-48b7-be37-b5399f00007b not found, creating... [ 1038.513867] env[65370]: DEBUG networking_nsxv3.common.locking [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1038.514039] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquiring lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1038.514159] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquired lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1038.514366] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquired external semaphore "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1038.514497] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Releasing lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1038.514766] env[65370]: DEBUG networking_nsxv3.common.locking [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1038.515118] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquiring lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1038.515118] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquired lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1038.515261] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquired external semaphore "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1038.515447] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Releasing lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1038.515657] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Resource: SegmentPort with ID: 96286831-489e-48b7-be37-b5399f00007b is going to be created. [ 1038.542125] env[65370]: DEBUG networking_nsxv3.common.locking [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1038.542443] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquiring lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1038.542698] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquired lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1038.543055] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquired external semaphore "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1038.543393] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Releasing lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1038.543664] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Releasing lock "port-96286831-489e-48b7-be37-b5399f00007b" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1038.914453] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for aa619879-3f9d-4aea-b1cb-1e5adfe92cfd: rpc.has_security_group_logging(os_id): False [ 1038.932821] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1038.932976] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1038.933120] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1038.933303] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1038.933384] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1038.933682] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1038.933756] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1038.933843] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1038.933976] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1038.934051] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1038.934138] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: aa619879-3f9d-4aea-b1cb-1e5adfe92cfd is going to be created. [ 1039.005421] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1039.005975] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1039.005975] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1039.005975] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1039.006278] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1039.025223] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 47d8b360-5d90-42ea-b9c3-ed76fddd03a3 in Status: SUCCESS [ 1039.025384] env[65370]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 47d8b360-5d90-42ea-b9c3-ed76fddd03a3 deletion is rescheduled due to dependency. [ 1039.025599] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-47d8b360-5d90-42ea-b9c3-ed76fddd03a3" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1039.026400] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: aa619879-3f9d-4aea-b1cb-1e5adfe92cfd in Status: IN_PROGRESS for 2s [ 1039.440020] env[65370]: INFO networking_nsxv3.common.synchronization [req-b13c7c03-fcfe-4318-83d4-77cc9475473e req-be247aa5-cc64-4b56-a34a-ab3ee4f5e697 service nova] Enqueued Resource ID: 154b7e30-9d22-43f4-84bb-7d8dd4d7cc9a with Priority: HIGHEST for action security_group_rules [ 1039.440020] env[65370]: INFO networking_nsxv3.common.synchronization [req-b13c7c03-fcfe-4318-83d4-77cc9475473e req-be247aa5-cc64-4b56-a34a-ab3ee4f5e697 service nova] Enqueued Resource ID: 154b7e30-9d22-43f4-84bb-7d8dd4d7cc9a with Priority: HIGHEST for action security_group_members [ 1039.440020] env[65370]: INFO networking_nsxv3.common.synchronization [req-b13c7c03-fcfe-4318-83d4-77cc9475473e req-be247aa5-cc64-4b56-a34a-ab3ee4f5e697 service nova] Enqueued Resource ID: 96286831-489e-48b7-be37-b5399f00007b with Priority: HIGHEST for action port [ 1039.440572] env[65370]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 154b7e30-9d22-43f4-84bb-7d8dd4d7cc9a with Priority: HIGHEST for action security_group_rules [ 1039.440827] env[65370]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 154b7e30-9d22-43f4-84bb-7d8dd4d7cc9a with Priority: HIGHEST for action security_group_members [ 1039.441068] env[65370]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 96286831-489e-48b7-be37-b5399f00007b with Priority: HIGHEST for action port [ 1039.441481] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock rules-154b7e30-9d22-43f4-84bb-7d8dd4d7cc9a taken with stack trace [, , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1039.442365] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-154b7e30-9d22-43f4-84bb-7d8dd4d7cc9a" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1039.442365] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-154b7e30-9d22-43f4-84bb-7d8dd4d7cc9a" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1039.442365] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-154b7e30-9d22-43f4-84bb-7d8dd4d7cc9a" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1039.442365] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('154b7e30-9d22-43f4-84bb-7d8dd4d7cc9a',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1039.443111] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock member-154b7e30-9d22-43f4-84bb-7d8dd4d7cc9a taken with stack trace [, , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1039.443245] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-154b7e30-9d22-43f4-84bb-7d8dd4d7cc9a" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1039.443307] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-154b7e30-9d22-43f4-84bb-7d8dd4d7cc9a" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1039.443543] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-154b7e30-9d22-43f4-84bb-7d8dd4d7cc9a" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1039.443692] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1039.444229] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1039.444229] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1039.444229] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1039.444229] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1039.444524] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('154b7e30-9d22-43f4-84bb-7d8dd4d7cc9a',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1039.449081] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock port-96286831-489e-48b7-be37-b5399f00007b taken with stack trace [, , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1039.449081] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-96286831-489e-48b7-be37-b5399f00007b" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1039.449081] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-96286831-489e-48b7-be37-b5399f00007b" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1039.449081] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-96286831-489e-48b7-be37-b5399f00007b" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1039.449081] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('96286831-489e-48b7-be37-b5399f00007b',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1039.791173] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 9496f4d5-71fb-471e-bab0-2220819ba7ed in Status: SUCCESS [ 1039.791173] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-9496f4d5-71fb-471e-bab0-2220819ba7ed" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1039.917829] env[65370]: INFO networking_nsxv3.common.synchronization [req-67ed9207-9721-432c-81ac-8fbca226c7f6 req-351c68c3-11f7-4625-8d58-93ae404d481d tempest-AttachInterfacesUnderV243Test-197944153 tempest-AttachInterfacesUnderV243Test-197944153-project-member] Enqueued Resource ID: 84a5376d-c8c0-4dd2-bea4-f01f11567a72 with Priority: HIGHEST for action security_group_members [ 1039.918451] env[65370]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 84a5376d-c8c0-4dd2-bea4-f01f11567a72 with Priority: HIGHEST for action security_group_members [ 1039.918794] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock member-84a5376d-c8c0-4dd2-bea4-f01f11567a72 taken with stack trace [, , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1039.918926] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-84a5376d-c8c0-4dd2-bea4-f01f11567a72" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1039.918993] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-84a5376d-c8c0-4dd2-bea4-f01f11567a72" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1039.919212] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-84a5376d-c8c0-4dd2-bea4-f01f11567a72" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1039.919366] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1039.919490] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1039.919553] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1039.919700] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1039.919783] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1039.919879] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('84a5376d-c8c0-4dd2-bea4-f01f11567a72',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1039.937693] env[65370]: INFO networking_nsxv3.common.synchronization [req-67ed9207-9721-432c-81ac-8fbca226c7f6 req-351c68c3-11f7-4625-8d58-93ae404d481d tempest-AttachInterfacesUnderV243Test-197944153 tempest-AttachInterfacesUnderV243Test-197944153-project-member] Enqueued Resource ID: 84a5376d-c8c0-4dd2-bea4-f01f11567a72 with Priority: HIGHEST for action security_group_rules [ 1039.937888] env[65370]: INFO networking_nsxv3.common.synchronization [req-67ed9207-9721-432c-81ac-8fbca226c7f6 req-351c68c3-11f7-4625-8d58-93ae404d481d tempest-AttachInterfacesUnderV243Test-197944153 tempest-AttachInterfacesUnderV243Test-197944153-project-member] Enqueued Resource ID: 84a5376d-c8c0-4dd2-bea4-f01f11567a72 with Priority: HIGHEST for action security_group_members [ 1039.938036] env[65370]: INFO networking_nsxv3.common.synchronization [req-67ed9207-9721-432c-81ac-8fbca226c7f6 req-351c68c3-11f7-4625-8d58-93ae404d481d tempest-AttachInterfacesUnderV243Test-197944153 tempest-AttachInterfacesUnderV243Test-197944153-project-member] Enqueued Resource ID: 5aebefd2-c896-4612-a30a-7f40acda0a45 with Priority: HIGHEST for action port [ 1039.938550] env[65370]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 84a5376d-c8c0-4dd2-bea4-f01f11567a72 with Priority: HIGHEST for action security_group_rules [ 1039.938626] env[65370]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 84a5376d-c8c0-4dd2-bea4-f01f11567a72 with Priority: HIGHEST for action security_group_members [ 1039.938741] env[65370]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5aebefd2-c896-4612-a30a-7f40acda0a45 with Priority: HIGHEST for action port [ 1039.939015] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock rules-84a5376d-c8c0-4dd2-bea4-f01f11567a72 taken with stack trace [, , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1039.939138] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-84a5376d-c8c0-4dd2-bea4-f01f11567a72" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1039.939205] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-84a5376d-c8c0-4dd2-bea4-f01f11567a72" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1039.939390] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-84a5376d-c8c0-4dd2-bea4-f01f11567a72" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1039.939468] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('84a5376d-c8c0-4dd2-bea4-f01f11567a72',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1039.940294] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock member-84a5376d-c8c0-4dd2-bea4-f01f11567a72 taken with stack trace [, , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1039.941181] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-84a5376d-c8c0-4dd2-bea4-f01f11567a72" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1039.941181] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock port-5aebefd2-c896-4612-a30a-7f40acda0a45 taken with stack trace [, , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1039.941181] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-5aebefd2-c896-4612-a30a-7f40acda0a45" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1039.941181] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-5aebefd2-c896-4612-a30a-7f40acda0a45" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1039.943120] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-5aebefd2-c896-4612-a30a-7f40acda0a45" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1039.943120] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5aebefd2-c896-4612-a30a-7f40acda0a45',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1039.947762] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('154b7e30-9d22-43f4-84bb-7d8dd4d7cc9a',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1039.953051] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock member-154b7e30-9d22-43f4-84bb-7d8dd4d7cc9a taken with stack trace [, , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1039.953051] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-154b7e30-9d22-43f4-84bb-7d8dd4d7cc9a" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1039.953051] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 96286831-489e-48b7-be37-b5399f00007b with status ACTIVE [ 1039.953051] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1039.953051] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1039.953051] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1039.953051] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1039.953051] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1039.953051] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1039.953051] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1039.953051] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1039.953051] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1039.953051] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1039.953051] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1039.955195] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1039.955195] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1039.955195] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1039.955195] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1039.955195] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 96286831-489e-48b7-be37-b5399f00007b is going to be updated. [ 1039.976591] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1039.976734] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1039.976801] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1039.977021] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1039.977160] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1039.977313] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-96286831-489e-48b7-be37-b5399f00007b" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1040.095259] env[65370]: INFO networking_nsxv3.common.synchronization [req-adfc7499-094f-49df-8d8a-98f3b882d75a req-27a45e7f-ec61-44f9-968a-688d55a1b768 tempest-ServerActionsTestOtherA-1239332614 tempest-ServerActionsTestOtherA-1239332614-project-member] Enqueued Resource ID: b7074d70-d8cb-411f-b8c4-a4007dfd74f8 with Priority: HIGHEST for action security_group_members [ 1040.095259] env[65370]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b7074d70-d8cb-411f-b8c4-a4007dfd74f8 with Priority: HIGHEST for action security_group_members [ 1040.095691] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock member-b7074d70-d8cb-411f-b8c4-a4007dfd74f8 taken with stack trace [, , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1040.095691] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b7074d70-d8cb-411f-b8c4-a4007dfd74f8" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1040.095818] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b7074d70-d8cb-411f-b8c4-a4007dfd74f8" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1040.096568] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b7074d70-d8cb-411f-b8c4-a4007dfd74f8" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1040.096568] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1040.096568] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1040.096568] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1040.096568] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1040.096568] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1040.096568] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b7074d70-d8cb-411f-b8c4-a4007dfd74f8',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1040.223484] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: eba16cc3-e8ee-4772-ba0d-2b7b582b7844 in Status: SUCCESS [ 1040.223762] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-eba16cc3-e8ee-4772-ba0d-2b7b582b7844" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1040.423254] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('84a5376d-c8c0-4dd2-bea4-f01f11567a72',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1040.444793] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock member-84a5376d-c8c0-4dd2-bea4-f01f11567a72 taken with stack trace [, , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1040.445139] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-84a5376d-c8c0-4dd2-bea4-f01f11567a72" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1040.445496] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 5aebefd2-c896-4612-a30a-7f40acda0a45 with status ACTIVE [ 1040.445767] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1040.445948] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1040.446065] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1040.446388] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1040.446541] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1040.446837] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1040.447020] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1040.447124] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1040.448172] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1040.448172] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1040.448172] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1040.448172] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1040.448567] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1040.448871] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1040.449082] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1040.449291] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 5aebefd2-c896-4612-a30a-7f40acda0a45 is going to be updated. [ 1040.451825] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('154b7e30-9d22-43f4-84bb-7d8dd4d7cc9a',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1040.487196] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1040.487382] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1040.487483] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1040.487863] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1040.488065] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1040.488293] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-5aebefd2-c896-4612-a30a-7f40acda0a45" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1040.534412] env[65370]: DEBUG networking_nsxv3.common.locking [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Lock network-865 taken with stack trace [, , , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1040.534620] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquiring lock "network-865" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1040.534740] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquired lock "network-865" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1040.535044] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquired external semaphore "network-865" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1040.535422] env[65370]: DEBUG networking_nsxv3.common.locking [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1040.535615] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquiring lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1040.535769] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquired lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1040.536015] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquired external semaphore "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1040.536172] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Releasing lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1040.536385] env[65370]: DEBUG dogpile.cache.region [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] No value present for key: 'zone-id' {{(pid=65370) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1040.536494] env[65370]: DEBUG dogpile.lock [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] NeedRegenerationException {{(pid=65370) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1040.536599] env[65370]: DEBUG dogpile.lock [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] no value, waiting for create lock {{(pid=65370) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1040.536706] env[65370]: DEBUG dogpile.lock [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] value creation lock acquired {{(pid=65370) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1040.536811] env[65370]: DEBUG dogpile.cache.region [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] No value present for key: 'zone-id' {{(pid=65370) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1040.536911] env[65370]: DEBUG dogpile.lock [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Calling creation function for not-yet-present value {{(pid=65370) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1040.537062] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1040.555886] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1040.556102] env[65370]: DEBUG dogpile.cache.region [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=65370) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1040.556261] env[65370]: DEBUG dogpile.lock [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Released creation lock {{(pid=65370) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1040.556438] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Releasing lock "network-865" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1040.556751] env[65370]: DEBUG networking_nsxv3.common.locking [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Lock port-5baa400f-e6fb-4dc5-bea4-2b09cdc4c10d taken with stack trace [, , , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1040.556920] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquiring lock "port-5baa400f-e6fb-4dc5-bea4-2b09cdc4c10d" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1040.557053] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquired lock "port-5baa400f-e6fb-4dc5-bea4-2b09cdc4c10d" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1040.557385] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquired external semaphore "port-5baa400f-e6fb-4dc5-bea4-2b09cdc4c10d" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1040.557516] env[65370]: DEBUG networking_nsxv3.api.rpc [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5baa400f-e6fb-4dc5-bea4-2b09cdc4c10d',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1040.599073] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1040.599422] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1040.599422] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1040.599928] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1040.599928] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1040.599928] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1040.599928] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1040.599928] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1040.600261] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1040.600261] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1040.600261] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b7074d70-d8cb-411f-b8c4-a4007dfd74f8 is going to be deleted. [ 1040.650763] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1040.650999] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1040.650999] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1040.651319] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1040.651450] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1040.651577] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b7074d70-d8cb-411f-b8c4-a4007dfd74f8" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1040.925323] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('84a5376d-c8c0-4dd2-bea4-f01f11567a72',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1040.963670] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1040.963852] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1040.964067] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1040.965858] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1040.965858] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1040.965858] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 154b7e30-9d22-43f4-84bb-7d8dd4d7cc9a is going to be created. [ 1040.989057] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1040.989245] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1040.989327] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1040.989491] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1040.989649] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1040.999381] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 154b7e30-9d22-43f4-84bb-7d8dd4d7cc9a in Status: UNINITIALIZED for 2s [ 1041.040637] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: aa619879-3f9d-4aea-b1cb-1e5adfe92cfd in Status: SUCCESS [ 1041.042438] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-aa619879-3f9d-4aea-b1cb-1e5adfe92cfd" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1041.059629] env[65370]: DEBUG networking_nsxv3.common.locking [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1041.059908] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquiring lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1041.060035] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquired lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1041.060349] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquired external semaphore "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1041.060503] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Releasing lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1041.060661] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Segment Port 5baa400f-e6fb-4dc5-bea4-2b09cdc4c10d not found, creating... [ 1041.060933] env[65370]: DEBUG networking_nsxv3.common.locking [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1041.061186] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquiring lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1041.061255] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquired lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1041.061458] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquired external semaphore "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1041.061602] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Releasing lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1041.061895] env[65370]: DEBUG networking_nsxv3.common.locking [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1041.065773] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquiring lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1041.065999] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquired lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1041.066304] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquired external semaphore "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1041.066474] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Releasing lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1041.066626] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Resource: SegmentPort with ID: 5baa400f-e6fb-4dc5-bea4-2b09cdc4c10d is going to be created. [ 1041.096317] env[65370]: DEBUG networking_nsxv3.common.locking [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1041.096787] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquiring lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1041.096787] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquired lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1041.096946] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquired external semaphore "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1041.097195] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Releasing lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1041.097454] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Releasing lock "port-5baa400f-e6fb-4dc5-bea4-2b09cdc4c10d" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1041.427637] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1041.427815] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1041.427921] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1041.428144] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1041.428226] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1041.428481] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 84a5376d-c8c0-4dd2-bea4-f01f11567a72 is going to be updated. [ 1041.467100] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1041.467389] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1041.467389] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1041.467640] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1041.467640] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1041.478580] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 84a5376d-c8c0-4dd2-bea4-f01f11567a72 in Status: IN_PROGRESS for 2s [ 1041.817368] env[65370]: INFO networking_nsxv3.common.synchronization [req-adfc7499-094f-49df-8d8a-98f3b882d75a req-2beda3dc-4918-4714-8c2a-43497caddf81 service nova] Enqueued Resource ID: b7074d70-d8cb-411f-b8c4-a4007dfd74f8 with Priority: HIGHEST for action security_group_rules [ 1041.819431] env[65370]: INFO networking_nsxv3.common.synchronization [req-adfc7499-094f-49df-8d8a-98f3b882d75a req-2beda3dc-4918-4714-8c2a-43497caddf81 service nova] Enqueued Resource ID: b7074d70-d8cb-411f-b8c4-a4007dfd74f8 with Priority: HIGHEST for action security_group_members [ 1041.819431] env[65370]: INFO networking_nsxv3.common.synchronization [req-adfc7499-094f-49df-8d8a-98f3b882d75a req-2beda3dc-4918-4714-8c2a-43497caddf81 service nova] Enqueued Resource ID: 5baa400f-e6fb-4dc5-bea4-2b09cdc4c10d with Priority: HIGHEST for action port [ 1041.819431] env[65370]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b7074d70-d8cb-411f-b8c4-a4007dfd74f8 with Priority: HIGHEST for action security_group_rules [ 1041.819431] env[65370]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b7074d70-d8cb-411f-b8c4-a4007dfd74f8 with Priority: HIGHEST for action security_group_members [ 1041.819431] env[65370]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5baa400f-e6fb-4dc5-bea4-2b09cdc4c10d with Priority: HIGHEST for action port [ 1041.819431] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock rules-b7074d70-d8cb-411f-b8c4-a4007dfd74f8 taken with stack trace [, , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1041.819431] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-b7074d70-d8cb-411f-b8c4-a4007dfd74f8" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1041.819431] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-b7074d70-d8cb-411f-b8c4-a4007dfd74f8" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1041.819431] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-b7074d70-d8cb-411f-b8c4-a4007dfd74f8" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1041.820072] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('b7074d70-d8cb-411f-b8c4-a4007dfd74f8',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1041.826387] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock member-b7074d70-d8cb-411f-b8c4-a4007dfd74f8 taken with stack trace [, , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1041.826387] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b7074d70-d8cb-411f-b8c4-a4007dfd74f8" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1041.826387] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b7074d70-d8cb-411f-b8c4-a4007dfd74f8" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1041.826387] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b7074d70-d8cb-411f-b8c4-a4007dfd74f8" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1041.826387] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1041.826387] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1041.826387] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1041.826387] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1041.826387] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1041.826387] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b7074d70-d8cb-411f-b8c4-a4007dfd74f8',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1041.826387] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock port-5baa400f-e6fb-4dc5-bea4-2b09cdc4c10d taken with stack trace [, , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1041.826387] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-5baa400f-e6fb-4dc5-bea4-2b09cdc4c10d" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1041.826945] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-5baa400f-e6fb-4dc5-bea4-2b09cdc4c10d" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1041.826945] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-5baa400f-e6fb-4dc5-bea4-2b09cdc4c10d" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1041.826945] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5baa400f-e6fb-4dc5-bea4-2b09cdc4c10d',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1042.329403] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('b7074d70-d8cb-411f-b8c4-a4007dfd74f8',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1042.331129] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock member-b7074d70-d8cb-411f-b8c4-a4007dfd74f8 taken with stack trace [, , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1042.331359] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b7074d70-d8cb-411f-b8c4-a4007dfd74f8" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1042.331677] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 5baa400f-e6fb-4dc5-bea4-2b09cdc4c10d with status ACTIVE [ 1042.336391] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1042.336391] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1042.336391] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1042.336391] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1042.336391] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1042.336391] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1042.336391] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1042.336391] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1042.336391] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1042.336391] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1042.336391] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1042.336391] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1042.336391] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1042.336391] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1042.336391] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1042.336391] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 5baa400f-e6fb-4dc5-bea4-2b09cdc4c10d is going to be updated. [ 1042.361066] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1042.361066] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1042.361066] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1042.361245] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1042.361281] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1042.361475] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-5baa400f-e6fb-4dc5-bea4-2b09cdc4c10d" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1042.833758] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('b7074d70-d8cb-411f-b8c4-a4007dfd74f8',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1043.011453] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 154b7e30-9d22-43f4-84bb-7d8dd4d7cc9a in Status: SUCCESS [ 1043.011671] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-154b7e30-9d22-43f4-84bb-7d8dd4d7cc9a" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1043.012236] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-154b7e30-9d22-43f4-84bb-7d8dd4d7cc9a" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1043.012538] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-154b7e30-9d22-43f4-84bb-7d8dd4d7cc9a" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1043.012727] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1043.012844] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1043.012907] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1043.013065] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1043.013144] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1043.013226] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-154b7e30-9d22-43f4-84bb-7d8dd4d7cc9a" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1043.013312] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('154b7e30-9d22-43f4-84bb-7d8dd4d7cc9a',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1043.336195] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1043.336623] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1043.336719] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1043.337112] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1043.337497] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1043.337563] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b7074d70-d8cb-411f-b8c4-a4007dfd74f8 is going to be created. [ 1043.366803] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1043.366977] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1043.367062] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1043.367833] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1043.368356] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1043.379893] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b7074d70-d8cb-411f-b8c4-a4007dfd74f8 in Status: UNINITIALIZED for 2s [ 1043.488260] env[65370]: INFO networking_nsxv3.common.synchronization [req-0cbc9bd8-ef2c-4421-a814-e215562aa5da req-8b08567a-9063-42bf-9d09-68c1bcb77e44 tempest-ServersNegativeTestJSON-226836032 tempest-ServersNegativeTestJSON-226836032-project-member] Enqueued Resource ID: eba16cc3-e8ee-4772-ba0d-2b7b582b7844 with Priority: HIGHEST for action security_group_members [ 1043.488906] env[65370]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: eba16cc3-e8ee-4772-ba0d-2b7b582b7844 with Priority: HIGHEST for action security_group_members [ 1043.489290] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock member-eba16cc3-e8ee-4772-ba0d-2b7b582b7844 taken with stack trace [, , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1043.489432] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-eba16cc3-e8ee-4772-ba0d-2b7b582b7844" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1043.489479] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-eba16cc3-e8ee-4772-ba0d-2b7b582b7844" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1043.489689] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-eba16cc3-e8ee-4772-ba0d-2b7b582b7844" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1043.489794] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1043.490050] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1043.490050] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1043.490208] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1043.490331] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1043.490423] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('eba16cc3-e8ee-4772-ba0d-2b7b582b7844',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1043.492105] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 84a5376d-c8c0-4dd2-bea4-f01f11567a72 in Status: SUCCESS [ 1043.492296] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-84a5376d-c8c0-4dd2-bea4-f01f11567a72" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1043.492749] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-84a5376d-c8c0-4dd2-bea4-f01f11567a72" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1043.492934] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-84a5376d-c8c0-4dd2-bea4-f01f11567a72" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1043.493168] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1043.493303] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1043.493303] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1043.493469] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1043.493558] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1043.493604] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('84a5376d-c8c0-4dd2-bea4-f01f11567a72',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1043.517296] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('154b7e30-9d22-43f4-84bb-7d8dd4d7cc9a',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1043.665649] env[65370]: INFO networking_nsxv3.common.synchronization [req-2653edb2-9eb8-4be1-af57-1fc097c81642 req-88200f4f-b14b-445d-bc05-839241c7dc5c tempest-AttachInterfacesUnderV243Test-197944153 tempest-AttachInterfacesUnderV243Test-197944153-project-member] Enqueued Resource ID: 84a5376d-c8c0-4dd2-bea4-f01f11567a72 with Priority: HIGHEST for action security_group_members [ 1043.666232] env[65370]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 84a5376d-c8c0-4dd2-bea4-f01f11567a72 with Priority: HIGHEST for action security_group_members [ 1043.666569] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock member-84a5376d-c8c0-4dd2-bea4-f01f11567a72 taken with stack trace [, , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1043.666752] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-84a5376d-c8c0-4dd2-bea4-f01f11567a72" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1043.683573] env[65370]: INFO networking_nsxv3.common.synchronization [req-2653edb2-9eb8-4be1-af57-1fc097c81642 req-88200f4f-b14b-445d-bc05-839241c7dc5c tempest-AttachInterfacesUnderV243Test-197944153 tempest-AttachInterfacesUnderV243Test-197944153-project-member] Enqueued Resource ID: 84a5376d-c8c0-4dd2-bea4-f01f11567a72 with Priority: HIGHEST for action security_group_rules [ 1043.683764] env[65370]: INFO networking_nsxv3.common.synchronization [req-2653edb2-9eb8-4be1-af57-1fc097c81642 req-88200f4f-b14b-445d-bc05-839241c7dc5c tempest-AttachInterfacesUnderV243Test-197944153 tempest-AttachInterfacesUnderV243Test-197944153-project-member] Enqueued Resource ID: 84a5376d-c8c0-4dd2-bea4-f01f11567a72 with Priority: HIGHEST for action security_group_members [ 1043.683902] env[65370]: INFO networking_nsxv3.common.synchronization [req-2653edb2-9eb8-4be1-af57-1fc097c81642 req-88200f4f-b14b-445d-bc05-839241c7dc5c tempest-AttachInterfacesUnderV243Test-197944153 tempest-AttachInterfacesUnderV243Test-197944153-project-member] Enqueued Resource ID: 5aebefd2-c896-4612-a30a-7f40acda0a45 with Priority: HIGHEST for action port [ 1043.684399] env[65370]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 84a5376d-c8c0-4dd2-bea4-f01f11567a72 with Priority: HIGHEST for action security_group_rules [ 1043.684533] env[65370]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 84a5376d-c8c0-4dd2-bea4-f01f11567a72 with Priority: HIGHEST for action security_group_members [ 1043.684642] env[65370]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5aebefd2-c896-4612-a30a-7f40acda0a45 with Priority: HIGHEST for action port [ 1043.684987] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock rules-84a5376d-c8c0-4dd2-bea4-f01f11567a72 taken with stack trace [, , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1043.685104] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-84a5376d-c8c0-4dd2-bea4-f01f11567a72" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1043.685316] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock member-84a5376d-c8c0-4dd2-bea4-f01f11567a72 taken with stack trace [, , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1043.685540] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-84a5376d-c8c0-4dd2-bea4-f01f11567a72" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1043.685805] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock port-5aebefd2-c896-4612-a30a-7f40acda0a45 taken with stack trace [, , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1043.685920] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-5aebefd2-c896-4612-a30a-7f40acda0a45" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1043.685986] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-5aebefd2-c896-4612-a30a-7f40acda0a45" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1043.686206] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-5aebefd2-c896-4612-a30a-7f40acda0a45" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1043.686278] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5aebefd2-c896-4612-a30a-7f40acda0a45',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1044.000616] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('eba16cc3-e8ee-4772-ba0d-2b7b582b7844',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1044.000616] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('84a5376d-c8c0-4dd2-bea4-f01f11567a72',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1044.020485] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 154b7e30-9d22-43f4-84bb-7d8dd4d7cc9a: rpc.has_security_group_logging(os_id): False [ 1044.045281] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1044.045426] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1044.045563] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1044.045786] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1044.045885] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1044.046125] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1044.046238] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1044.046278] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1044.046437] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1044.046511] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1044.046595] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 154b7e30-9d22-43f4-84bb-7d8dd4d7cc9a is going to be created. [ 1044.123329] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1044.124728] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1044.124728] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1044.124728] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1044.124728] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1044.149261] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 154b7e30-9d22-43f4-84bb-7d8dd4d7cc9a in Status: IN_PROGRESS for 2s [ 1044.188914] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 5aebefd2-c896-4612-a30a-7f40acda0a45 with status ACTIVE [ 1044.189256] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1044.189387] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1044.189455] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1044.189688] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1044.189805] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1044.190139] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1044.190251] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1044.190326] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1044.190553] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1044.190635] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1044.190916] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1044.190999] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1044.191084] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1044.191231] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1044.191310] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1044.191396] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 5aebefd2-c896-4612-a30a-7f40acda0a45 is going to be updated. [ 1044.220162] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1044.220682] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1044.220806] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1044.220972] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1044.221118] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1044.221287] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-5aebefd2-c896-4612-a30a-7f40acda0a45" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1044.502292] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('eba16cc3-e8ee-4772-ba0d-2b7b582b7844',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1044.503274] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('84a5376d-c8c0-4dd2-bea4-f01f11567a72',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1045.005316] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1045.005316] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1045.005441] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1045.005557] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1045.005658] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1045.005769] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: eba16cc3-e8ee-4772-ba0d-2b7b582b7844 is going to be updated. [ 1045.007474] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1045.007674] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1045.007731] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1045.007931] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1045.008978] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1045.008978] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 84a5376d-c8c0-4dd2-bea4-f01f11567a72 is going to be updated. [ 1045.038079] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1045.038079] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1045.038079] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1045.038079] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1045.038079] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1045.039874] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1045.040191] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1045.040362] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1045.040638] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1045.040887] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1045.056189] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 84a5376d-c8c0-4dd2-bea4-f01f11567a72 in Status: IN_PROGRESS for 2s [ 1045.056189] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: eba16cc3-e8ee-4772-ba0d-2b7b582b7844 in Status: IN_PROGRESS for 2s [ 1045.396432] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b7074d70-d8cb-411f-b8c4-a4007dfd74f8 in Status: SUCCESS [ 1045.396672] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b7074d70-d8cb-411f-b8c4-a4007dfd74f8" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1045.396888] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b7074d70-d8cb-411f-b8c4-a4007dfd74f8" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1045.397154] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b7074d70-d8cb-411f-b8c4-a4007dfd74f8" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1045.397382] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1045.397506] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1045.397574] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1045.397820] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1045.397892] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1045.398246] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b7074d70-d8cb-411f-b8c4-a4007dfd74f8" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1045.398364] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('b7074d70-d8cb-411f-b8c4-a4007dfd74f8',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1045.902611] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock member-b7074d70-d8cb-411f-b8c4-a4007dfd74f8 taken with stack trace [, , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1045.902611] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b7074d70-d8cb-411f-b8c4-a4007dfd74f8" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1045.902611] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b7074d70-d8cb-411f-b8c4-a4007dfd74f8" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1045.903650] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b7074d70-d8cb-411f-b8c4-a4007dfd74f8" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1045.904574] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1045.904574] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1045.904574] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1045.904574] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1045.904574] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1045.904574] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b7074d70-d8cb-411f-b8c4-a4007dfd74f8" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1045.904827] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock member-b7074d70-d8cb-411f-b8c4-a4007dfd74f8 taken with stack trace [, , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1045.904827] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b7074d70-d8cb-411f-b8c4-a4007dfd74f8" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1045.904827] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b7074d70-d8cb-411f-b8c4-a4007dfd74f8" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1045.904950] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b7074d70-d8cb-411f-b8c4-a4007dfd74f8" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1045.905063] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1045.905193] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1045.905298] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1045.905436] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1045.905550] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1045.905585] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b7074d70-d8cb-411f-b8c4-a4007dfd74f8" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1045.906619] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('b7074d70-d8cb-411f-b8c4-a4007dfd74f8',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1046.161835] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 154b7e30-9d22-43f4-84bb-7d8dd4d7cc9a in Status: SUCCESS [ 1046.162079] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-154b7e30-9d22-43f4-84bb-7d8dd4d7cc9a" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1046.409350] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for b7074d70-d8cb-411f-b8c4-a4007dfd74f8: rpc.has_security_group_logging(os_id): False [ 1046.437883] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1046.437883] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1046.437883] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1046.437883] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1046.437883] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1046.437883] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1046.437883] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1046.437883] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1046.437883] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1046.437883] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1046.437883] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1046.437883] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1046.437883] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1046.437883] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1046.437883] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1046.438669] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1046.438669] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1046.440103] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1046.440705] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1046.440955] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1046.443075] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: b7074d70-d8cb-411f-b8c4-a4007dfd74f8 is going to be created. [ 1046.539724] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1046.539724] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1046.539724] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1046.539724] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1046.540104] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1046.552312] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b7074d70-d8cb-411f-b8c4-a4007dfd74f8 in Status: IN_PROGRESS for 2s [ 1047.068495] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 84a5376d-c8c0-4dd2-bea4-f01f11567a72 in Status: SUCCESS [ 1047.068894] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-84a5376d-c8c0-4dd2-bea4-f01f11567a72" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1047.068894] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-84a5376d-c8c0-4dd2-bea4-f01f11567a72" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1047.069113] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-84a5376d-c8c0-4dd2-bea4-f01f11567a72" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1047.069315] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1047.069432] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1047.069492] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1047.069802] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1047.069802] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1047.069802] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-84a5376d-c8c0-4dd2-bea4-f01f11567a72" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1047.069933] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('84a5376d-c8c0-4dd2-bea4-f01f11567a72',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1047.071320] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: eba16cc3-e8ee-4772-ba0d-2b7b582b7844 in Status: SUCCESS [ 1047.071494] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-eba16cc3-e8ee-4772-ba0d-2b7b582b7844" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1047.071627] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-84a5376d-c8c0-4dd2-bea4-f01f11567a72" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1047.071801] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-84a5376d-c8c0-4dd2-bea4-f01f11567a72" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1047.071999] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1047.072171] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1047.072218] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1047.072405] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1047.072405] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1047.072523] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('84a5376d-c8c0-4dd2-bea4-f01f11567a72',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1047.574950] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('84a5376d-c8c0-4dd2-bea4-f01f11567a72',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1047.576064] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('84a5376d-c8c0-4dd2-bea4-f01f11567a72',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1047.794032] env[65370]: INFO networking_nsxv3.common.synchronization [None req-636ffca7-e4e7-4669-ba13-a80296fc894a tempest-AttachInterfacesTestJSON-315686657 tempest-AttachInterfacesTestJSON-315686657-project-member] Enqueued Resource ID: 87bbb461-0dea-430b-adcd-ee0e3f4ed609 with Priority: HIGHEST for action security_group_rules [ 1047.794032] env[65370]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 87bbb461-0dea-430b-adcd-ee0e3f4ed609 with Priority: HIGHEST for action security_group_rules [ 1047.794032] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock rules-87bbb461-0dea-430b-adcd-ee0e3f4ed609 taken with stack trace [, , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1047.794032] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-87bbb461-0dea-430b-adcd-ee0e3f4ed609" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1047.794032] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-87bbb461-0dea-430b-adcd-ee0e3f4ed609" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1047.794032] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-87bbb461-0dea-430b-adcd-ee0e3f4ed609" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1047.794032] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('87bbb461-0dea-430b-adcd-ee0e3f4ed609',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1047.925249] env[65370]: INFO networking_nsxv3.common.synchronization [None req-8517a212-a4ec-4898-a0cf-2a1c25c785b7 tempest-AttachInterfacesTestJSON-315686657 tempest-AttachInterfacesTestJSON-315686657-project-member] Enqueued Resource ID: 87bbb461-0dea-430b-adcd-ee0e3f4ed609 with Priority: HIGHEST for action security_group_rules [ 1047.925556] env[65370]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 87bbb461-0dea-430b-adcd-ee0e3f4ed609 with Priority: HIGHEST for action security_group_rules [ 1047.925968] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock rules-87bbb461-0dea-430b-adcd-ee0e3f4ed609 taken with stack trace [, , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1047.929327] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-87bbb461-0dea-430b-adcd-ee0e3f4ed609" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1048.077707] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 84a5376d-c8c0-4dd2-bea4-f01f11567a72: rpc.has_security_group_logging(os_id): False [ 1048.078890] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('84a5376d-c8c0-4dd2-bea4-f01f11567a72',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1048.102340] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1048.102520] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1048.102568] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1048.102885] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1048.138332] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1048.138694] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1048.138855] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1048.138927] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1048.139121] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1048.139240] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1048.139365] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 84a5376d-c8c0-4dd2-bea4-f01f11567a72 is going to be updated. [ 1048.269645] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1048.269931] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1048.270050] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1048.270260] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1048.270466] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1048.290601] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 84a5376d-c8c0-4dd2-bea4-f01f11567a72 in Status: IN_PROGRESS for 2s [ 1048.319907] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1048.319907] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1048.319907] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1048.319907] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1048.320572] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1048.320572] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 87bbb461-0dea-430b-adcd-ee0e3f4ed609 already deleted. [ 1048.320572] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-87bbb461-0dea-430b-adcd-ee0e3f4ed609" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1048.320572] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-87bbb461-0dea-430b-adcd-ee0e3f4ed609" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1048.321068] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-87bbb461-0dea-430b-adcd-ee0e3f4ed609" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1048.321197] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('87bbb461-0dea-430b-adcd-ee0e3f4ed609',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1048.568259] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b7074d70-d8cb-411f-b8c4-a4007dfd74f8 in Status: SUCCESS [ 1048.568595] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-b7074d70-d8cb-411f-b8c4-a4007dfd74f8" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1048.572279] env[65370]: INFO networking_nsxv3.common.synchronization [req-6b92658c-78a8-4021-8eb5-9f16950d6732 req-de3600fe-8377-458b-ac16-c09bd1d5c90a tempest-AttachInterfacesUnderV243Test-197944153 tempest-AttachInterfacesUnderV243Test-197944153-project-member] Enqueued Resource ID: 84a5376d-c8c0-4dd2-bea4-f01f11567a72 with Priority: HIGHEST for action security_group_members [ 1048.575085] env[65370]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 84a5376d-c8c0-4dd2-bea4-f01f11567a72 with Priority: HIGHEST for action security_group_members [ 1048.575085] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock member-84a5376d-c8c0-4dd2-bea4-f01f11567a72 taken with stack trace [, , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1048.575085] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-84a5376d-c8c0-4dd2-bea4-f01f11567a72" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1048.582049] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1048.582189] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1048.582236] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1048.582437] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1048.582521] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1048.582618] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 84a5376d-c8c0-4dd2-bea4-f01f11567a72 is going to be updated. [ 1048.616601] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1048.616810] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1048.616810] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1048.617028] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1048.617183] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1048.626797] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 84a5376d-c8c0-4dd2-bea4-f01f11567a72 in Status: IN_PROGRESS for 2s [ 1048.846339] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1048.846339] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1048.846339] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1048.846339] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1048.846339] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1048.846339] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 87bbb461-0dea-430b-adcd-ee0e3f4ed609 already deleted. [ 1048.846339] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-87bbb461-0dea-430b-adcd-ee0e3f4ed609" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1049.754788] env[65370]: INFO networking_nsxv3.common.synchronization [req-a010f215-4f55-4963-83ff-b09a78394d86 req-d3861867-feb0-4246-8fba-3049c72bcd3d tempest-AttachVolumeNegativeTest-719365731 tempest-AttachVolumeNegativeTest-719365731-project-member] Enqueued Resource ID: ff03ba53-594b-4bc2-b51c-5c04df76011d with Priority: HIGHEST for action security_group_members [ 1049.755528] env[65370]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ff03ba53-594b-4bc2-b51c-5c04df76011d with Priority: HIGHEST for action security_group_members [ 1049.755896] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock member-ff03ba53-594b-4bc2-b51c-5c04df76011d taken with stack trace [, , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1049.756061] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ff03ba53-594b-4bc2-b51c-5c04df76011d" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1049.756138] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ff03ba53-594b-4bc2-b51c-5c04df76011d" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1049.756369] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ff03ba53-594b-4bc2-b51c-5c04df76011d" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1049.756526] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1049.756618] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1049.756685] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1049.756827] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1049.756913] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1049.757014] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ff03ba53-594b-4bc2-b51c-5c04df76011d',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1050.237670] env[65370]: DEBUG networking_nsxv3.common.locking [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Lock network-600 taken with stack trace [, , , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1050.237989] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquiring lock "network-600" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1050.238190] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquired lock "network-600" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1050.238413] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquired external semaphore "network-600" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1050.238680] env[65370]: DEBUG networking_nsxv3.common.locking [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1050.238892] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquiring lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1050.238980] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquired lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1050.239359] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquired external semaphore "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1050.239506] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Releasing lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1050.239733] env[65370]: DEBUG dogpile.cache.region [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] No value present for key: 'zone-id' {{(pid=65370) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1050.239845] env[65370]: DEBUG dogpile.lock [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] NeedRegenerationException {{(pid=65370) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1050.239945] env[65370]: DEBUG dogpile.lock [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] no value, waiting for create lock {{(pid=65370) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1050.240061] env[65370]: DEBUG dogpile.lock [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] value creation lock acquired {{(pid=65370) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1050.240622] env[65370]: DEBUG dogpile.cache.region [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] No value present for key: 'zone-id' {{(pid=65370) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1050.240753] env[65370]: DEBUG dogpile.lock [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Calling creation function for not-yet-present value {{(pid=65370) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1050.240892] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1050.259770] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1050.260461] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1050.260610] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1050.261360] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1050.261560] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1050.262678] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1050.262889] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1050.262968] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1050.263207] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1050.263276] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1050.263335] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ff03ba53-594b-4bc2-b51c-5c04df76011d already deleted. [ 1050.263450] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ff03ba53-594b-4bc2-b51c-5c04df76011d" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1050.265489] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1050.265722] env[65370]: DEBUG dogpile.cache.region [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Cache value generated in 0.025 seconds for key(s): 'zone-id' {{(pid=65370) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1050.265851] env[65370]: DEBUG dogpile.lock [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Released creation lock {{(pid=65370) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1050.266255] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Releasing lock "network-600" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1050.266377] env[65370]: DEBUG networking_nsxv3.common.locking [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Lock port-60352610-89c9-4e43-b5cb-835e700a7a47 taken with stack trace [, , , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1050.266552] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquiring lock "port-60352610-89c9-4e43-b5cb-835e700a7a47" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1050.266701] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquired lock "port-60352610-89c9-4e43-b5cb-835e700a7a47" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1050.267066] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquired external semaphore "port-60352610-89c9-4e43-b5cb-835e700a7a47" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1050.267205] env[65370]: DEBUG networking_nsxv3.api.rpc [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('60352610-89c9-4e43-b5cb-835e700a7a47',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1050.310289] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 84a5376d-c8c0-4dd2-bea4-f01f11567a72 in Status: SUCCESS [ 1050.310289] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-84a5376d-c8c0-4dd2-bea4-f01f11567a72" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1050.310289] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-84a5376d-c8c0-4dd2-bea4-f01f11567a72" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1050.310289] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-84a5376d-c8c0-4dd2-bea4-f01f11567a72" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1050.310289] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('84a5376d-c8c0-4dd2-bea4-f01f11567a72',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1050.641309] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 84a5376d-c8c0-4dd2-bea4-f01f11567a72 in Status: SUCCESS [ 1050.641663] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-84a5376d-c8c0-4dd2-bea4-f01f11567a72" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1050.641807] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-84a5376d-c8c0-4dd2-bea4-f01f11567a72" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1050.642056] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-84a5376d-c8c0-4dd2-bea4-f01f11567a72" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1050.642260] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1050.642402] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1050.642478] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1050.642635] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1050.642718] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1050.642823] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('84a5376d-c8c0-4dd2-bea4-f01f11567a72',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1050.770882] env[65370]: DEBUG networking_nsxv3.common.locking [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1050.771459] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquiring lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1050.771459] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquired lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1050.771699] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquired external semaphore "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1050.771905] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Releasing lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1050.772121] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Segment Port 60352610-89c9-4e43-b5cb-835e700a7a47 not found, creating... [ 1050.772439] env[65370]: DEBUG networking_nsxv3.common.locking [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1050.772624] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquiring lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1050.772744] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquired lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1050.773043] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquired external semaphore "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1050.773283] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Releasing lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1050.773619] env[65370]: DEBUG networking_nsxv3.common.locking [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1050.773827] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquiring lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1050.773987] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquired lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1050.774296] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquired external semaphore "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1050.774461] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Releasing lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1050.774610] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Resource: SegmentPort with ID: 60352610-89c9-4e43-b5cb-835e700a7a47 is going to be created. [ 1050.798607] env[65370]: DEBUG networking_nsxv3.common.locking [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1050.798973] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquiring lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1050.799118] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquired lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1050.799509] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquired external semaphore "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1050.799908] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Releasing lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1050.800333] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Releasing lock "port-60352610-89c9-4e43-b5cb-835e700a7a47" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1050.838204] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1050.838610] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1050.838610] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1050.838843] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1050.838843] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1050.838994] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 84a5376d-c8c0-4dd2-bea4-f01f11567a72 is going to be deleted. [ 1050.922499] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1050.922499] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1050.922499] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1050.922499] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1050.922499] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1050.922499] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-84a5376d-c8c0-4dd2-bea4-f01f11567a72" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1051.109736] env[65370]: INFO networking_nsxv3.common.synchronization [req-cb0b7f72-7548-4f42-9842-c92286811768 req-d231c66c-515d-4c59-8084-a6b9a1e8152a tempest-ServerRescueNegativeTestJSON-807527939 tempest-ServerRescueNegativeTestJSON-807527939-project-member] Enqueued Resource ID: 237e1a89-daff-4fd5-b02a-97e1d536d9bd with Priority: HIGHEST for action security_group_members [ 1051.110365] env[65370]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 237e1a89-daff-4fd5-b02a-97e1d536d9bd with Priority: HIGHEST for action security_group_members [ 1051.110720] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock member-237e1a89-daff-4fd5-b02a-97e1d536d9bd taken with stack trace [, , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1051.110893] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-237e1a89-daff-4fd5-b02a-97e1d536d9bd" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1051.110984] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-237e1a89-daff-4fd5-b02a-97e1d536d9bd" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1051.111231] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-237e1a89-daff-4fd5-b02a-97e1d536d9bd" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1051.111389] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1051.111491] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1051.111554] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1051.111703] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1051.111789] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1051.111880] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('237e1a89-daff-4fd5-b02a-97e1d536d9bd',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1051.147295] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1051.147295] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1051.147295] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1051.147295] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1051.147295] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1051.147295] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1051.147295] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1051.147295] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1051.147295] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1051.147295] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1051.147295] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 84a5376d-c8c0-4dd2-bea4-f01f11567a72 is going to be deleted. [ 1051.182061] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1051.182061] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1051.182061] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1051.182061] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1051.182061] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1051.182451] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-84a5376d-c8c0-4dd2-bea4-f01f11567a72" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1051.182451] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-84a5376d-c8c0-4dd2-bea4-f01f11567a72" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1051.182702] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-84a5376d-c8c0-4dd2-bea4-f01f11567a72" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1051.183765] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1051.183932] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1051.184052] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1051.184372] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1051.184457] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1051.184526] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('84a5376d-c8c0-4dd2-bea4-f01f11567a72',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1051.568202] env[65370]: INFO networking_nsxv3.common.synchronization [req-a010f215-4f55-4963-83ff-b09a78394d86 req-63b208ab-d5e0-40b2-a298-9a8a6bf66657 service nova] Enqueued Resource ID: ff03ba53-594b-4bc2-b51c-5c04df76011d with Priority: HIGHEST for action security_group_rules [ 1051.568378] env[65370]: INFO networking_nsxv3.common.synchronization [req-a010f215-4f55-4963-83ff-b09a78394d86 req-63b208ab-d5e0-40b2-a298-9a8a6bf66657 service nova] Enqueued Resource ID: ff03ba53-594b-4bc2-b51c-5c04df76011d with Priority: HIGHEST for action security_group_members [ 1051.568511] env[65370]: INFO networking_nsxv3.common.synchronization [req-a010f215-4f55-4963-83ff-b09a78394d86 req-63b208ab-d5e0-40b2-a298-9a8a6bf66657 service nova] Enqueued Resource ID: 60352610-89c9-4e43-b5cb-835e700a7a47 with Priority: HIGHEST for action port [ 1051.569209] env[65370]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ff03ba53-594b-4bc2-b51c-5c04df76011d with Priority: HIGHEST for action security_group_rules [ 1051.569411] env[65370]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ff03ba53-594b-4bc2-b51c-5c04df76011d with Priority: HIGHEST for action security_group_members [ 1051.569572] env[65370]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 60352610-89c9-4e43-b5cb-835e700a7a47 with Priority: HIGHEST for action port [ 1051.570035] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock rules-ff03ba53-594b-4bc2-b51c-5c04df76011d taken with stack trace [, , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1051.570196] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-ff03ba53-594b-4bc2-b51c-5c04df76011d" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1051.570307] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-ff03ba53-594b-4bc2-b51c-5c04df76011d" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1051.570568] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-ff03ba53-594b-4bc2-b51c-5c04df76011d" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1051.570645] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('ff03ba53-594b-4bc2-b51c-5c04df76011d',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1051.573379] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock member-ff03ba53-594b-4bc2-b51c-5c04df76011d taken with stack trace [, , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1051.573379] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ff03ba53-594b-4bc2-b51c-5c04df76011d" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1051.573673] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ff03ba53-594b-4bc2-b51c-5c04df76011d" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1051.573708] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ff03ba53-594b-4bc2-b51c-5c04df76011d" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1051.574284] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1051.574284] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1051.574284] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1051.574284] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1051.574284] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1051.575350] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ff03ba53-594b-4bc2-b51c-5c04df76011d',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1051.576254] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock port-60352610-89c9-4e43-b5cb-835e700a7a47 taken with stack trace [, , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1051.576334] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-60352610-89c9-4e43-b5cb-835e700a7a47" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1051.576379] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-60352610-89c9-4e43-b5cb-835e700a7a47" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1051.576529] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-60352610-89c9-4e43-b5cb-835e700a7a47" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1051.576589] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('60352610-89c9-4e43-b5cb-835e700a7a47',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1051.614633] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('237e1a89-daff-4fd5-b02a-97e1d536d9bd',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1051.687971] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1051.688205] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1051.688250] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1051.688517] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1051.688652] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1051.689071] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1051.689071] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1051.689071] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1051.689273] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1051.689352] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1051.689451] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 84a5376d-c8c0-4dd2-bea4-f01f11567a72 already deleted. [ 1051.689535] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-84a5376d-c8c0-4dd2-bea4-f01f11567a72" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1052.078014] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock member-ff03ba53-594b-4bc2-b51c-5c04df76011d taken with stack trace [, , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1052.078388] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ff03ba53-594b-4bc2-b51c-5c04df76011d" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1052.080546] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('ff03ba53-594b-4bc2-b51c-5c04df76011d',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1052.081460] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 60352610-89c9-4e43-b5cb-835e700a7a47 with status ACTIVE [ 1052.081889] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1052.081889] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1052.081889] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1052.082098] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1052.082138] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1052.082852] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1052.082852] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1052.082852] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1052.082852] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1052.082852] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1052.085782] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1052.085782] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1052.085782] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1052.085782] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1052.085782] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1052.085782] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 60352610-89c9-4e43-b5cb-835e700a7a47 is going to be updated. [ 1052.108959] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1052.109142] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1052.109227] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1052.109439] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1052.110083] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1052.110228] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-60352610-89c9-4e43-b5cb-835e700a7a47" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1052.116628] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('237e1a89-daff-4fd5-b02a-97e1d536d9bd',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1052.586911] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('ff03ba53-594b-4bc2-b51c-5c04df76011d',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1052.619339] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1052.619508] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1052.619574] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1052.619757] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1052.619851] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1052.619959] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 237e1a89-daff-4fd5-b02a-97e1d536d9bd is going to be updated. [ 1052.649663] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1052.650312] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1052.650399] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1052.650941] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1052.651140] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1052.660650] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 237e1a89-daff-4fd5-b02a-97e1d536d9bd in Status: IN_PROGRESS for 2s [ 1053.094182] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1053.094502] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1053.094502] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1053.094969] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1053.095094] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1053.095252] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ff03ba53-594b-4bc2-b51c-5c04df76011d is going to be created. [ 1053.124486] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1053.124635] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1053.124708] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1053.124921] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1053.125104] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1053.139423] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ff03ba53-594b-4bc2-b51c-5c04df76011d in Status: UNINITIALIZED for 2s [ 1053.222032] env[65370]: INFO networking_nsxv3.common.synchronization [req-62638f60-fb3d-48a4-bd4b-1947baa96c7d req-59845f8f-29c1-4a91-a149-4fa10690261a tempest-ServerGroupTestJSON-242180378 tempest-ServerGroupTestJSON-242180378-project-member] Enqueued Resource ID: 5dd6e6d4-a4c3-43e1-a153-05b659cf62c9 with Priority: HIGHEST for action security_group_members [ 1053.223853] env[65370]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5dd6e6d4-a4c3-43e1-a153-05b659cf62c9 with Priority: HIGHEST for action security_group_members [ 1053.224967] env[65370]: INFO networking_nsxv3.common.synchronization [req-55215a57-3d26-412e-b139-e41487a5df32 req-3419e1d7-7114-4af2-b240-107b951dd411 tempest-ServerActionsTestOtherA-1239332614 tempest-ServerActionsTestOtherA-1239332614-project-member] Enqueued Resource ID: b7074d70-d8cb-411f-b8c4-a4007dfd74f8 with Priority: HIGHEST for action security_group_members [ 1053.225488] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock member-5dd6e6d4-a4c3-43e1-a153-05b659cf62c9 taken with stack trace [, , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1053.225699] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5dd6e6d4-a4c3-43e1-a153-05b659cf62c9" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1053.225824] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5dd6e6d4-a4c3-43e1-a153-05b659cf62c9" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1053.226208] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5dd6e6d4-a4c3-43e1-a153-05b659cf62c9" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1053.226460] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1053.226641] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1053.226752] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1053.227013] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1053.227184] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1053.227357] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5dd6e6d4-a4c3-43e1-a153-05b659cf62c9',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1053.229350] env[65370]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b7074d70-d8cb-411f-b8c4-a4007dfd74f8 with Priority: HIGHEST for action security_group_members [ 1053.229980] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock member-b7074d70-d8cb-411f-b8c4-a4007dfd74f8 taken with stack trace [, , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1053.230174] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b7074d70-d8cb-411f-b8c4-a4007dfd74f8" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1053.230292] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b7074d70-d8cb-411f-b8c4-a4007dfd74f8" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1053.230562] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b7074d70-d8cb-411f-b8c4-a4007dfd74f8" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1053.230808] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1053.230977] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1053.231103] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1053.231334] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1053.231620] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1053.231620] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b7074d70-d8cb-411f-b8c4-a4007dfd74f8',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1053.299185] env[65370]: INFO networking_nsxv3.common.synchronization [req-55215a57-3d26-412e-b139-e41487a5df32 req-3419e1d7-7114-4af2-b240-107b951dd411 tempest-ServerActionsTestOtherA-1239332614 tempest-ServerActionsTestOtherA-1239332614-project-member] Enqueued Resource ID: 5baa400f-e6fb-4dc5-bea4-2b09cdc4c10d with Priority: HIGHEST for action port [ 1053.300444] env[65370]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5baa400f-e6fb-4dc5-bea4-2b09cdc4c10d with Priority: HIGHEST for action port [ 1053.300444] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock port-5baa400f-e6fb-4dc5-bea4-2b09cdc4c10d taken with stack trace [, , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1053.300444] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-5baa400f-e6fb-4dc5-bea4-2b09cdc4c10d" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1053.300780] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-5baa400f-e6fb-4dc5-bea4-2b09cdc4c10d" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1053.300780] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-5baa400f-e6fb-4dc5-bea4-2b09cdc4c10d" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1053.300851] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5baa400f-e6fb-4dc5-bea4-2b09cdc4c10d',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1053.585962] env[65370]: DEBUG networking_nsxv3.common.locking [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Lock network-372 taken with stack trace [, , , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1053.586224] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquiring lock "network-372" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1053.586311] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquired lock "network-372" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1053.586607] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquired external semaphore "network-372" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1053.586853] env[65370]: DEBUG networking_nsxv3.common.locking [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1053.587154] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquiring lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1053.587235] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquired lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1053.587492] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquired external semaphore "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1053.587716] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Releasing lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1053.589115] env[65370]: DEBUG dogpile.cache.region [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] No value present for key: 'zone-id' {{(pid=65370) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1053.589115] env[65370]: DEBUG dogpile.lock [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] NeedRegenerationException {{(pid=65370) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1053.589115] env[65370]: DEBUG dogpile.lock [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] no value, waiting for create lock {{(pid=65370) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1053.589115] env[65370]: DEBUG dogpile.lock [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] value creation lock acquired {{(pid=65370) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1053.589115] env[65370]: DEBUG dogpile.cache.region [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] No value present for key: 'zone-id' {{(pid=65370) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1053.589115] env[65370]: DEBUG dogpile.lock [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Calling creation function for not-yet-present value {{(pid=65370) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1053.589518] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1053.609150] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1053.609268] env[65370]: DEBUG dogpile.cache.region [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=65370) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1053.609363] env[65370]: DEBUG dogpile.lock [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Released creation lock {{(pid=65370) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1053.609571] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Releasing lock "network-372" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1053.609905] env[65370]: DEBUG networking_nsxv3.common.locking [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Lock port-31614e30-ac57-45fb-9e1b-0a13b15098a3 taken with stack trace [, , , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1053.610579] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquiring lock "port-31614e30-ac57-45fb-9e1b-0a13b15098a3" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1053.610579] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquired lock "port-31614e30-ac57-45fb-9e1b-0a13b15098a3" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1053.610579] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquired external semaphore "port-31614e30-ac57-45fb-9e1b-0a13b15098a3" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1053.610752] env[65370]: DEBUG networking_nsxv3.api.rpc [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('31614e30-ac57-45fb-9e1b-0a13b15098a3',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1053.730845] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1053.731031] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1053.731108] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1053.731372] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1053.731445] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1053.731610] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1053.731710] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1053.731767] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1053.731905] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1053.732032] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1053.732085] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5dd6e6d4-a4c3-43e1-a153-05b659cf62c9 already deleted. [ 1053.732167] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5dd6e6d4-a4c3-43e1-a153-05b659cf62c9" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1053.733576] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1053.733678] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1053.733741] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1053.733891] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1053.733967] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1053.734143] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1053.734234] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1053.734321] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1053.734421] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1053.734492] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1053.734572] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b7074d70-d8cb-411f-b8c4-a4007dfd74f8 is going to be updated. [ 1053.767478] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1053.767725] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1053.767725] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1053.768117] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1053.768280] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1053.783340] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b7074d70-d8cb-411f-b8c4-a4007dfd74f8 in Status: IN_PROGRESS for 2s [ 1053.803829] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 5baa400f-e6fb-4dc5-bea4-2b09cdc4c10d with status ACTIVE [ 1053.804069] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1053.804212] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1053.804282] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1053.804501] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1053.804593] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1053.804868] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1053.805083] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1053.805159] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1053.805337] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1053.805419] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1053.805622] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1053.805774] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1053.805858] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1053.806037] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1053.806118] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1053.806209] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 5baa400f-e6fb-4dc5-bea4-2b09cdc4c10d is going to be updated. [ 1053.847912] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1053.848082] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1053.848144] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1053.848353] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1053.848486] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1053.848644] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-5baa400f-e6fb-4dc5-bea4-2b09cdc4c10d" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1054.113515] env[65370]: DEBUG networking_nsxv3.common.locking [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1054.114052] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquiring lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1054.114052] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquired lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1054.114240] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquired external semaphore "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1054.114313] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Releasing lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1054.114459] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Segment Port 31614e30-ac57-45fb-9e1b-0a13b15098a3 not found, creating... [ 1054.114718] env[65370]: DEBUG networking_nsxv3.common.locking [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1054.114875] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquiring lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1054.114992] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquired lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1054.115232] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquired external semaphore "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1054.115370] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Releasing lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1054.115646] env[65370]: DEBUG networking_nsxv3.common.locking [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1054.115832] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquiring lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1054.115942] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquired lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1054.116195] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquired external semaphore "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1054.116376] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Releasing lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1054.116532] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Resource: SegmentPort with ID: 31614e30-ac57-45fb-9e1b-0a13b15098a3 is going to be created. [ 1054.144231] env[65370]: DEBUG networking_nsxv3.common.locking [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1054.144480] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquiring lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1054.144628] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquired lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1054.144886] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquired external semaphore "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1054.145149] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Releasing lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1054.145435] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Releasing lock "port-31614e30-ac57-45fb-9e1b-0a13b15098a3" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1054.672511] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 237e1a89-daff-4fd5-b02a-97e1d536d9bd in Status: SUCCESS [ 1054.672775] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-237e1a89-daff-4fd5-b02a-97e1d536d9bd" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1054.927612] env[65370]: INFO networking_nsxv3.common.synchronization [req-62638f60-fb3d-48a4-bd4b-1947baa96c7d req-6516862f-f694-4988-8b6d-1531a4389aab service nova] Enqueued Resource ID: 5dd6e6d4-a4c3-43e1-a153-05b659cf62c9 with Priority: HIGHEST for action security_group_rules [ 1054.927612] env[65370]: INFO networking_nsxv3.common.synchronization [req-62638f60-fb3d-48a4-bd4b-1947baa96c7d req-6516862f-f694-4988-8b6d-1531a4389aab service nova] Enqueued Resource ID: 5dd6e6d4-a4c3-43e1-a153-05b659cf62c9 with Priority: HIGHEST for action security_group_members [ 1054.927612] env[65370]: INFO networking_nsxv3.common.synchronization [req-62638f60-fb3d-48a4-bd4b-1947baa96c7d req-6516862f-f694-4988-8b6d-1531a4389aab service nova] Enqueued Resource ID: 31614e30-ac57-45fb-9e1b-0a13b15098a3 with Priority: HIGHEST for action port [ 1054.927612] env[65370]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5dd6e6d4-a4c3-43e1-a153-05b659cf62c9 with Priority: HIGHEST for action security_group_rules [ 1054.927612] env[65370]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5dd6e6d4-a4c3-43e1-a153-05b659cf62c9 with Priority: HIGHEST for action security_group_members [ 1054.931424] env[65370]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 31614e30-ac57-45fb-9e1b-0a13b15098a3 with Priority: HIGHEST for action port [ 1054.933066] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock rules-5dd6e6d4-a4c3-43e1-a153-05b659cf62c9 taken with stack trace [, , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1054.933066] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-5dd6e6d4-a4c3-43e1-a153-05b659cf62c9" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1054.933066] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-5dd6e6d4-a4c3-43e1-a153-05b659cf62c9" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1054.933066] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-5dd6e6d4-a4c3-43e1-a153-05b659cf62c9" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1054.933066] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('5dd6e6d4-a4c3-43e1-a153-05b659cf62c9',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1054.937034] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock member-5dd6e6d4-a4c3-43e1-a153-05b659cf62c9 taken with stack trace [, , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1054.937034] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5dd6e6d4-a4c3-43e1-a153-05b659cf62c9" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1054.937034] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5dd6e6d4-a4c3-43e1-a153-05b659cf62c9" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1054.937034] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5dd6e6d4-a4c3-43e1-a153-05b659cf62c9" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1054.937034] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1054.937034] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1054.937034] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1054.937034] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1054.937034] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1054.937034] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5dd6e6d4-a4c3-43e1-a153-05b659cf62c9',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1054.938138] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock port-31614e30-ac57-45fb-9e1b-0a13b15098a3 taken with stack trace [, , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1054.938314] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-31614e30-ac57-45fb-9e1b-0a13b15098a3" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1054.938419] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-31614e30-ac57-45fb-9e1b-0a13b15098a3" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1054.938639] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-31614e30-ac57-45fb-9e1b-0a13b15098a3" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1054.942028] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('31614e30-ac57-45fb-9e1b-0a13b15098a3',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1055.150656] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ff03ba53-594b-4bc2-b51c-5c04df76011d in Status: SUCCESS [ 1055.150981] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ff03ba53-594b-4bc2-b51c-5c04df76011d" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1055.151519] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ff03ba53-594b-4bc2-b51c-5c04df76011d" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1055.151789] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ff03ba53-594b-4bc2-b51c-5c04df76011d" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1055.152029] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1055.152180] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1055.152279] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1055.152468] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1055.153318] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1055.153436] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ff03ba53-594b-4bc2-b51c-5c04df76011d" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1055.153536] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('ff03ba53-594b-4bc2-b51c-5c04df76011d',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1055.377176] env[65370]: INFO networking_nsxv3.common.synchronization [req-a4cfd5ec-8ffe-4351-bf23-29a33bc8ee14 req-ffa5a518-9465-4922-b858-e8b37fe48fac tempest-DeleteServersTestJSON-1160924027 tempest-DeleteServersTestJSON-1160924027-project-member] Enqueued Resource ID: 1eaa763e-4469-4428-92d0-ba20a6c99edc with Priority: HIGHEST for action security_group_members [ 1055.377732] env[65370]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1eaa763e-4469-4428-92d0-ba20a6c99edc with Priority: HIGHEST for action security_group_members [ 1055.378228] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock member-1eaa763e-4469-4428-92d0-ba20a6c99edc taken with stack trace [, , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1055.378414] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1eaa763e-4469-4428-92d0-ba20a6c99edc" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1055.378527] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1eaa763e-4469-4428-92d0-ba20a6c99edc" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1055.378841] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1eaa763e-4469-4428-92d0-ba20a6c99edc" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1055.379145] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1055.379258] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1055.379449] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1055.379653] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1055.379764] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1055.379924] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1eaa763e-4469-4428-92d0-ba20a6c99edc',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1055.442621] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock member-5dd6e6d4-a4c3-43e1-a153-05b659cf62c9 taken with stack trace [, , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1055.442621] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5dd6e6d4-a4c3-43e1-a153-05b659cf62c9" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1055.442621] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('5dd6e6d4-a4c3-43e1-a153-05b659cf62c9',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1055.443728] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 31614e30-ac57-45fb-9e1b-0a13b15098a3 with status ACTIVE [ 1055.443983] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1055.444143] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1055.444232] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1055.448033] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1055.448033] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1055.448033] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1055.448033] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1055.448033] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1055.448033] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1055.448033] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1055.448033] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1055.448033] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1055.448033] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1055.448033] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1055.448033] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1055.448033] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 31614e30-ac57-45fb-9e1b-0a13b15098a3 is going to be updated. [ 1055.476223] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1055.476386] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1055.476526] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1055.476742] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1055.476890] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1055.477073] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-31614e30-ac57-45fb-9e1b-0a13b15098a3" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1055.657272] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('ff03ba53-594b-4bc2-b51c-5c04df76011d',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1055.794060] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b7074d70-d8cb-411f-b8c4-a4007dfd74f8 in Status: SUCCESS [ 1055.794261] env[65370]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b7074d70-d8cb-411f-b8c4-a4007dfd74f8 deletion is rescheduled due to dependency. [ 1055.794378] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b7074d70-d8cb-411f-b8c4-a4007dfd74f8" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1055.882668] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1055.883059] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1055.883059] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1055.883170] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1055.905867] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1055.906144] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1055.906270] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1055.906331] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1055.906551] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1055.906621] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1055.906715] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1eaa763e-4469-4428-92d0-ba20a6c99edc is going to be updated. [ 1055.944693] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1055.944864] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1055.944955] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1055.945304] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1055.945462] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1055.949828] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('5dd6e6d4-a4c3-43e1-a153-05b659cf62c9',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1055.956672] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1eaa763e-4469-4428-92d0-ba20a6c99edc in Status: IN_PROGRESS for 2s [ 1056.160127] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for ff03ba53-594b-4bc2-b51c-5c04df76011d: rpc.has_security_group_logging(os_id): False [ 1056.186031] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1056.186031] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1056.186031] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1056.186031] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1056.186031] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1056.186031] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1056.186031] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1056.186031] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1056.186031] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1056.186031] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1056.186031] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: ff03ba53-594b-4bc2-b51c-5c04df76011d is going to be created. [ 1056.272760] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1056.273057] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1056.273057] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1056.273301] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1056.274218] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1056.287956] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ff03ba53-594b-4bc2-b51c-5c04df76011d in Status: IN_PROGRESS for 2s [ 1056.452516] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1056.453410] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1056.455651] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1056.455651] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1056.455651] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1056.455651] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5dd6e6d4-a4c3-43e1-a153-05b659cf62c9 is going to be created. [ 1056.483997] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1056.486024] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1056.486024] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1056.486024] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1056.486024] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1056.505108] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5dd6e6d4-a4c3-43e1-a153-05b659cf62c9 in Status: UNINITIALIZED for 2s [ 1057.471794] env[65370]: INFO networking_nsxv3.common.synchronization [req-37473cb2-fe58-4d26-9dda-86ea8e555366 req-08953073-3acf-4f08-b1ab-9df180bb63d3 tempest-ListServerFiltersTestJSON-1679580052 tempest-ListServerFiltersTestJSON-1679580052-project-member] Enqueued Resource ID: 9496f4d5-71fb-471e-bab0-2220819ba7ed with Priority: HIGHEST for action security_group_members [ 1057.472361] env[65370]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9496f4d5-71fb-471e-bab0-2220819ba7ed with Priority: HIGHEST for action security_group_members [ 1057.472696] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock member-9496f4d5-71fb-471e-bab0-2220819ba7ed taken with stack trace [, , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1057.472832] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9496f4d5-71fb-471e-bab0-2220819ba7ed" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1057.472832] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9496f4d5-71fb-471e-bab0-2220819ba7ed" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1057.473101] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9496f4d5-71fb-471e-bab0-2220819ba7ed" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1057.473172] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1057.473410] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1057.473410] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1057.473538] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1057.473674] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1057.473754] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9496f4d5-71fb-471e-bab0-2220819ba7ed',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1057.480742] env[65370]: INFO networking_nsxv3.common.synchronization [req-a38e463f-6f15-431f-9814-e46cfb89711e req-dd95ffaf-743f-4a3b-8b39-3ac3f44b2d03 tempest-ServerActionsV293TestJSON-2044734182 tempest-ServerActionsV293TestJSON-2044734182-project-member] Enqueued Resource ID: 5b5e0c25-5d4e-4e13-9670-be19b4122c73 with Priority: HIGHEST for action security_group_members [ 1057.480977] env[65370]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5b5e0c25-5d4e-4e13-9670-be19b4122c73 with Priority: HIGHEST for action security_group_members [ 1057.481490] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock member-5b5e0c25-5d4e-4e13-9670-be19b4122c73 taken with stack trace [, , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1057.481619] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5b5e0c25-5d4e-4e13-9670-be19b4122c73" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1057.481684] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5b5e0c25-5d4e-4e13-9670-be19b4122c73" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1057.481852] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5b5e0c25-5d4e-4e13-9670-be19b4122c73" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1057.481996] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1057.482105] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1057.482166] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1057.482307] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1057.482387] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1057.482472] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5b5e0c25-5d4e-4e13-9670-be19b4122c73',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1057.966681] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1eaa763e-4469-4428-92d0-ba20a6c99edc in Status: SUCCESS [ 1057.966847] env[65370]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1eaa763e-4469-4428-92d0-ba20a6c99edc deletion is rescheduled due to dependency. [ 1057.966943] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1eaa763e-4469-4428-92d0-ba20a6c99edc" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1057.975506] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('9496f4d5-71fb-471e-bab0-2220819ba7ed',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1057.985641] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1057.985823] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1057.985897] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1057.986141] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1058.008561] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1058.008960] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1058.009323] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1058.009407] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1058.009695] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1058.009778] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1058.009895] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5b5e0c25-5d4e-4e13-9670-be19b4122c73 is going to be updated. [ 1058.044090] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1058.044090] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1058.044090] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1058.044090] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1058.044090] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1058.056636] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5b5e0c25-5d4e-4e13-9670-be19b4122c73 in Status: IN_PROGRESS for 2s [ 1058.303424] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ff03ba53-594b-4bc2-b51c-5c04df76011d in Status: SUCCESS [ 1058.303595] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-ff03ba53-594b-4bc2-b51c-5c04df76011d" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1058.479654] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('9496f4d5-71fb-471e-bab0-2220819ba7ed',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1058.517114] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5dd6e6d4-a4c3-43e1-a153-05b659cf62c9 in Status: SUCCESS [ 1058.517114] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5dd6e6d4-a4c3-43e1-a153-05b659cf62c9" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1058.517322] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5dd6e6d4-a4c3-43e1-a153-05b659cf62c9" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1058.517420] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5dd6e6d4-a4c3-43e1-a153-05b659cf62c9" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1058.518271] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1058.518419] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1058.518486] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1058.518664] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1058.518748] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1058.519092] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5dd6e6d4-a4c3-43e1-a153-05b659cf62c9" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1058.519224] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('5dd6e6d4-a4c3-43e1-a153-05b659cf62c9',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1058.984053] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1058.984365] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1058.984365] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1058.984511] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1058.984594] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1058.985697] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9496f4d5-71fb-471e-bab0-2220819ba7ed is going to be updated. [ 1059.021252] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1059.021389] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1059.021477] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1059.021698] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1059.023190] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1059.024395] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock member-5dd6e6d4-a4c3-43e1-a153-05b659cf62c9 taken with stack trace [, , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1059.024515] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5dd6e6d4-a4c3-43e1-a153-05b659cf62c9" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1059.024601] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5dd6e6d4-a4c3-43e1-a153-05b659cf62c9" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1059.024792] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5dd6e6d4-a4c3-43e1-a153-05b659cf62c9" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1059.025229] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1059.025229] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1059.025229] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1059.025417] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1059.025417] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1059.025501] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5dd6e6d4-a4c3-43e1-a153-05b659cf62c9" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1059.027050] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock member-5dd6e6d4-a4c3-43e1-a153-05b659cf62c9 taken with stack trace [, , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1059.027050] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5dd6e6d4-a4c3-43e1-a153-05b659cf62c9" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1059.027050] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5dd6e6d4-a4c3-43e1-a153-05b659cf62c9" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1059.027050] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5dd6e6d4-a4c3-43e1-a153-05b659cf62c9" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1059.027050] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1059.027050] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1059.027050] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1059.027050] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1059.027050] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1059.027050] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5dd6e6d4-a4c3-43e1-a153-05b659cf62c9" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1059.027050] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('5dd6e6d4-a4c3-43e1-a153-05b659cf62c9',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1059.039587] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9496f4d5-71fb-471e-bab0-2220819ba7ed in Status: IN_PROGRESS for 2s [ 1059.530656] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 5dd6e6d4-a4c3-43e1-a153-05b659cf62c9: rpc.has_security_group_logging(os_id): False [ 1059.557242] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1059.557327] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1059.557386] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1059.557635] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1059.557718] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1059.557956] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1059.558103] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1059.558387] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1059.558387] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1059.558387] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1059.558550] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1059.558678] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1059.558758] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1059.559326] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1059.559326] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1059.559326] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1059.559326] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1059.559326] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1059.559608] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1059.559608] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1059.559608] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 5dd6e6d4-a4c3-43e1-a153-05b659cf62c9 is going to be created. [ 1059.616186] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1059.616331] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1059.616397] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1059.616602] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1059.616779] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1059.629988] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 5dd6e6d4-a4c3-43e1-a153-05b659cf62c9 in Status: IN_PROGRESS for 2s [ 1060.066540] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5b5e0c25-5d4e-4e13-9670-be19b4122c73 in Status: SUCCESS [ 1060.066767] env[65370]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5b5e0c25-5d4e-4e13-9670-be19b4122c73 deletion is rescheduled due to dependency. [ 1060.066850] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5b5e0c25-5d4e-4e13-9670-be19b4122c73" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1061.052317] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9496f4d5-71fb-471e-bab0-2220819ba7ed in Status: SUCCESS [ 1061.052591] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9496f4d5-71fb-471e-bab0-2220819ba7ed" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1061.647201] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 5dd6e6d4-a4c3-43e1-a153-05b659cf62c9 in Status: SUCCESS [ 1061.647418] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-5dd6e6d4-a4c3-43e1-a153-05b659cf62c9" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1062.481538] env[65370]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1062.485035] env[65370]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1064.605207] env[65370]: INFO networking_nsxv3.common.synchronization [req-85fc25b5-a5d1-4d06-89ec-3fe67803ee22 req-ecbc1cb8-777e-463a-b60b-017231a5b126 tempest-AttachInterfacesTestJSON-315686657 tempest-AttachInterfacesTestJSON-315686657-project-member] Enqueued Resource ID: 87bbb461-0dea-430b-adcd-ee0e3f4ed609 with Priority: HIGHEST for action security_group_members [ 1064.606299] env[65370]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 87bbb461-0dea-430b-adcd-ee0e3f4ed609 with Priority: HIGHEST for action security_group_members [ 1064.607336] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock member-87bbb461-0dea-430b-adcd-ee0e3f4ed609 taken with stack trace [, , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1064.607336] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-87bbb461-0dea-430b-adcd-ee0e3f4ed609" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1064.607336] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-87bbb461-0dea-430b-adcd-ee0e3f4ed609" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1064.607336] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-87bbb461-0dea-430b-adcd-ee0e3f4ed609" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1064.607336] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1064.607624] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1064.607624] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1064.607701] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1064.607739] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1064.608062] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('87bbb461-0dea-430b-adcd-ee0e3f4ed609',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1064.949752] env[65370]: DEBUG networking_nsxv3.common.locking [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Lock network-309 taken with stack trace [, , , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1064.949981] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquiring lock "network-309" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1064.950147] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquired lock "network-309" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1064.950483] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquired external semaphore "network-309" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1064.950749] env[65370]: DEBUG networking_nsxv3.common.locking [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1064.950908] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquiring lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1064.951043] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquired lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1064.951264] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquired external semaphore "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1064.951407] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Releasing lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1064.951969] env[65370]: DEBUG dogpile.cache.region [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] No value present for key: 'zone-id' {{(pid=65370) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1064.952115] env[65370]: DEBUG dogpile.lock [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] NeedRegenerationException {{(pid=65370) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1064.952227] env[65370]: DEBUG dogpile.lock [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] no value, waiting for create lock {{(pid=65370) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1064.952336] env[65370]: DEBUG dogpile.lock [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] value creation lock acquired {{(pid=65370) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1064.952447] env[65370]: DEBUG dogpile.cache.region [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] No value present for key: 'zone-id' {{(pid=65370) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1064.952551] env[65370]: DEBUG dogpile.lock [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Calling creation function for not-yet-present value {{(pid=65370) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1064.952682] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1064.977212] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1064.977411] env[65370]: DEBUG dogpile.cache.region [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Cache value generated in 0.025 seconds for key(s): 'zone-id' {{(pid=65370) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1064.977625] env[65370]: DEBUG dogpile.lock [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Released creation lock {{(pid=65370) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1064.977819] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Releasing lock "network-309" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1064.978243] env[65370]: DEBUG networking_nsxv3.common.locking [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Lock port-57c63f28-75e5-4762-8eb2-d6b98e11d0e3 taken with stack trace [, , , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1064.978446] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquiring lock "port-57c63f28-75e5-4762-8eb2-d6b98e11d0e3" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1064.978654] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquired lock "port-57c63f28-75e5-4762-8eb2-d6b98e11d0e3" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1064.979048] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquired external semaphore "port-57c63f28-75e5-4762-8eb2-d6b98e11d0e3" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1064.979154] env[65370]: DEBUG networking_nsxv3.api.rpc [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('57c63f28-75e5-4762-8eb2-d6b98e11d0e3',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1065.113271] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1065.113271] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1065.113271] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1065.113271] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1065.113271] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1065.113271] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1065.113271] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1065.113271] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1065.113771] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1065.113771] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1065.113875] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 87bbb461-0dea-430b-adcd-ee0e3f4ed609 already deleted. [ 1065.114587] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-87bbb461-0dea-430b-adcd-ee0e3f4ed609" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1065.481475] env[65370]: DEBUG networking_nsxv3.common.locking [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1065.481727] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquiring lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1065.481838] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquired lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1065.482148] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquired external semaphore "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1065.482318] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Releasing lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1065.482490] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Segment Port 57c63f28-75e5-4762-8eb2-d6b98e11d0e3 not found, creating... [ 1065.482771] env[65370]: DEBUG networking_nsxv3.common.locking [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1065.482947] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquiring lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1065.483113] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquired lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1065.483357] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquired external semaphore "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1065.483496] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Releasing lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1065.483783] env[65370]: DEBUG networking_nsxv3.common.locking [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1065.483940] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquiring lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1065.484073] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquired lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1065.484282] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquired external semaphore "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1065.484415] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Releasing lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1065.484553] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Resource: SegmentPort with ID: 57c63f28-75e5-4762-8eb2-d6b98e11d0e3 is going to be created. [ 1065.510992] env[65370]: DEBUG networking_nsxv3.common.locking [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1065.511259] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquiring lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1065.511354] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquired lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1065.511639] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquired external semaphore "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1065.511870] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Releasing lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1065.512135] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Releasing lock "port-57c63f28-75e5-4762-8eb2-d6b98e11d0e3" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1066.215417] env[65370]: INFO networking_nsxv3.common.synchronization [req-85fc25b5-a5d1-4d06-89ec-3fe67803ee22 req-ff1d282d-f498-4c73-89b2-d7dfa139a36e service nova] Enqueued Resource ID: 87bbb461-0dea-430b-adcd-ee0e3f4ed609 with Priority: HIGHEST for action security_group_rules [ 1066.215644] env[65370]: INFO networking_nsxv3.common.synchronization [req-85fc25b5-a5d1-4d06-89ec-3fe67803ee22 req-ff1d282d-f498-4c73-89b2-d7dfa139a36e service nova] Enqueued Resource ID: 87bbb461-0dea-430b-adcd-ee0e3f4ed609 with Priority: HIGHEST for action security_group_members [ 1066.215737] env[65370]: INFO networking_nsxv3.common.synchronization [req-85fc25b5-a5d1-4d06-89ec-3fe67803ee22 req-ff1d282d-f498-4c73-89b2-d7dfa139a36e service nova] Enqueued Resource ID: 57c63f28-75e5-4762-8eb2-d6b98e11d0e3 with Priority: HIGHEST for action port [ 1066.216270] env[65370]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 87bbb461-0dea-430b-adcd-ee0e3f4ed609 with Priority: HIGHEST for action security_group_rules [ 1066.216396] env[65370]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 87bbb461-0dea-430b-adcd-ee0e3f4ed609 with Priority: HIGHEST for action security_group_members [ 1066.216488] env[65370]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 57c63f28-75e5-4762-8eb2-d6b98e11d0e3 with Priority: HIGHEST for action port [ 1066.216753] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock rules-87bbb461-0dea-430b-adcd-ee0e3f4ed609 taken with stack trace [, , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1066.216863] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-87bbb461-0dea-430b-adcd-ee0e3f4ed609" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1066.216925] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-87bbb461-0dea-430b-adcd-ee0e3f4ed609" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1066.218409] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-87bbb461-0dea-430b-adcd-ee0e3f4ed609" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1066.218409] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('87bbb461-0dea-430b-adcd-ee0e3f4ed609',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1066.219222] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock member-87bbb461-0dea-430b-adcd-ee0e3f4ed609 taken with stack trace [, , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1066.219222] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-87bbb461-0dea-430b-adcd-ee0e3f4ed609" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1066.219344] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-87bbb461-0dea-430b-adcd-ee0e3f4ed609" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1066.219870] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-87bbb461-0dea-430b-adcd-ee0e3f4ed609" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1066.219870] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1066.220023] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1066.220023] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1066.220236] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1066.220286] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1066.220372] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('87bbb461-0dea-430b-adcd-ee0e3f4ed609',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1066.221844] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock port-57c63f28-75e5-4762-8eb2-d6b98e11d0e3 taken with stack trace [, , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1066.224207] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-57c63f28-75e5-4762-8eb2-d6b98e11d0e3" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1066.224207] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-57c63f28-75e5-4762-8eb2-d6b98e11d0e3" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1066.224207] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-57c63f28-75e5-4762-8eb2-d6b98e11d0e3" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1066.224207] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('57c63f28-75e5-4762-8eb2-d6b98e11d0e3',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1066.720013] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock member-87bbb461-0dea-430b-adcd-ee0e3f4ed609 taken with stack trace [, , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1066.720166] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-87bbb461-0dea-430b-adcd-ee0e3f4ed609" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1066.722554] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('87bbb461-0dea-430b-adcd-ee0e3f4ed609',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1066.726191] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 57c63f28-75e5-4762-8eb2-d6b98e11d0e3 with status ACTIVE [ 1066.726245] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1066.726390] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1066.726452] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1066.726622] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1066.726847] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1066.727764] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1066.727764] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1066.727764] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1066.727764] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1066.727764] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1066.731267] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1066.731466] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1066.731527] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1066.731769] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1066.731914] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1066.732051] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 57c63f28-75e5-4762-8eb2-d6b98e11d0e3 is going to be updated. [ 1066.759447] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1066.759651] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1066.759690] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1066.759924] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1066.760030] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1066.760326] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-57c63f28-75e5-4762-8eb2-d6b98e11d0e3" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1066.964469] env[65370]: INFO networking_nsxv3.common.synchronization [None req-69fc3899-9c60-408a-9e4c-fb722fbb048e None None] Enqueued Resource ID: f1a8a402-edaa-4083-be02-218feafd095c with Priority: HIGHEST for action port [ 1066.965048] env[65370]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f1a8a402-edaa-4083-be02-218feafd095c with Priority: HIGHEST for action port [ 1066.965366] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock port-f1a8a402-edaa-4083-be02-218feafd095c taken with stack trace [, , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1066.965490] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-f1a8a402-edaa-4083-be02-218feafd095c" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1066.965558] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-f1a8a402-edaa-4083-be02-218feafd095c" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1066.965866] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-f1a8a402-edaa-4083-be02-218feafd095c" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1066.965949] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f1a8a402-edaa-4083-be02-218feafd095c',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1067.224248] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('87bbb461-0dea-430b-adcd-ee0e3f4ed609',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1067.472106] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port f1a8a402-edaa-4083-be02-218feafd095c [ 1067.473501] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1067.473501] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1067.473501] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1067.473501] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1067.473501] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1067.473501] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:f1a8a402-edaa-4083-be02-218feafd095c already deleted. [ 1067.473501] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-f1a8a402-edaa-4083-be02-218feafd095c" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1067.728902] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1067.728902] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1067.728902] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1067.728902] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1067.728902] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1067.728902] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 87bbb461-0dea-430b-adcd-ee0e3f4ed609 is going to be created. [ 1067.757423] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1067.757560] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1067.757627] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1067.757841] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1067.759029] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1067.768405] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 87bbb461-0dea-430b-adcd-ee0e3f4ed609 in Status: UNINITIALIZED for 2s [ 1069.571142] env[65370]: INFO networking_nsxv3.common.synchronization [req-31aa7d87-cdf7-4c19-9a6d-b6af6f27c67d req-11344dce-b014-4f22-93d3-dcc3fd188be1 tempest-ServerGroupTestJSON-242180378 tempest-ServerGroupTestJSON-242180378-project-member] Enqueued Resource ID: 5dd6e6d4-a4c3-43e1-a153-05b659cf62c9 with Priority: HIGHEST for action security_group_members [ 1069.575580] env[65370]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5dd6e6d4-a4c3-43e1-a153-05b659cf62c9 with Priority: HIGHEST for action security_group_members [ 1069.575580] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock member-5dd6e6d4-a4c3-43e1-a153-05b659cf62c9 taken with stack trace [, , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1069.575580] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5dd6e6d4-a4c3-43e1-a153-05b659cf62c9" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1069.575580] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5dd6e6d4-a4c3-43e1-a153-05b659cf62c9" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1069.575580] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5dd6e6d4-a4c3-43e1-a153-05b659cf62c9" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1069.575580] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1069.575580] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1069.575580] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1069.575580] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1069.575580] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1069.575580] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5dd6e6d4-a4c3-43e1-a153-05b659cf62c9',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1069.608299] env[65370]: INFO networking_nsxv3.common.synchronization [None req-c99234be-41a7-44dc-8120-4e4e84dae452 None None] Enqueued Resource ID: 0abb560c-e4e8-4d04-befa-cca04bd794f1 with Priority: HIGHEST for action port [ 1069.608299] env[65370]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0abb560c-e4e8-4d04-befa-cca04bd794f1 with Priority: HIGHEST for action port [ 1069.608299] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock port-0abb560c-e4e8-4d04-befa-cca04bd794f1 taken with stack trace [, , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1069.608299] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-0abb560c-e4e8-4d04-befa-cca04bd794f1" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1069.608299] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-0abb560c-e4e8-4d04-befa-cca04bd794f1" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1069.608299] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-0abb560c-e4e8-4d04-befa-cca04bd794f1" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1069.608299] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0abb560c-e4e8-4d04-befa-cca04bd794f1',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1069.779348] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 87bbb461-0dea-430b-adcd-ee0e3f4ed609 in Status: SUCCESS [ 1069.779536] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-87bbb461-0dea-430b-adcd-ee0e3f4ed609" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1069.779690] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-87bbb461-0dea-430b-adcd-ee0e3f4ed609" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1069.779927] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-87bbb461-0dea-430b-adcd-ee0e3f4ed609" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1069.780130] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1069.780251] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1069.780332] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1069.780517] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1069.780799] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1069.780799] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-87bbb461-0dea-430b-adcd-ee0e3f4ed609" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1069.780799] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('87bbb461-0dea-430b-adcd-ee0e3f4ed609',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1069.893374] env[65370]: INFO networking_nsxv3.common.synchronization [req-419951e1-ea37-43cf-ac0f-109205e7218c req-49a1f34f-75d2-4da4-a9d1-15c1c5d3873a tempest-ServerRescueNegativeTestJSON-807527939 tempest-ServerRescueNegativeTestJSON-807527939-project-member] Enqueued Resource ID: 237e1a89-daff-4fd5-b02a-97e1d536d9bd with Priority: HIGHEST for action security_group_members [ 1069.894172] env[65370]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 237e1a89-daff-4fd5-b02a-97e1d536d9bd with Priority: HIGHEST for action security_group_members [ 1069.894370] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock member-237e1a89-daff-4fd5-b02a-97e1d536d9bd taken with stack trace [, , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1069.894924] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-237e1a89-daff-4fd5-b02a-97e1d536d9bd" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1069.894924] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-237e1a89-daff-4fd5-b02a-97e1d536d9bd" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1069.894924] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-237e1a89-daff-4fd5-b02a-97e1d536d9bd" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1069.895091] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1069.895227] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1069.895291] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1069.895447] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1069.895923] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1069.895923] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('237e1a89-daff-4fd5-b02a-97e1d536d9bd',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1070.077588] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1070.077903] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1070.077903] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1070.078382] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1070.078382] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1070.078656] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1070.078656] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1070.078755] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1070.079275] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1070.079275] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1070.079275] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5dd6e6d4-a4c3-43e1-a153-05b659cf62c9 is going to be updated. [ 1070.109113] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1070.109375] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1070.109375] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1070.109918] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1070.109997] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1070.111095] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 0abb560c-e4e8-4d04-befa-cca04bd794f1 [ 1070.111277] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1070.111585] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1070.111680] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1070.111870] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1070.111965] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1070.112074] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:0abb560c-e4e8-4d04-befa-cca04bd794f1 already deleted. [ 1070.112166] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-0abb560c-e4e8-4d04-befa-cca04bd794f1" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1070.121756] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5dd6e6d4-a4c3-43e1-a153-05b659cf62c9 in Status: IN_PROGRESS for 2s [ 1070.286501] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('87bbb461-0dea-430b-adcd-ee0e3f4ed609',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1070.398731] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1070.398731] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1070.398731] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1070.398731] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1070.398731] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1070.398960] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1070.398960] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1070.399065] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1070.400136] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1070.400136] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1070.400136] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 237e1a89-daff-4fd5-b02a-97e1d536d9bd is going to be updated. [ 1070.428066] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1070.431507] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1070.431507] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1070.431507] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1070.431507] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1070.438538] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 237e1a89-daff-4fd5-b02a-97e1d536d9bd in Status: IN_PROGRESS for 2s [ 1070.791029] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 87bbb461-0dea-430b-adcd-ee0e3f4ed609: rpc.has_security_group_logging(os_id): False [ 1070.817724] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1070.817724] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1070.817724] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1070.818024] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1070.818102] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1070.818370] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1070.818479] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1070.818531] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1070.818687] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1070.818763] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1070.818849] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 87bbb461-0dea-430b-adcd-ee0e3f4ed609 is going to be created. [ 1070.887913] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1070.888323] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1070.888323] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1070.888467] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1070.890453] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1070.902851] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 87bbb461-0dea-430b-adcd-ee0e3f4ed609 in Status: IN_PROGRESS for 2s [ 1072.131443] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5dd6e6d4-a4c3-43e1-a153-05b659cf62c9 in Status: SUCCESS [ 1072.131721] env[65370]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5dd6e6d4-a4c3-43e1-a153-05b659cf62c9 deletion is rescheduled due to dependency. [ 1072.131953] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5dd6e6d4-a4c3-43e1-a153-05b659cf62c9" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1072.448632] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 237e1a89-daff-4fd5-b02a-97e1d536d9bd in Status: SUCCESS [ 1072.448769] env[65370]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 237e1a89-daff-4fd5-b02a-97e1d536d9bd deletion is rescheduled due to dependency. [ 1072.448913] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-237e1a89-daff-4fd5-b02a-97e1d536d9bd" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1072.917297] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 87bbb461-0dea-430b-adcd-ee0e3f4ed609 in Status: SUCCESS [ 1072.917653] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-87bbb461-0dea-430b-adcd-ee0e3f4ed609" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1073.102502] env[65370]: INFO networking_nsxv3.common.synchronization [req-65b07af6-6f66-464f-b101-3a3d34e6cfdc req-ff0b9332-5893-41a9-a3be-fa71fd328e44 tempest-ServerDiskConfigTestJSON-902849627 tempest-ServerDiskConfigTestJSON-902849627-project-member] Enqueued Resource ID: 420136f3-91df-4669-b5e3-cee436aeacb9 with Priority: HIGHEST for action security_group_members [ 1073.103579] env[65370]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 420136f3-91df-4669-b5e3-cee436aeacb9 with Priority: HIGHEST for action security_group_members [ 1073.103919] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock member-420136f3-91df-4669-b5e3-cee436aeacb9 taken with stack trace [, , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1073.104147] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-420136f3-91df-4669-b5e3-cee436aeacb9" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1073.104236] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-420136f3-91df-4669-b5e3-cee436aeacb9" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1073.104443] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-420136f3-91df-4669-b5e3-cee436aeacb9" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1073.104593] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1073.104694] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1073.104870] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1073.105034] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1073.105104] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1073.105473] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('420136f3-91df-4669-b5e3-cee436aeacb9',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1073.607840] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1073.608263] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1073.608263] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1073.608555] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1073.608698] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1073.608952] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1073.609180] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1073.609286] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1073.609485] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1073.609599] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1073.609776] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 420136f3-91df-4669-b5e3-cee436aeacb9 is going to be updated. [ 1073.636844] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1073.636979] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1073.637835] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1073.637835] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1073.637835] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1073.646671] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 420136f3-91df-4669-b5e3-cee436aeacb9 in Status: IN_PROGRESS for 2s [ 1074.699490] env[65370]: INFO networking_nsxv3.common.synchronization [req-41cba393-1b52-484c-b0fe-92c103551368 req-f6fa056b-1688-41a1-9068-bb997ce0b987 tempest-ListServerFiltersTestJSON-1679580052 tempest-ListServerFiltersTestJSON-1679580052-project-member] Enqueued Resource ID: 9496f4d5-71fb-471e-bab0-2220819ba7ed with Priority: HIGHEST for action security_group_members [ 1074.701882] env[65370]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9496f4d5-71fb-471e-bab0-2220819ba7ed with Priority: HIGHEST for action security_group_members [ 1074.706074] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock member-9496f4d5-71fb-471e-bab0-2220819ba7ed taken with stack trace [, , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1074.706299] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9496f4d5-71fb-471e-bab0-2220819ba7ed" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1074.706402] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9496f4d5-71fb-471e-bab0-2220819ba7ed" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1074.706707] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9496f4d5-71fb-471e-bab0-2220819ba7ed" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1074.706951] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1074.707387] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1074.707387] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1074.707478] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1074.708512] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1074.708512] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9496f4d5-71fb-471e-bab0-2220819ba7ed',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1075.210781] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('9496f4d5-71fb-471e-bab0-2220819ba7ed',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1075.660836] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 420136f3-91df-4669-b5e3-cee436aeacb9 in Status: SUCCESS [ 1075.660836] env[65370]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 420136f3-91df-4669-b5e3-cee436aeacb9 deletion is rescheduled due to dependency. [ 1075.660836] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-420136f3-91df-4669-b5e3-cee436aeacb9" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1075.714028] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('9496f4d5-71fb-471e-bab0-2220819ba7ed',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1075.918946] env[65370]: INFO networking_nsxv3.common.synchronization [req-50eda421-5615-4cca-8267-eda0a70f3548 req-4e754108-4416-4267-b68a-1e398459c13c tempest-ServerActionsTestJSON-720598601 tempest-ServerActionsTestJSON-720598601-project-member] Enqueued Resource ID: 23fa7df4-0993-48e9-9080-1087f76da31c with Priority: HIGHEST for action security_group_members [ 1075.919646] env[65370]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 23fa7df4-0993-48e9-9080-1087f76da31c with Priority: HIGHEST for action security_group_members [ 1075.919944] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock member-23fa7df4-0993-48e9-9080-1087f76da31c taken with stack trace [, , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1075.920104] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-23fa7df4-0993-48e9-9080-1087f76da31c" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1075.920194] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-23fa7df4-0993-48e9-9080-1087f76da31c" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1075.920434] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-23fa7df4-0993-48e9-9080-1087f76da31c" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1075.920661] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1075.920739] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1075.920739] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1075.920891] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1075.920973] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1075.921080] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('23fa7df4-0993-48e9-9080-1087f76da31c',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1076.217175] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1076.217337] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1076.217406] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1076.217621] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1076.217711] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1076.217809] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9496f4d5-71fb-471e-bab0-2220819ba7ed is going to be updated. [ 1076.254955] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1076.255140] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1076.255213] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1076.255451] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1076.256451] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1076.272042] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9496f4d5-71fb-471e-bab0-2220819ba7ed in Status: IN_PROGRESS for 2s [ 1076.423854] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1076.423854] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1076.423854] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1076.424136] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1076.424242] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1076.424523] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1076.424649] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1076.424722] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1076.424914] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1076.425106] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1076.425200] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 23fa7df4-0993-48e9-9080-1087f76da31c is going to be updated. [ 1076.460403] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1076.460648] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1076.460742] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1076.460954] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1076.461111] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1076.470914] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 23fa7df4-0993-48e9-9080-1087f76da31c in Status: IN_PROGRESS for 2s [ 1076.828876] env[65370]: INFO networking_nsxv3.common.synchronization [req-0afd68d5-c615-49fb-ad57-f3aee26b34df req-86197925-1ff4-4209-893f-b622d5bd5af7 tempest-DeleteServersTestJSON-1160924027 tempest-DeleteServersTestJSON-1160924027-project-member] Enqueued Resource ID: 1eaa763e-4469-4428-92d0-ba20a6c99edc with Priority: HIGHEST for action security_group_members [ 1076.829459] env[65370]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1eaa763e-4469-4428-92d0-ba20a6c99edc with Priority: HIGHEST for action security_group_members [ 1076.829750] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock member-1eaa763e-4469-4428-92d0-ba20a6c99edc taken with stack trace [, , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1076.829876] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1eaa763e-4469-4428-92d0-ba20a6c99edc" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1076.829972] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1eaa763e-4469-4428-92d0-ba20a6c99edc" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1076.830147] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1eaa763e-4469-4428-92d0-ba20a6c99edc" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1076.830302] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1076.830620] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1076.830620] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1076.830620] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1076.830741] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1076.830805] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1eaa763e-4469-4428-92d0-ba20a6c99edc',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1077.172076] env[65370]: DEBUG networking_nsxv3.common.locking [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Lock network-712 taken with stack trace [, , , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1077.172327] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquiring lock "network-712" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1077.172458] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquired lock "network-712" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1077.172714] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquired external semaphore "network-712" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1077.172973] env[65370]: DEBUG networking_nsxv3.common.locking [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1077.173309] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquiring lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1077.173433] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquired lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1077.173645] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquired external semaphore "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1077.173786] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Releasing lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1077.173991] env[65370]: DEBUG dogpile.cache.region [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] No value present for key: 'zone-id' {{(pid=65370) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1077.174117] env[65370]: DEBUG dogpile.lock [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] NeedRegenerationException {{(pid=65370) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1077.174225] env[65370]: DEBUG dogpile.lock [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] no value, waiting for create lock {{(pid=65370) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1077.174329] env[65370]: DEBUG dogpile.lock [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] value creation lock acquired {{(pid=65370) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1077.174436] env[65370]: DEBUG dogpile.cache.region [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] No value present for key: 'zone-id' {{(pid=65370) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1077.174540] env[65370]: DEBUG dogpile.lock [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Calling creation function for not-yet-present value {{(pid=65370) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1077.174667] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1077.192624] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1077.192624] env[65370]: DEBUG dogpile.cache.region [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Cache value generated in 0.018 seconds for key(s): 'zone-id' {{(pid=65370) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1077.192794] env[65370]: DEBUG dogpile.lock [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Released creation lock {{(pid=65370) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1077.193026] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Releasing lock "network-712" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1077.193383] env[65370]: DEBUG networking_nsxv3.common.locking [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Lock port-5488ae29-7179-4378-aab3-3ae48433f157 taken with stack trace [, , , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1077.193557] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquiring lock "port-5488ae29-7179-4378-aab3-3ae48433f157" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1077.193674] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquired lock "port-5488ae29-7179-4378-aab3-3ae48433f157" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1077.194008] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquired external semaphore "port-5488ae29-7179-4378-aab3-3ae48433f157" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1077.194160] env[65370]: DEBUG networking_nsxv3.api.rpc [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5488ae29-7179-4378-aab3-3ae48433f157',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1077.332922] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1077.333116] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1077.333182] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1077.333421] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1077.333463] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1077.333643] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1077.333791] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1077.333791] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1077.336476] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1077.336476] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1077.336476] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1eaa763e-4469-4428-92d0-ba20a6c99edc is going to be updated. [ 1077.364564] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1077.364718] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1077.365273] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1077.365273] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1077.365386] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1077.376817] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1eaa763e-4469-4428-92d0-ba20a6c99edc in Status: IN_PROGRESS for 2s [ 1077.696544] env[65370]: DEBUG networking_nsxv3.common.locking [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1077.696811] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquiring lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1077.696972] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquired lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1077.697289] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquired external semaphore "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1077.697466] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Releasing lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1077.697643] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Segment Port 5488ae29-7179-4378-aab3-3ae48433f157 not found, creating... [ 1077.697921] env[65370]: DEBUG networking_nsxv3.common.locking [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1077.698142] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquiring lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1077.698276] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquired lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1077.698532] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquired external semaphore "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1077.698689] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Releasing lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1077.698994] env[65370]: DEBUG networking_nsxv3.common.locking [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1077.699185] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquiring lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1077.699309] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquired lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1077.699812] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquired external semaphore "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1077.699812] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Releasing lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1077.699812] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Resource: SegmentPort with ID: 5488ae29-7179-4378-aab3-3ae48433f157 is going to be created. [ 1077.735554] env[65370]: DEBUG networking_nsxv3.common.locking [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1077.735828] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquiring lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1077.735912] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquired lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1077.736332] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquired external semaphore "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1077.736574] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Releasing lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1077.736799] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Releasing lock "port-5488ae29-7179-4378-aab3-3ae48433f157" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1078.282757] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9496f4d5-71fb-471e-bab0-2220819ba7ed in Status: SUCCESS [ 1078.282757] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9496f4d5-71fb-471e-bab0-2220819ba7ed" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1078.433066] env[65370]: INFO networking_nsxv3.common.synchronization [req-0afd68d5-c615-49fb-ad57-f3aee26b34df req-6133c7a0-972b-4ec0-9540-0e859decb484 service nova] Enqueued Resource ID: 1eaa763e-4469-4428-92d0-ba20a6c99edc with Priority: HIGHEST for action security_group_rules [ 1078.433066] env[65370]: INFO networking_nsxv3.common.synchronization [req-0afd68d5-c615-49fb-ad57-f3aee26b34df req-6133c7a0-972b-4ec0-9540-0e859decb484 service nova] Enqueued Resource ID: 1eaa763e-4469-4428-92d0-ba20a6c99edc with Priority: HIGHEST for action security_group_members [ 1078.433066] env[65370]: INFO networking_nsxv3.common.synchronization [req-0afd68d5-c615-49fb-ad57-f3aee26b34df req-6133c7a0-972b-4ec0-9540-0e859decb484 service nova] Enqueued Resource ID: 5488ae29-7179-4378-aab3-3ae48433f157 with Priority: HIGHEST for action port [ 1078.433066] env[65370]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1eaa763e-4469-4428-92d0-ba20a6c99edc with Priority: HIGHEST for action security_group_rules [ 1078.433066] env[65370]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1eaa763e-4469-4428-92d0-ba20a6c99edc with Priority: HIGHEST for action security_group_members [ 1078.433066] env[65370]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5488ae29-7179-4378-aab3-3ae48433f157 with Priority: HIGHEST for action port [ 1078.433066] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock rules-1eaa763e-4469-4428-92d0-ba20a6c99edc taken with stack trace [, , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1078.433551] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-1eaa763e-4469-4428-92d0-ba20a6c99edc" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1078.433551] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-1eaa763e-4469-4428-92d0-ba20a6c99edc" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1078.433551] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-1eaa763e-4469-4428-92d0-ba20a6c99edc" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1078.433551] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('1eaa763e-4469-4428-92d0-ba20a6c99edc',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1078.434819] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock member-1eaa763e-4469-4428-92d0-ba20a6c99edc taken with stack trace [, , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1078.434868] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1eaa763e-4469-4428-92d0-ba20a6c99edc" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1078.435212] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock port-5488ae29-7179-4378-aab3-3ae48433f157 taken with stack trace [, , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1078.435350] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-5488ae29-7179-4378-aab3-3ae48433f157" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1078.435437] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-5488ae29-7179-4378-aab3-3ae48433f157" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1078.435653] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-5488ae29-7179-4378-aab3-3ae48433f157" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1078.435766] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5488ae29-7179-4378-aab3-3ae48433f157',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1078.479972] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 23fa7df4-0993-48e9-9080-1087f76da31c in Status: SUCCESS [ 1078.480173] env[65370]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 23fa7df4-0993-48e9-9080-1087f76da31c deletion is rescheduled due to dependency. [ 1078.480288] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-23fa7df4-0993-48e9-9080-1087f76da31c" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1078.937542] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock member-1eaa763e-4469-4428-92d0-ba20a6c99edc taken with stack trace [, , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1078.937669] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1eaa763e-4469-4428-92d0-ba20a6c99edc" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1078.937858] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 5488ae29-7179-4378-aab3-3ae48433f157 with status ACTIVE [ 1078.938045] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1078.938206] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1078.938331] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1078.938486] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1078.938572] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1078.938740] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1078.938838] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1078.938912] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1078.939074] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1078.939154] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1078.939330] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1078.939421] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1078.939490] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1078.939629] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1078.939701] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1078.939784] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 5488ae29-7179-4378-aab3-3ae48433f157 is going to be updated. [ 1078.962094] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1078.962253] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1078.962323] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1078.962539] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1078.962675] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1078.962847] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-5488ae29-7179-4378-aab3-3ae48433f157" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1079.386193] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1eaa763e-4469-4428-92d0-ba20a6c99edc in Status: SUCCESS [ 1079.386543] env[65370]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1eaa763e-4469-4428-92d0-ba20a6c99edc deletion is rescheduled due to dependency. [ 1079.386543] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1eaa763e-4469-4428-92d0-ba20a6c99edc" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1079.386682] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1eaa763e-4469-4428-92d0-ba20a6c99edc" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1079.386986] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1eaa763e-4469-4428-92d0-ba20a6c99edc" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1079.387258] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1079.387409] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1079.387480] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1079.387666] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1079.387776] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1079.387892] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1eaa763e-4469-4428-92d0-ba20a6c99edc',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1079.890801] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('1eaa763e-4469-4428-92d0-ba20a6c99edc',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1080.394486] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('1eaa763e-4469-4428-92d0-ba20a6c99edc',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1080.897916] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1080.898369] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1080.898369] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1080.898531] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1080.898583] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1080.898681] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1eaa763e-4469-4428-92d0-ba20a6c99edc is going to be updated. [ 1080.947790] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1080.947968] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1080.948017] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1080.948467] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1080.948467] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1080.960152] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1eaa763e-4469-4428-92d0-ba20a6c99edc in Status: IN_PROGRESS for 2s [ 1081.739422] env[65370]: INFO networking_nsxv3.common.synchronization [req-f9573c3e-780e-401b-b656-1aefffbe16b7 req-ccba80f2-71a4-4773-9494-9521f2543cfe tempest-ServerMetadataNegativeTestJSON-284297633 tempest-ServerMetadataNegativeTestJSON-284297633-project-member] Enqueued Resource ID: 73fdcc5c-e9b7-4038-bdaa-9396e2912ed3 with Priority: HIGHEST for action security_group_members [ 1081.739703] env[65370]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 73fdcc5c-e9b7-4038-bdaa-9396e2912ed3 with Priority: HIGHEST for action security_group_members [ 1081.740019] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock member-73fdcc5c-e9b7-4038-bdaa-9396e2912ed3 taken with stack trace [, , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1081.740117] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-73fdcc5c-e9b7-4038-bdaa-9396e2912ed3" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1081.740163] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-73fdcc5c-e9b7-4038-bdaa-9396e2912ed3" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1081.740415] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-73fdcc5c-e9b7-4038-bdaa-9396e2912ed3" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1081.740579] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1081.740677] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1081.740743] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1081.740890] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1081.740975] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1081.741091] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('73fdcc5c-e9b7-4038-bdaa-9396e2912ed3',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1082.075189] env[65370]: DEBUG networking_nsxv3.common.locking [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Lock network-173 taken with stack trace [, , , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1082.075442] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquiring lock "network-173" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1082.076349] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquired lock "network-173" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1082.076349] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquired external semaphore "network-173" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1082.076545] env[65370]: DEBUG networking_nsxv3.common.locking [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1082.076695] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquiring lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1082.076835] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquired lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1082.077140] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquired external semaphore "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1082.077333] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Releasing lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1082.077564] env[65370]: DEBUG dogpile.cache.region [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] No value present for key: 'zone-id' {{(pid=65370) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1082.077685] env[65370]: DEBUG dogpile.lock [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] NeedRegenerationException {{(pid=65370) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1082.077806] env[65370]: DEBUG dogpile.lock [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] no value, waiting for create lock {{(pid=65370) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1082.077904] env[65370]: DEBUG dogpile.lock [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] value creation lock acquired {{(pid=65370) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1082.078018] env[65370]: DEBUG dogpile.cache.region [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] No value present for key: 'zone-id' {{(pid=65370) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1082.078118] env[65370]: DEBUG dogpile.lock [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Calling creation function for not-yet-present value {{(pid=65370) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1082.078284] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1082.101301] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1082.101301] env[65370]: DEBUG dogpile.cache.region [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=65370) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1082.101301] env[65370]: DEBUG dogpile.lock [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Released creation lock {{(pid=65370) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1082.101301] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Releasing lock "network-173" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1082.101301] env[65370]: DEBUG networking_nsxv3.common.locking [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Lock port-e637e09c-fc6c-4940-9041-7cb32d78ee18 taken with stack trace [, , , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1082.101572] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquiring lock "port-e637e09c-fc6c-4940-9041-7cb32d78ee18" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1082.101749] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquired lock "port-e637e09c-fc6c-4940-9041-7cb32d78ee18" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1082.102133] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquired external semaphore "port-e637e09c-fc6c-4940-9041-7cb32d78ee18" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1082.102404] env[65370]: DEBUG networking_nsxv3.api.rpc [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e637e09c-fc6c-4940-9041-7cb32d78ee18',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1082.243650] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1082.243840] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1082.243877] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1082.244221] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1082.244277] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1082.244811] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1082.244811] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1082.244811] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1082.244811] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1082.244811] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1082.245033] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 73fdcc5c-e9b7-4038-bdaa-9396e2912ed3 already deleted. [ 1082.245033] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-73fdcc5c-e9b7-4038-bdaa-9396e2912ed3" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1082.605540] env[65370]: DEBUG networking_nsxv3.common.locking [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1082.605858] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquiring lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1082.606047] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquired lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1082.606386] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquired external semaphore "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1082.606537] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Releasing lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1082.606699] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Segment Port e637e09c-fc6c-4940-9041-7cb32d78ee18 not found, creating... [ 1082.607063] env[65370]: DEBUG networking_nsxv3.common.locking [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1082.607229] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquiring lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1082.607357] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquired lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1082.607588] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquired external semaphore "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1082.607724] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Releasing lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1082.608014] env[65370]: DEBUG networking_nsxv3.common.locking [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1082.608218] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquiring lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1082.608324] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquired lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1082.608534] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquired external semaphore "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1082.608666] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Releasing lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1082.608815] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Resource: SegmentPort with ID: e637e09c-fc6c-4940-9041-7cb32d78ee18 is going to be created. [ 1082.634556] env[65370]: DEBUG networking_nsxv3.common.locking [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1082.634780] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquiring lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1082.634903] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquired lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1082.635209] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquired external semaphore "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1082.635440] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Releasing lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1082.635662] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Releasing lock "port-e637e09c-fc6c-4940-9041-7cb32d78ee18" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1082.972018] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1eaa763e-4469-4428-92d0-ba20a6c99edc in Status: SUCCESS [ 1082.972389] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1eaa763e-4469-4428-92d0-ba20a6c99edc" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1082.972593] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1eaa763e-4469-4428-92d0-ba20a6c99edc" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1082.972732] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1eaa763e-4469-4428-92d0-ba20a6c99edc" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1082.973167] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1082.973167] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1082.973167] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1082.973328] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1082.973328] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1082.973416] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1eaa763e-4469-4428-92d0-ba20a6c99edc" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1082.973502] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('1eaa763e-4469-4428-92d0-ba20a6c99edc',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1083.363546] env[65370]: INFO networking_nsxv3.common.synchronization [req-f9573c3e-780e-401b-b656-1aefffbe16b7 req-6e0393c8-307f-4876-85da-2548021d4988 service nova] Enqueued Resource ID: 73fdcc5c-e9b7-4038-bdaa-9396e2912ed3 with Priority: HIGHEST for action security_group_rules [ 1083.363619] env[65370]: INFO networking_nsxv3.common.synchronization [req-f9573c3e-780e-401b-b656-1aefffbe16b7 req-6e0393c8-307f-4876-85da-2548021d4988 service nova] Enqueued Resource ID: 73fdcc5c-e9b7-4038-bdaa-9396e2912ed3 with Priority: HIGHEST for action security_group_members [ 1083.363748] env[65370]: INFO networking_nsxv3.common.synchronization [req-f9573c3e-780e-401b-b656-1aefffbe16b7 req-6e0393c8-307f-4876-85da-2548021d4988 service nova] Enqueued Resource ID: e637e09c-fc6c-4940-9041-7cb32d78ee18 with Priority: HIGHEST for action port [ 1083.364271] env[65370]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 73fdcc5c-e9b7-4038-bdaa-9396e2912ed3 with Priority: HIGHEST for action security_group_rules [ 1083.364475] env[65370]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 73fdcc5c-e9b7-4038-bdaa-9396e2912ed3 with Priority: HIGHEST for action security_group_members [ 1083.364586] env[65370]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e637e09c-fc6c-4940-9041-7cb32d78ee18 with Priority: HIGHEST for action port [ 1083.364866] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock rules-73fdcc5c-e9b7-4038-bdaa-9396e2912ed3 taken with stack trace [, , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1083.364998] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-73fdcc5c-e9b7-4038-bdaa-9396e2912ed3" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1083.365062] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-73fdcc5c-e9b7-4038-bdaa-9396e2912ed3" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1083.365333] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-73fdcc5c-e9b7-4038-bdaa-9396e2912ed3" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1083.365451] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('73fdcc5c-e9b7-4038-bdaa-9396e2912ed3',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1083.366521] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock member-73fdcc5c-e9b7-4038-bdaa-9396e2912ed3 taken with stack trace [, , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1083.366647] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-73fdcc5c-e9b7-4038-bdaa-9396e2912ed3" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1083.366714] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-73fdcc5c-e9b7-4038-bdaa-9396e2912ed3" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1083.366898] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-73fdcc5c-e9b7-4038-bdaa-9396e2912ed3" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1083.367059] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1083.367176] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1083.367205] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1083.367342] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1083.367426] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1083.367513] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('73fdcc5c-e9b7-4038-bdaa-9396e2912ed3',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1083.368344] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock port-e637e09c-fc6c-4940-9041-7cb32d78ee18 taken with stack trace [, , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1083.368535] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-e637e09c-fc6c-4940-9041-7cb32d78ee18" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1083.368602] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-e637e09c-fc6c-4940-9041-7cb32d78ee18" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1083.368756] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-e637e09c-fc6c-4940-9041-7cb32d78ee18" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1083.368836] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e637e09c-fc6c-4940-9041-7cb32d78ee18',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1083.476045] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock member-1eaa763e-4469-4428-92d0-ba20a6c99edc taken with stack trace [, , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1083.476045] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1eaa763e-4469-4428-92d0-ba20a6c99edc" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1083.476045] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1eaa763e-4469-4428-92d0-ba20a6c99edc" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1083.476045] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1eaa763e-4469-4428-92d0-ba20a6c99edc" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1083.476423] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1083.476423] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1083.476613] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1083.476613] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1083.476685] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1083.477222] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1eaa763e-4469-4428-92d0-ba20a6c99edc" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1083.477222] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock member-1eaa763e-4469-4428-92d0-ba20a6c99edc taken with stack trace [, , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1083.477222] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1eaa763e-4469-4428-92d0-ba20a6c99edc" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1083.477222] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1eaa763e-4469-4428-92d0-ba20a6c99edc" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1083.477222] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1eaa763e-4469-4428-92d0-ba20a6c99edc" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1083.477569] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1083.477569] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1083.477569] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1083.477569] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1083.477772] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1083.477772] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1eaa763e-4469-4428-92d0-ba20a6c99edc" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1083.477870] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('1eaa763e-4469-4428-92d0-ba20a6c99edc',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1083.871355] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock member-73fdcc5c-e9b7-4038-bdaa-9396e2912ed3 taken with stack trace [, , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1083.871355] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-73fdcc5c-e9b7-4038-bdaa-9396e2912ed3" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1083.871755] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('73fdcc5c-e9b7-4038-bdaa-9396e2912ed3',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1083.872753] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port e637e09c-fc6c-4940-9041-7cb32d78ee18 with status ACTIVE [ 1083.873844] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1083.874030] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1083.874138] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1083.874440] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1083.874559] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1083.874844] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1083.875029] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1083.875119] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1083.875310] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1083.875414] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1083.875621] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1083.875720] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1083.875796] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1083.875931] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1083.876014] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1083.876102] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: e637e09c-fc6c-4940-9041-7cb32d78ee18 is going to be updated. [ 1083.902967] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1083.903127] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1083.903207] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1083.903481] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1083.903636] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1083.903943] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-e637e09c-fc6c-4940-9041-7cb32d78ee18" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1083.981090] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 1eaa763e-4469-4428-92d0-ba20a6c99edc: rpc.has_security_group_logging(os_id): False [ 1084.024520] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1084.024520] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1084.024789] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1084.024841] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1084.024941] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1084.025152] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1084.025289] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1084.025357] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1084.025514] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1084.025629] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1084.025903] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1084.025990] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1084.026075] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1084.026253] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1084.026341] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1084.026556] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1084.026654] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1084.026711] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1084.026892] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1084.026997] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1084.027114] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 1eaa763e-4469-4428-92d0-ba20a6c99edc is going to be updated. [ 1084.197593] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1084.197593] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1084.197593] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1084.197915] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1084.198029] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1084.268570] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 1eaa763e-4469-4428-92d0-ba20a6c99edc in Status: IN_PROGRESS for 2s [ 1084.378562] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('73fdcc5c-e9b7-4038-bdaa-9396e2912ed3',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1084.881062] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1084.882030] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1084.882163] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1084.882486] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1084.882589] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1084.883422] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 73fdcc5c-e9b7-4038-bdaa-9396e2912ed3 is going to be created. [ 1084.906574] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1084.906778] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1084.906848] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1084.907040] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1084.907212] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1084.920078] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 73fdcc5c-e9b7-4038-bdaa-9396e2912ed3 in Status: UNINITIALIZED for 2s [ 1086.304980] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 1eaa763e-4469-4428-92d0-ba20a6c99edc in Status: SUCCESS [ 1086.305709] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-1eaa763e-4469-4428-92d0-ba20a6c99edc" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1086.934285] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 73fdcc5c-e9b7-4038-bdaa-9396e2912ed3 in Status: SUCCESS [ 1086.934467] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-73fdcc5c-e9b7-4038-bdaa-9396e2912ed3" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1086.934631] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-73fdcc5c-e9b7-4038-bdaa-9396e2912ed3" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1086.934852] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-73fdcc5c-e9b7-4038-bdaa-9396e2912ed3" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1086.935073] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1086.935252] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1086.935325] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1086.935549] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1086.935581] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1086.935651] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-73fdcc5c-e9b7-4038-bdaa-9396e2912ed3" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1086.935768] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('73fdcc5c-e9b7-4038-bdaa-9396e2912ed3',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1087.438959] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock member-73fdcc5c-e9b7-4038-bdaa-9396e2912ed3 taken with stack trace [, , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1087.439382] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-73fdcc5c-e9b7-4038-bdaa-9396e2912ed3" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1087.439382] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-73fdcc5c-e9b7-4038-bdaa-9396e2912ed3" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1087.439542] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-73fdcc5c-e9b7-4038-bdaa-9396e2912ed3" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1087.439627] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1087.439808] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1087.439852] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1087.440412] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1087.440412] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1087.440412] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-73fdcc5c-e9b7-4038-bdaa-9396e2912ed3" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1087.440412] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock member-73fdcc5c-e9b7-4038-bdaa-9396e2912ed3 taken with stack trace [, , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1087.440412] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-73fdcc5c-e9b7-4038-bdaa-9396e2912ed3" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1087.441245] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-73fdcc5c-e9b7-4038-bdaa-9396e2912ed3" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1087.441245] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-73fdcc5c-e9b7-4038-bdaa-9396e2912ed3" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1087.441245] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1087.441245] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1087.441245] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1087.441245] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1087.441536] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1087.441536] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-73fdcc5c-e9b7-4038-bdaa-9396e2912ed3" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1087.441536] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('73fdcc5c-e9b7-4038-bdaa-9396e2912ed3',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1087.945044] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 73fdcc5c-e9b7-4038-bdaa-9396e2912ed3: rpc.has_security_group_logging(os_id): False [ 1087.968779] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1087.970174] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1087.970174] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1087.970174] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1087.970174] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1087.970174] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1087.970174] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1087.970174] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1087.971407] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1087.971407] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1087.971568] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1087.971568] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1087.971645] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1087.971775] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1087.973359] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1087.973826] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1087.973982] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1087.974082] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1087.974285] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1087.974369] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1087.974465] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 73fdcc5c-e9b7-4038-bdaa-9396e2912ed3 is going to be created. [ 1088.047108] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1088.047343] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1088.047517] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1088.047846] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1088.048116] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1088.062663] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 73fdcc5c-e9b7-4038-bdaa-9396e2912ed3 in Status: IN_PROGRESS for 2s [ 1088.365697] env[65370]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1088.365887] env[65370]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=1 [ 1088.394235] env[65370]: INFO networking_nsxv3.common.synchronization [req-b22be8ce-9e6a-4e43-8c32-c228b82aa31b req-ddcf1edc-9a3c-4260-ae34-26998d8eee54 tempest-ServerDiskConfigTestJSON-902849627 tempest-ServerDiskConfigTestJSON-902849627-project-member] Enqueued Resource ID: 420136f3-91df-4669-b5e3-cee436aeacb9 with Priority: HIGHEST for action security_group_members [ 1088.394912] env[65370]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 420136f3-91df-4669-b5e3-cee436aeacb9 with Priority: HIGHEST for action security_group_members [ 1088.395409] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock member-420136f3-91df-4669-b5e3-cee436aeacb9 taken with stack trace [, , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1088.395581] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-420136f3-91df-4669-b5e3-cee436aeacb9" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1088.395697] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-420136f3-91df-4669-b5e3-cee436aeacb9" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1088.396387] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-420136f3-91df-4669-b5e3-cee436aeacb9" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1088.396387] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1088.396387] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1088.396544] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1088.396760] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1088.396973] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1088.397024] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('420136f3-91df-4669-b5e3-cee436aeacb9',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1088.802940] env[65370]: DEBUG networking_nsxv3.common.locking [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Lock network-974 taken with stack trace [, , , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1088.802940] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquiring lock "network-974" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1088.802940] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquired lock "network-974" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1088.803374] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquired external semaphore "network-974" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1088.806489] env[65370]: DEBUG networking_nsxv3.common.locking [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1088.807104] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquiring lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1088.808361] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquired lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1088.808800] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquired external semaphore "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1088.809073] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Releasing lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1088.809450] env[65370]: DEBUG dogpile.cache.region [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] No value present for key: 'zone-id' {{(pid=65370) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1088.809624] env[65370]: DEBUG dogpile.lock [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] NeedRegenerationException {{(pid=65370) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1088.809933] env[65370]: DEBUG dogpile.lock [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] no value, waiting for create lock {{(pid=65370) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1088.810144] env[65370]: DEBUG dogpile.lock [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] value creation lock acquired {{(pid=65370) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1088.810349] env[65370]: DEBUG dogpile.cache.region [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] No value present for key: 'zone-id' {{(pid=65370) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1088.810528] env[65370]: DEBUG dogpile.lock [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Calling creation function for not-yet-present value {{(pid=65370) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1088.810745] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1088.835587] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1088.835847] env[65370]: DEBUG dogpile.cache.region [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Cache value generated in 0.025 seconds for key(s): 'zone-id' {{(pid=65370) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1088.836021] env[65370]: DEBUG dogpile.lock [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Released creation lock {{(pid=65370) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1088.836256] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Releasing lock "network-974" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1088.836787] env[65370]: DEBUG networking_nsxv3.common.locking [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Lock port-a1edba09-4967-4807-92cc-614abe6e9938 taken with stack trace [, , , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1088.837126] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquiring lock "port-a1edba09-4967-4807-92cc-614abe6e9938" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1088.837363] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquired lock "port-a1edba09-4967-4807-92cc-614abe6e9938" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1088.837745] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquired external semaphore "port-a1edba09-4967-4807-92cc-614abe6e9938" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1088.837931] env[65370]: DEBUG networking_nsxv3.api.rpc [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a1edba09-4967-4807-92cc-614abe6e9938',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1088.901093] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1088.901271] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1088.901322] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1088.901621] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1088.901669] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1088.901965] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1088.902083] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1088.902144] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1088.902303] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1088.902382] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1088.902563] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 420136f3-91df-4669-b5e3-cee436aeacb9 is going to be updated. [ 1088.943735] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1088.943882] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1088.943954] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1088.944195] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1088.944366] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1088.959852] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 420136f3-91df-4669-b5e3-cee436aeacb9 in Status: IN_PROGRESS for 2s [ 1089.344026] env[65370]: DEBUG networking_nsxv3.common.locking [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1089.344026] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquiring lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1089.344026] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquired lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1089.344026] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquired external semaphore "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1089.344026] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Releasing lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1089.344026] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Segment Port a1edba09-4967-4807-92cc-614abe6e9938 not found, creating... [ 1089.344026] env[65370]: DEBUG networking_nsxv3.common.locking [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1089.344026] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquiring lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1089.344026] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquired lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1089.344026] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquired external semaphore "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1089.344026] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Releasing lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1089.344698] env[65370]: DEBUG networking_nsxv3.common.locking [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1089.344698] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquiring lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1089.345572] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquired lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1089.345572] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquired external semaphore "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1089.346374] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Releasing lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1089.346374] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Resource: SegmentPort with ID: a1edba09-4967-4807-92cc-614abe6e9938 is going to be created. [ 1089.389514] env[65370]: DEBUG networking_nsxv3.common.locking [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1089.389789] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquiring lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1089.389956] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquired lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1089.390305] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquired external semaphore "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1089.390443] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Releasing lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1089.391184] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Releasing lock "port-a1edba09-4967-4807-92cc-614abe6e9938" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1090.030956] env[65370]: INFO networking_nsxv3.common.synchronization [None req-48f6d0e9-39d5-40d6-b41b-86444641c683 None None] Enqueued Resource ID: 778fa206-a726-4844-a900-3ca4ea72b6bc with Priority: HIGHEST for action port [ 1090.033702] env[65370]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 778fa206-a726-4844-a900-3ca4ea72b6bc with Priority: HIGHEST for action port [ 1090.033702] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock port-778fa206-a726-4844-a900-3ca4ea72b6bc taken with stack trace [, , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1090.033825] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-778fa206-a726-4844-a900-3ca4ea72b6bc" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1090.033865] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-778fa206-a726-4844-a900-3ca4ea72b6bc" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1090.034162] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-778fa206-a726-4844-a900-3ca4ea72b6bc" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1090.034259] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('778fa206-a726-4844-a900-3ca4ea72b6bc',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1090.080507] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 73fdcc5c-e9b7-4038-bdaa-9396e2912ed3 in Status: SUCCESS [ 1090.080896] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-73fdcc5c-e9b7-4038-bdaa-9396e2912ed3" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1090.108426] env[65370]: INFO networking_nsxv3.common.synchronization [req-b22be8ce-9e6a-4e43-8c32-c228b82aa31b req-dfdf69c0-211f-493d-8ff8-e06420ab7291 service nova] Enqueued Resource ID: 420136f3-91df-4669-b5e3-cee436aeacb9 with Priority: HIGHEST for action security_group_rules [ 1090.108426] env[65370]: INFO networking_nsxv3.common.synchronization [req-b22be8ce-9e6a-4e43-8c32-c228b82aa31b req-dfdf69c0-211f-493d-8ff8-e06420ab7291 service nova] Enqueued Resource ID: 420136f3-91df-4669-b5e3-cee436aeacb9 with Priority: HIGHEST for action security_group_members [ 1090.108426] env[65370]: INFO networking_nsxv3.common.synchronization [req-b22be8ce-9e6a-4e43-8c32-c228b82aa31b req-dfdf69c0-211f-493d-8ff8-e06420ab7291 service nova] Enqueued Resource ID: a1edba09-4967-4807-92cc-614abe6e9938 with Priority: HIGHEST for action port [ 1090.108426] env[65370]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 420136f3-91df-4669-b5e3-cee436aeacb9 with Priority: HIGHEST for action security_group_rules [ 1090.108426] env[65370]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 420136f3-91df-4669-b5e3-cee436aeacb9 with Priority: HIGHEST for action security_group_members [ 1090.108426] env[65370]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a1edba09-4967-4807-92cc-614abe6e9938 with Priority: HIGHEST for action port [ 1090.108426] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock rules-420136f3-91df-4669-b5e3-cee436aeacb9 taken with stack trace [, , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1090.110135] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-420136f3-91df-4669-b5e3-cee436aeacb9" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1090.110373] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-420136f3-91df-4669-b5e3-cee436aeacb9" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1090.110757] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-420136f3-91df-4669-b5e3-cee436aeacb9" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1090.110996] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('420136f3-91df-4669-b5e3-cee436aeacb9',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1090.112796] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock member-420136f3-91df-4669-b5e3-cee436aeacb9 taken with stack trace [, , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1090.113509] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-420136f3-91df-4669-b5e3-cee436aeacb9" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1090.113509] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock port-a1edba09-4967-4807-92cc-614abe6e9938 taken with stack trace [, , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1090.113664] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-a1edba09-4967-4807-92cc-614abe6e9938" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1090.113887] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-a1edba09-4967-4807-92cc-614abe6e9938" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1090.116118] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-a1edba09-4967-4807-92cc-614abe6e9938" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1090.116118] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a1edba09-4967-4807-92cc-614abe6e9938',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1090.538200] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 778fa206-a726-4844-a900-3ca4ea72b6bc [ 1090.538524] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1090.538735] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1090.538842] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1090.539135] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1090.539231] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1090.539402] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:778fa206-a726-4844-a900-3ca4ea72b6bc already deleted. [ 1090.539490] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-778fa206-a726-4844-a900-3ca4ea72b6bc" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1090.617094] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock member-420136f3-91df-4669-b5e3-cee436aeacb9 taken with stack trace [, , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1090.617241] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-420136f3-91df-4669-b5e3-cee436aeacb9" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1090.617476] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port a1edba09-4967-4807-92cc-614abe6e9938 with status ACTIVE [ 1090.617650] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1090.617759] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1090.617875] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1090.618039] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1090.618124] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1090.618320] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1090.618434] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1090.618517] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1090.618650] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1090.618727] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1090.618906] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1090.619014] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1090.619070] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1090.619208] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1090.619323] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1090.619373] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: a1edba09-4967-4807-92cc-614abe6e9938 is going to be updated. [ 1090.645536] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1090.645536] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1090.645536] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1090.645753] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1090.645782] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1090.647746] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-a1edba09-4967-4807-92cc-614abe6e9938" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1090.975377] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 420136f3-91df-4669-b5e3-cee436aeacb9 in Status: SUCCESS [ 1090.975566] env[65370]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 420136f3-91df-4669-b5e3-cee436aeacb9 deletion is rescheduled due to dependency. [ 1090.975744] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-420136f3-91df-4669-b5e3-cee436aeacb9" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1090.975843] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-420136f3-91df-4669-b5e3-cee436aeacb9" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1090.979057] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-420136f3-91df-4669-b5e3-cee436aeacb9" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1090.979057] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1090.980126] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1090.980126] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1090.980126] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1090.980126] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1090.980126] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('420136f3-91df-4669-b5e3-cee436aeacb9',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1091.483173] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('420136f3-91df-4669-b5e3-cee436aeacb9',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1091.970117] env[65370]: INFO networking_nsxv3.common.synchronization [None req-62f0cc30-de79-48ce-9aa1-3279cb6cc0dd None None] Enqueued Resource ID: 7cba2186-6cb6-4d65-a07e-9e2e9c2c3b20 with Priority: HIGHEST for action port [ 1091.970117] env[65370]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7cba2186-6cb6-4d65-a07e-9e2e9c2c3b20 with Priority: HIGHEST for action port [ 1091.970117] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock port-7cba2186-6cb6-4d65-a07e-9e2e9c2c3b20 taken with stack trace [, , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1091.970117] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-7cba2186-6cb6-4d65-a07e-9e2e9c2c3b20" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1091.970117] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-7cba2186-6cb6-4d65-a07e-9e2e9c2c3b20" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1091.970382] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-7cba2186-6cb6-4d65-a07e-9e2e9c2c3b20" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1091.971459] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7cba2186-6cb6-4d65-a07e-9e2e9c2c3b20',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1091.988028] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('420136f3-91df-4669-b5e3-cee436aeacb9',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1092.476045] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 7cba2186-6cb6-4d65-a07e-9e2e9c2c3b20 [ 1092.476045] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1092.476045] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1092.476045] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1092.476045] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1092.476045] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1092.476045] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:7cba2186-6cb6-4d65-a07e-9e2e9c2c3b20 already deleted. [ 1092.476045] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-7cba2186-6cb6-4d65-a07e-9e2e9c2c3b20" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1092.492324] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1092.492602] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1092.492602] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1092.492794] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1092.493535] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1092.493646] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 420136f3-91df-4669-b5e3-cee436aeacb9 is going to be updated. [ 1092.530285] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1092.531338] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1092.531338] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1092.531338] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1092.531338] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1092.544055] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 420136f3-91df-4669-b5e3-cee436aeacb9 in Status: IN_PROGRESS for 2s [ 1092.785882] env[65370]: INFO networking_nsxv3.common.synchronization [req-adce2701-86db-4bd0-8982-b1b88a70abc1 req-40b5fe40-c493-4bcb-9ce1-3342a479533b tempest-ListServerFiltersTestJSON-1679580052 tempest-ListServerFiltersTestJSON-1679580052-project-member] Enqueued Resource ID: 9496f4d5-71fb-471e-bab0-2220819ba7ed with Priority: HIGHEST for action security_group_members [ 1092.786531] env[65370]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9496f4d5-71fb-471e-bab0-2220819ba7ed with Priority: HIGHEST for action security_group_members [ 1092.787267] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock member-9496f4d5-71fb-471e-bab0-2220819ba7ed taken with stack trace [, , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1092.787399] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9496f4d5-71fb-471e-bab0-2220819ba7ed" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1092.787445] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9496f4d5-71fb-471e-bab0-2220819ba7ed" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1092.787616] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9496f4d5-71fb-471e-bab0-2220819ba7ed" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1092.787767] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1092.787867] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1092.787924] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1092.788079] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1092.788160] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1092.788253] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9496f4d5-71fb-471e-bab0-2220819ba7ed',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1093.104160] env[65370]: INFO networking_nsxv3.common.synchronization [None req-9553c356-e776-488c-a385-4a62821ed064 None None] Enqueued Resource ID: 032170df-c473-45d9-8ac1-c3d0d7705097 with Priority: HIGHEST for action port [ 1093.104160] env[65370]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 032170df-c473-45d9-8ac1-c3d0d7705097 with Priority: HIGHEST for action port [ 1093.104160] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock port-032170df-c473-45d9-8ac1-c3d0d7705097 taken with stack trace [, , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1093.104160] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-032170df-c473-45d9-8ac1-c3d0d7705097" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1093.104160] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-032170df-c473-45d9-8ac1-c3d0d7705097" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1093.104160] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-032170df-c473-45d9-8ac1-c3d0d7705097" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1093.104160] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('032170df-c473-45d9-8ac1-c3d0d7705097',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1093.135990] env[65370]: INFO networking_nsxv3.common.synchronization [req-ef8d3670-edbc-4e3f-a669-17aa1cedc20c req-64c739ac-353f-4918-97e7-51583f9aaa1d tempest-DeleteServersTestJSON-1160924027 tempest-DeleteServersTestJSON-1160924027-project-member] Enqueued Resource ID: 1eaa763e-4469-4428-92d0-ba20a6c99edc with Priority: HIGHEST for action security_group_members [ 1093.135990] env[65370]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1eaa763e-4469-4428-92d0-ba20a6c99edc with Priority: HIGHEST for action security_group_members [ 1093.135990] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock member-1eaa763e-4469-4428-92d0-ba20a6c99edc taken with stack trace [, , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1093.135990] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1eaa763e-4469-4428-92d0-ba20a6c99edc" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1093.135990] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1eaa763e-4469-4428-92d0-ba20a6c99edc" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1093.136343] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1eaa763e-4469-4428-92d0-ba20a6c99edc" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1093.136843] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1093.137104] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1093.137257] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1093.137579] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1093.137761] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1093.137969] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1eaa763e-4469-4428-92d0-ba20a6c99edc',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1093.292792] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1093.292983] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1093.293081] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1093.293323] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1093.293429] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1093.296605] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1093.296605] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1093.296605] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1093.296605] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1093.296605] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1093.296605] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9496f4d5-71fb-471e-bab0-2220819ba7ed is going to be updated. [ 1093.328157] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1093.328157] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1093.328157] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1093.328157] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1093.328157] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1093.340225] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9496f4d5-71fb-471e-bab0-2220819ba7ed in Status: IN_PROGRESS for 2s [ 1093.608292] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 032170df-c473-45d9-8ac1-c3d0d7705097 [ 1093.608292] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1093.608292] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1093.608292] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1093.608292] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1093.608292] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1093.608292] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:032170df-c473-45d9-8ac1-c3d0d7705097 already deleted. [ 1093.608292] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-032170df-c473-45d9-8ac1-c3d0d7705097" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1093.643118] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1093.643118] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1093.643118] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1093.643118] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1093.643118] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1093.643422] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1093.643422] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1093.643496] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1093.643628] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1093.643696] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1093.643781] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1eaa763e-4469-4428-92d0-ba20a6c99edc is going to be updated. [ 1093.682943] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1093.683492] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1093.683615] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1093.683785] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1093.683956] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1093.699064] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1eaa763e-4469-4428-92d0-ba20a6c99edc in Status: IN_PROGRESS for 2s [ 1094.555327] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 420136f3-91df-4669-b5e3-cee436aeacb9 in Status: SUCCESS [ 1094.555597] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-420136f3-91df-4669-b5e3-cee436aeacb9" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1094.555766] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-420136f3-91df-4669-b5e3-cee436aeacb9" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1094.555977] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-420136f3-91df-4669-b5e3-cee436aeacb9" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1094.556184] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1094.556378] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1094.556447] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1094.556605] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1094.556685] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1094.556769] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-420136f3-91df-4669-b5e3-cee436aeacb9" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1094.556861] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('420136f3-91df-4669-b5e3-cee436aeacb9',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1094.570360] env[65370]: INFO networking_nsxv3.common.synchronization [None req-b6855239-4825-4f91-b370-5af706640d86 None None] Enqueued Resource ID: 815dcac1-533d-47a0-b36e-8a48a0866e84 with Priority: HIGHEST for action port [ 1094.570904] env[65370]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 815dcac1-533d-47a0-b36e-8a48a0866e84 with Priority: HIGHEST for action port [ 1094.571224] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock port-815dcac1-533d-47a0-b36e-8a48a0866e84 taken with stack trace [, , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1094.571812] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-815dcac1-533d-47a0-b36e-8a48a0866e84" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1094.571892] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-815dcac1-533d-47a0-b36e-8a48a0866e84" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1094.573520] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-815dcac1-533d-47a0-b36e-8a48a0866e84" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1094.575089] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('815dcac1-533d-47a0-b36e-8a48a0866e84',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1094.906644] env[65370]: INFO networking_nsxv3.common.synchronization [req-a93a6534-a23d-4410-b86b-7fbeb18db8bc req-7260f54b-31bf-4c47-ad36-74c441925a54 tempest-ServerActionsTestOtherA-1239332614 tempest-ServerActionsTestOtherA-1239332614-project-member] Enqueued Resource ID: 408a8a38-c326-4f43-84a2-818a13f7e124 with Priority: HIGHEST for action security_group_members [ 1094.906644] env[65370]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 408a8a38-c326-4f43-84a2-818a13f7e124 with Priority: HIGHEST for action security_group_members [ 1094.907136] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock member-408a8a38-c326-4f43-84a2-818a13f7e124 taken with stack trace [, , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1094.907424] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-408a8a38-c326-4f43-84a2-818a13f7e124" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1094.907576] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-408a8a38-c326-4f43-84a2-818a13f7e124" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1094.908220] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-408a8a38-c326-4f43-84a2-818a13f7e124" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1094.908609] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1094.908925] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1094.909096] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1094.909349] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1094.909535] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1094.909725] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('408a8a38-c326-4f43-84a2-818a13f7e124',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1095.061490] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock member-420136f3-91df-4669-b5e3-cee436aeacb9 taken with stack trace [, , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1095.061648] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-420136f3-91df-4669-b5e3-cee436aeacb9" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1095.061721] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-420136f3-91df-4669-b5e3-cee436aeacb9" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1095.061937] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-420136f3-91df-4669-b5e3-cee436aeacb9" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1095.062140] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1095.062246] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1095.062309] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1095.062461] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1095.062549] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1095.062641] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-420136f3-91df-4669-b5e3-cee436aeacb9" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1095.062786] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock member-420136f3-91df-4669-b5e3-cee436aeacb9 taken with stack trace [, , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1095.062877] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-420136f3-91df-4669-b5e3-cee436aeacb9" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1095.062937] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-420136f3-91df-4669-b5e3-cee436aeacb9" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1095.066388] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-420136f3-91df-4669-b5e3-cee436aeacb9" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1095.066554] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1095.066659] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1095.066727] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1095.067467] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1095.067620] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1095.067728] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-420136f3-91df-4669-b5e3-cee436aeacb9" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1095.067835] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('420136f3-91df-4669-b5e3-cee436aeacb9',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1095.075574] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 815dcac1-533d-47a0-b36e-8a48a0866e84 [ 1095.075780] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1095.075903] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1095.075972] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1095.076891] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1095.077035] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1095.077165] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:815dcac1-533d-47a0-b36e-8a48a0866e84 already deleted. [ 1095.077276] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-815dcac1-533d-47a0-b36e-8a48a0866e84" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1095.261749] env[65370]: DEBUG networking_nsxv3.common.locking [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Lock network-865 taken with stack trace [, , , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1095.261942] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquiring lock "network-865" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1095.262337] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquired lock "network-865" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1095.262439] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquired external semaphore "network-865" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1095.262702] env[65370]: DEBUG networking_nsxv3.common.locking [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1095.262835] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquiring lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1095.262951] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquired lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1095.263192] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquired external semaphore "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1095.263329] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Releasing lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1095.263538] env[65370]: DEBUG dogpile.cache.region [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] No value present for key: 'zone-id' {{(pid=65370) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1095.263649] env[65370]: DEBUG dogpile.lock [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] NeedRegenerationException {{(pid=65370) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1095.263752] env[65370]: DEBUG dogpile.lock [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] no value, waiting for create lock {{(pid=65370) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1095.263921] env[65370]: DEBUG dogpile.lock [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] value creation lock acquired {{(pid=65370) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1095.263979] env[65370]: DEBUG dogpile.cache.region [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] No value present for key: 'zone-id' {{(pid=65370) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1095.264072] env[65370]: DEBUG dogpile.lock [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Calling creation function for not-yet-present value {{(pid=65370) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1095.264195] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1095.283397] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1095.283568] env[65370]: DEBUG dogpile.cache.region [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=65370) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1095.283702] env[65370]: DEBUG dogpile.lock [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Released creation lock {{(pid=65370) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1095.283869] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Releasing lock "network-865" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1095.284199] env[65370]: DEBUG networking_nsxv3.common.locking [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Lock port-928d4e39-469f-42c6-9a0d-b6e950ba9197 taken with stack trace [, , , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1095.284373] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquiring lock "port-928d4e39-469f-42c6-9a0d-b6e950ba9197" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1095.284520] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquired lock "port-928d4e39-469f-42c6-9a0d-b6e950ba9197" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1095.285399] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquired external semaphore "port-928d4e39-469f-42c6-9a0d-b6e950ba9197" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1095.285399] env[65370]: DEBUG networking_nsxv3.api.rpc [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('928d4e39-469f-42c6-9a0d-b6e950ba9197',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1095.352506] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9496f4d5-71fb-471e-bab0-2220819ba7ed in Status: SUCCESS [ 1095.352733] env[65370]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9496f4d5-71fb-471e-bab0-2220819ba7ed deletion is rescheduled due to dependency. [ 1095.352845] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9496f4d5-71fb-471e-bab0-2220819ba7ed" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1095.413715] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('408a8a38-c326-4f43-84a2-818a13f7e124',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1095.570263] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 420136f3-91df-4669-b5e3-cee436aeacb9: rpc.has_security_group_logging(os_id): False [ 1095.622554] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1095.623143] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1095.623143] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1095.623143] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1095.623143] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1095.623505] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1095.623505] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1095.623595] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1095.624153] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1095.624153] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1095.624153] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1095.624153] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1095.624153] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1095.624367] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1095.624367] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1095.624823] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1095.625931] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1095.625931] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1095.625931] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1095.625931] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1095.625931] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 420136f3-91df-4669-b5e3-cee436aeacb9 is going to be updated. [ 1095.710715] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1eaa763e-4469-4428-92d0-ba20a6c99edc in Status: SUCCESS [ 1095.710901] env[65370]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1eaa763e-4469-4428-92d0-ba20a6c99edc deletion is rescheduled due to dependency. [ 1095.711064] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1eaa763e-4469-4428-92d0-ba20a6c99edc" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1095.719892] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1095.720202] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1095.720354] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1095.720646] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1095.720915] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1095.741287] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 420136f3-91df-4669-b5e3-cee436aeacb9 in Status: IN_PROGRESS for 2s [ 1095.787769] env[65370]: DEBUG networking_nsxv3.common.locking [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1095.789049] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquiring lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1095.789049] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquired lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1095.789049] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquired external semaphore "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1095.789049] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Releasing lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1095.789049] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Segment Port 928d4e39-469f-42c6-9a0d-b6e950ba9197 not found, creating... [ 1095.789270] env[65370]: DEBUG networking_nsxv3.common.locking [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1095.789340] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquiring lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1095.789424] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquired lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1095.789665] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquired external semaphore "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1095.789804] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Releasing lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1095.790644] env[65370]: DEBUG networking_nsxv3.common.locking [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1095.790807] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquiring lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1095.790951] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquired lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1095.791202] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquired external semaphore "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1095.791343] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Releasing lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1095.791504] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Resource: SegmentPort with ID: 928d4e39-469f-42c6-9a0d-b6e950ba9197 is going to be created. [ 1095.820472] env[65370]: DEBUG networking_nsxv3.common.locking [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1095.820930] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquiring lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1095.820930] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquired lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1095.820930] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquired external semaphore "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1095.821131] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Releasing lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1095.822282] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Releasing lock "port-928d4e39-469f-42c6-9a0d-b6e950ba9197" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1095.915447] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('408a8a38-c326-4f43-84a2-818a13f7e124',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1096.420182] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1096.421243] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1096.421243] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1096.421243] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1096.421243] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1096.421243] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 408a8a38-c326-4f43-84a2-818a13f7e124 is going to be updated. [ 1096.453031] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1096.453031] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1096.453031] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1096.453249] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1096.453477] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1096.464858] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 408a8a38-c326-4f43-84a2-818a13f7e124 in Status: IN_PROGRESS for 2s [ 1096.613487] env[65370]: INFO networking_nsxv3.common.synchronization [req-a93a6534-a23d-4410-b86b-7fbeb18db8bc req-1575cb59-295d-476a-9e7e-8c7802c2bb59 service nova] Enqueued Resource ID: 408a8a38-c326-4f43-84a2-818a13f7e124 with Priority: HIGHEST for action security_group_rules [ 1096.613681] env[65370]: INFO networking_nsxv3.common.synchronization [req-a93a6534-a23d-4410-b86b-7fbeb18db8bc req-1575cb59-295d-476a-9e7e-8c7802c2bb59 service nova] Enqueued Resource ID: 408a8a38-c326-4f43-84a2-818a13f7e124 with Priority: HIGHEST for action security_group_members [ 1096.613795] env[65370]: INFO networking_nsxv3.common.synchronization [req-a93a6534-a23d-4410-b86b-7fbeb18db8bc req-1575cb59-295d-476a-9e7e-8c7802c2bb59 service nova] Enqueued Resource ID: 928d4e39-469f-42c6-9a0d-b6e950ba9197 with Priority: HIGHEST for action port [ 1096.614394] env[65370]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 408a8a38-c326-4f43-84a2-818a13f7e124 with Priority: HIGHEST for action security_group_rules [ 1096.614535] env[65370]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 408a8a38-c326-4f43-84a2-818a13f7e124 with Priority: HIGHEST for action security_group_members [ 1096.614635] env[65370]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 928d4e39-469f-42c6-9a0d-b6e950ba9197 with Priority: HIGHEST for action port [ 1096.615135] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock rules-408a8a38-c326-4f43-84a2-818a13f7e124 taken with stack trace [, , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1096.615135] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-408a8a38-c326-4f43-84a2-818a13f7e124" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1096.615238] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-408a8a38-c326-4f43-84a2-818a13f7e124" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1096.615501] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-408a8a38-c326-4f43-84a2-818a13f7e124" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1096.615501] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('408a8a38-c326-4f43-84a2-818a13f7e124',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1096.616713] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock member-408a8a38-c326-4f43-84a2-818a13f7e124 taken with stack trace [, , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1096.616938] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-408a8a38-c326-4f43-84a2-818a13f7e124" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1096.617306] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock port-928d4e39-469f-42c6-9a0d-b6e950ba9197 taken with stack trace [, , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1096.617451] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-928d4e39-469f-42c6-9a0d-b6e950ba9197" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1096.617535] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-928d4e39-469f-42c6-9a0d-b6e950ba9197" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1096.617746] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-928d4e39-469f-42c6-9a0d-b6e950ba9197" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1096.617865] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('928d4e39-469f-42c6-9a0d-b6e950ba9197',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1097.120361] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock member-408a8a38-c326-4f43-84a2-818a13f7e124 taken with stack trace [, , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1097.120727] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-408a8a38-c326-4f43-84a2-818a13f7e124" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1097.123764] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 928d4e39-469f-42c6-9a0d-b6e950ba9197 with status ACTIVE [ 1097.123764] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1097.123917] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1097.123917] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1097.124131] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1097.124223] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1097.124405] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1097.124537] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1097.124571] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1097.124713] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1097.124768] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1097.124945] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1097.125044] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1097.125135] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1097.125240] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1097.125316] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1097.125394] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 928d4e39-469f-42c6-9a0d-b6e950ba9197 is going to be updated. [ 1097.150998] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1097.151231] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1097.151231] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1097.151427] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1097.151563] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1097.151735] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-928d4e39-469f-42c6-9a0d-b6e950ba9197" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1097.761633] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 420136f3-91df-4669-b5e3-cee436aeacb9 in Status: SUCCESS [ 1097.761633] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-420136f3-91df-4669-b5e3-cee436aeacb9" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1098.206372] env[65370]: INFO networking_nsxv3.common.synchronization [req-449d2ec9-3658-488e-bf1c-c54871939bcf req-4c9dc139-8240-4287-a4b0-389024cd9317 tempest-ServerMetadataNegativeTestJSON-284297633 tempest-ServerMetadataNegativeTestJSON-284297633-project-member] Enqueued Resource ID: 73fdcc5c-e9b7-4038-bdaa-9396e2912ed3 with Priority: HIGHEST for action security_group_members [ 1098.206372] env[65370]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 73fdcc5c-e9b7-4038-bdaa-9396e2912ed3 with Priority: HIGHEST for action security_group_members [ 1098.206712] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock member-73fdcc5c-e9b7-4038-bdaa-9396e2912ed3 taken with stack trace [, , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1098.206712] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-73fdcc5c-e9b7-4038-bdaa-9396e2912ed3" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1098.206712] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-73fdcc5c-e9b7-4038-bdaa-9396e2912ed3" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1098.206891] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-73fdcc5c-e9b7-4038-bdaa-9396e2912ed3" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1098.207018] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1098.207129] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1098.207194] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1098.207358] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1098.207444] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1098.207539] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('73fdcc5c-e9b7-4038-bdaa-9396e2912ed3',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1098.477189] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 408a8a38-c326-4f43-84a2-818a13f7e124 in Status: SUCCESS [ 1098.477353] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-408a8a38-c326-4f43-84a2-818a13f7e124" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1098.477478] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-408a8a38-c326-4f43-84a2-818a13f7e124" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1098.477672] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-408a8a38-c326-4f43-84a2-818a13f7e124" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1098.477871] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1098.478017] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1098.478115] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1098.478258] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1098.478341] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1098.478505] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('408a8a38-c326-4f43-84a2-818a13f7e124',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1098.709929] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1098.710173] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1098.710240] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1098.710421] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1098.710515] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1098.710747] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1098.710882] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1098.710947] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1098.711107] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1098.711191] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1098.711275] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 73fdcc5c-e9b7-4038-bdaa-9396e2912ed3 is going to be updated. [ 1098.752601] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1098.752838] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1098.752992] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1098.753273] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1098.753504] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1098.763165] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 73fdcc5c-e9b7-4038-bdaa-9396e2912ed3 in Status: IN_PROGRESS for 2s [ 1098.982015] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('408a8a38-c326-4f43-84a2-818a13f7e124',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1099.485736] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('408a8a38-c326-4f43-84a2-818a13f7e124',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1099.987637] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1099.987637] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1099.987801] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1099.987917] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1099.988019] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1099.988118] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 408a8a38-c326-4f43-84a2-818a13f7e124 is going to be updated. [ 1100.019570] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1100.019768] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1100.019768] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1100.019976] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1100.020136] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1100.028254] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 408a8a38-c326-4f43-84a2-818a13f7e124 in Status: IN_PROGRESS for 2s [ 1100.773177] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 73fdcc5c-e9b7-4038-bdaa-9396e2912ed3 in Status: SUCCESS [ 1100.773463] env[65370]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 73fdcc5c-e9b7-4038-bdaa-9396e2912ed3 deletion is rescheduled due to dependency. [ 1100.773463] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-73fdcc5c-e9b7-4038-bdaa-9396e2912ed3" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1102.041083] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 408a8a38-c326-4f43-84a2-818a13f7e124 in Status: SUCCESS [ 1102.041389] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-408a8a38-c326-4f43-84a2-818a13f7e124" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1102.041547] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-408a8a38-c326-4f43-84a2-818a13f7e124" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1102.041721] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-408a8a38-c326-4f43-84a2-818a13f7e124" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1102.041909] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1102.042046] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1102.042110] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1102.042263] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1102.042367] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1102.042465] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-408a8a38-c326-4f43-84a2-818a13f7e124" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1102.042557] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('408a8a38-c326-4f43-84a2-818a13f7e124',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1102.547111] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('408a8a38-c326-4f43-84a2-818a13f7e124',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1103.049482] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 408a8a38-c326-4f43-84a2-818a13f7e124: rpc.has_security_group_logging(os_id): False [ 1103.075531] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1103.075531] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1103.075531] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1103.075827] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1103.075827] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1103.076113] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1103.076375] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1103.076455] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1103.077026] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1103.077026] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1103.077026] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 408a8a38-c326-4f43-84a2-818a13f7e124 is going to be updated. [ 1103.162258] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1103.162258] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1103.162258] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1103.162258] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1103.162413] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1103.180713] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 408a8a38-c326-4f43-84a2-818a13f7e124 in Status: IN_PROGRESS for 2s [ 1103.208136] env[65370]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1103.208205] env[65370]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=1 [ 1105.197615] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 408a8a38-c326-4f43-84a2-818a13f7e124 in Status: SUCCESS [ 1105.197906] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-408a8a38-c326-4f43-84a2-818a13f7e124" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1105.456315] env[65370]: INFO networking_nsxv3.common.synchronization [req-fa82c673-0082-4868-8a49-86845353e3ec req-266f0914-c34f-4670-b54b-a56909c93495 tempest-ServerDiskConfigTestJSON-902849627 tempest-ServerDiskConfigTestJSON-902849627-project-member] Enqueued Resource ID: 420136f3-91df-4669-b5e3-cee436aeacb9 with Priority: HIGHEST for action security_group_members [ 1105.456519] env[65370]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 420136f3-91df-4669-b5e3-cee436aeacb9 with Priority: HIGHEST for action security_group_members [ 1105.456777] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock member-420136f3-91df-4669-b5e3-cee436aeacb9 taken with stack trace [, , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1105.456905] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-420136f3-91df-4669-b5e3-cee436aeacb9" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1105.456966] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-420136f3-91df-4669-b5e3-cee436aeacb9" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1105.457979] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-420136f3-91df-4669-b5e3-cee436aeacb9" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1105.457979] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1105.457979] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1105.457979] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1105.457979] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1105.458234] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1105.458234] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('420136f3-91df-4669-b5e3-cee436aeacb9',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1105.960849] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1105.961084] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1105.961197] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1105.961551] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1105.961670] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1105.961949] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1105.962096] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1105.962184] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1105.962403] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1105.962514] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1105.962604] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 420136f3-91df-4669-b5e3-cee436aeacb9 is going to be updated. [ 1105.990988] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1105.991182] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1105.991245] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1105.991426] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1105.991569] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1106.000607] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 420136f3-91df-4669-b5e3-cee436aeacb9 in Status: IN_PROGRESS for 2s [ 1106.473503] env[65370]: INFO networking_nsxv3.common.synchronization [req-99f5cbbf-2dff-46aa-aae4-fcd6b17f66ab req-da711411-c39d-4ab4-b1f6-9fa3ac38827b tempest-ServersNegativeTestMultiTenantJSON-1552301997 tempest-ServersNegativeTestMultiTenantJSON-1552301997-project-member] Enqueued Resource ID: 5f21eadf-115c-453d-a18a-ea8d6e583522 with Priority: HIGHEST for action security_group_members [ 1106.474085] env[65370]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5f21eadf-115c-453d-a18a-ea8d6e583522 with Priority: HIGHEST for action security_group_members [ 1106.474414] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock member-5f21eadf-115c-453d-a18a-ea8d6e583522 taken with stack trace [, , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1106.474542] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5f21eadf-115c-453d-a18a-ea8d6e583522" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1106.474605] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5f21eadf-115c-453d-a18a-ea8d6e583522" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1106.474900] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5f21eadf-115c-453d-a18a-ea8d6e583522" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1106.475136] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1106.475502] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1106.475502] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1106.475596] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1106.475665] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1106.475750] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5f21eadf-115c-453d-a18a-ea8d6e583522',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1106.838881] env[65370]: DEBUG networking_nsxv3.common.locking [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Lock network-545 taken with stack trace [, , , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1106.839124] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquiring lock "network-545" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1106.839248] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquired lock "network-545" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1106.839593] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquired external semaphore "network-545" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1106.840056] env[65370]: DEBUG networking_nsxv3.common.locking [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1106.840233] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquiring lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1106.840348] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquired lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1106.840591] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquired external semaphore "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1106.840745] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Releasing lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1106.840944] env[65370]: DEBUG dogpile.cache.region [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] No value present for key: 'zone-id' {{(pid=65370) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1106.841077] env[65370]: DEBUG dogpile.lock [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] NeedRegenerationException {{(pid=65370) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1106.841186] env[65370]: DEBUG dogpile.lock [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] no value, waiting for create lock {{(pid=65370) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1106.841291] env[65370]: DEBUG dogpile.lock [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] value creation lock acquired {{(pid=65370) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1106.841398] env[65370]: DEBUG dogpile.cache.region [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] No value present for key: 'zone-id' {{(pid=65370) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1106.841506] env[65370]: DEBUG dogpile.lock [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Calling creation function for not-yet-present value {{(pid=65370) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1106.841640] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1106.864016] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1106.864276] env[65370]: DEBUG dogpile.cache.region [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=65370) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1106.864357] env[65370]: DEBUG dogpile.lock [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Released creation lock {{(pid=65370) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1106.864533] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Releasing lock "network-545" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1106.864857] env[65370]: DEBUG networking_nsxv3.common.locking [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Lock port-58536a4e-6bd7-4977-a9a8-519654f29c5f taken with stack trace [, , , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1106.865033] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquiring lock "port-58536a4e-6bd7-4977-a9a8-519654f29c5f" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1106.865153] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquired lock "port-58536a4e-6bd7-4977-a9a8-519654f29c5f" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1106.865473] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquired external semaphore "port-58536a4e-6bd7-4977-a9a8-519654f29c5f" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1106.865608] env[65370]: DEBUG networking_nsxv3.api.rpc [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('58536a4e-6bd7-4977-a9a8-519654f29c5f',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1106.978017] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1106.978204] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1106.978253] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1106.978487] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1106.978638] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1106.978849] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1106.978960] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1106.979034] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1106.979207] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1106.979286] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1106.979370] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5f21eadf-115c-453d-a18a-ea8d6e583522 already deleted. [ 1106.979451] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5f21eadf-115c-453d-a18a-ea8d6e583522" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1107.368588] env[65370]: DEBUG networking_nsxv3.common.locking [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1107.368856] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquiring lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1107.368980] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquired lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1107.370095] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquired external semaphore "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1107.370095] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Releasing lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1107.370095] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Segment Port 58536a4e-6bd7-4977-a9a8-519654f29c5f not found, creating... [ 1107.370095] env[65370]: DEBUG networking_nsxv3.common.locking [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1107.370095] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquiring lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1107.370095] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquired lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1107.370439] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquired external semaphore "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1107.370439] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Releasing lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1107.370735] env[65370]: DEBUG networking_nsxv3.common.locking [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1107.370814] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquiring lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1107.370924] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquired lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1107.371199] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquired external semaphore "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1107.371267] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Releasing lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1107.371374] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Resource: SegmentPort with ID: 58536a4e-6bd7-4977-a9a8-519654f29c5f is going to be created. [ 1107.394696] env[65370]: DEBUG networking_nsxv3.common.locking [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1107.394933] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquiring lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1107.395049] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquired lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1107.395336] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquired external semaphore "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1107.395568] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Releasing lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1107.395794] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Releasing lock "port-58536a4e-6bd7-4977-a9a8-519654f29c5f" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1108.011608] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 420136f3-91df-4669-b5e3-cee436aeacb9 in Status: SUCCESS [ 1108.011999] env[65370]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 420136f3-91df-4669-b5e3-cee436aeacb9 deletion is rescheduled due to dependency. [ 1108.011999] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-420136f3-91df-4669-b5e3-cee436aeacb9" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1108.110898] env[65370]: INFO networking_nsxv3.common.synchronization [req-99f5cbbf-2dff-46aa-aae4-fcd6b17f66ab req-54077bbe-0133-4945-8a73-29190f8bb01e service nova] Enqueued Resource ID: 5f21eadf-115c-453d-a18a-ea8d6e583522 with Priority: HIGHEST for action security_group_rules [ 1108.110978] env[65370]: INFO networking_nsxv3.common.synchronization [req-99f5cbbf-2dff-46aa-aae4-fcd6b17f66ab req-54077bbe-0133-4945-8a73-29190f8bb01e service nova] Enqueued Resource ID: 5f21eadf-115c-453d-a18a-ea8d6e583522 with Priority: HIGHEST for action security_group_members [ 1108.111229] env[65370]: INFO networking_nsxv3.common.synchronization [req-99f5cbbf-2dff-46aa-aae4-fcd6b17f66ab req-54077bbe-0133-4945-8a73-29190f8bb01e service nova] Enqueued Resource ID: 58536a4e-6bd7-4977-a9a8-519654f29c5f with Priority: HIGHEST for action port [ 1108.111686] env[65370]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5f21eadf-115c-453d-a18a-ea8d6e583522 with Priority: HIGHEST for action security_group_rules [ 1108.111834] env[65370]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5f21eadf-115c-453d-a18a-ea8d6e583522 with Priority: HIGHEST for action security_group_members [ 1108.111992] env[65370]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 58536a4e-6bd7-4977-a9a8-519654f29c5f with Priority: HIGHEST for action port [ 1108.112350] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock rules-5f21eadf-115c-453d-a18a-ea8d6e583522 taken with stack trace [, , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1108.112504] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-5f21eadf-115c-453d-a18a-ea8d6e583522" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1108.112683] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-5f21eadf-115c-453d-a18a-ea8d6e583522" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1108.113210] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-5f21eadf-115c-453d-a18a-ea8d6e583522" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1108.113210] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('5f21eadf-115c-453d-a18a-ea8d6e583522',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1108.114711] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock member-5f21eadf-115c-453d-a18a-ea8d6e583522 taken with stack trace [, , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1108.114711] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5f21eadf-115c-453d-a18a-ea8d6e583522" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1108.114711] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5f21eadf-115c-453d-a18a-ea8d6e583522" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1108.114711] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5f21eadf-115c-453d-a18a-ea8d6e583522" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1108.114711] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1108.114711] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1108.114711] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1108.114950] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1108.114950] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1108.114950] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5f21eadf-115c-453d-a18a-ea8d6e583522',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1108.117365] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock port-58536a4e-6bd7-4977-a9a8-519654f29c5f taken with stack trace [, , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1108.117528] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-58536a4e-6bd7-4977-a9a8-519654f29c5f" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1108.117643] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-58536a4e-6bd7-4977-a9a8-519654f29c5f" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1108.117907] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-58536a4e-6bd7-4977-a9a8-519654f29c5f" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1108.118026] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('58536a4e-6bd7-4977-a9a8-519654f29c5f',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1108.619465] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock member-5f21eadf-115c-453d-a18a-ea8d6e583522 taken with stack trace [, , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1108.619714] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5f21eadf-115c-453d-a18a-ea8d6e583522" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1108.621027] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 58536a4e-6bd7-4977-a9a8-519654f29c5f with status ACTIVE [ 1108.621221] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1108.621349] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1108.621430] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1108.621644] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1108.621734] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1108.621996] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1108.621996] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1108.622113] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1108.622237] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1108.623108] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1108.623108] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1108.623108] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1108.623108] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1108.623108] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1108.623108] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1108.623108] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 58536a4e-6bd7-4977-a9a8-519654f29c5f is going to be updated. [ 1108.623984] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('5f21eadf-115c-453d-a18a-ea8d6e583522',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1108.645918] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1108.646118] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1108.646255] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1108.646486] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1108.646635] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1108.646953] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-58536a4e-6bd7-4977-a9a8-519654f29c5f" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1109.127376] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('5f21eadf-115c-453d-a18a-ea8d6e583522',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1109.629200] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1109.629632] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1109.629920] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1109.630157] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1109.630292] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1109.630457] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5f21eadf-115c-453d-a18a-ea8d6e583522 is going to be created. [ 1109.658424] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1109.658660] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1109.658737] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1109.659075] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1109.659419] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1109.670334] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5f21eadf-115c-453d-a18a-ea8d6e583522 in Status: UNINITIALIZED for 2s [ 1110.535942] env[65370]: INFO networking_nsxv3.common.synchronization [req-149f4ce9-cd79-42a1-9ad5-b22fe64515c0 req-e062678f-714d-4b04-9cfb-d0339df3cd11 tempest-ServerActionsTestOtherB-1099767447 tempest-ServerActionsTestOtherB-1099767447-project-member] Enqueued Resource ID: 2011abd7-ba10-4aae-84fb-1b1bfbd238fa with Priority: HIGHEST for action security_group_members [ 1110.536591] env[65370]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2011abd7-ba10-4aae-84fb-1b1bfbd238fa with Priority: HIGHEST for action security_group_members [ 1110.537034] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock member-2011abd7-ba10-4aae-84fb-1b1bfbd238fa taken with stack trace [, , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1110.537100] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2011abd7-ba10-4aae-84fb-1b1bfbd238fa" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1110.537133] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2011abd7-ba10-4aae-84fb-1b1bfbd238fa" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1110.537316] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2011abd7-ba10-4aae-84fb-1b1bfbd238fa" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1110.537466] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1110.537561] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1110.537622] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1110.537781] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1110.537866] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1110.537957] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2011abd7-ba10-4aae-84fb-1b1bfbd238fa',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1111.039987] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1111.040196] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1111.040269] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1111.040452] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1111.065944] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1111.066282] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1111.066410] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1111.066479] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1111.066705] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1111.066784] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1111.066875] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2011abd7-ba10-4aae-84fb-1b1bfbd238fa is going to be updated. [ 1111.093281] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1111.093529] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1111.093529] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1111.093870] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1111.094082] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1111.103172] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2011abd7-ba10-4aae-84fb-1b1bfbd238fa in Status: IN_PROGRESS for 2s [ 1111.679800] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5f21eadf-115c-453d-a18a-ea8d6e583522 in Status: SUCCESS [ 1111.680144] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5f21eadf-115c-453d-a18a-ea8d6e583522" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1111.680329] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5f21eadf-115c-453d-a18a-ea8d6e583522" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1111.680548] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5f21eadf-115c-453d-a18a-ea8d6e583522" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1111.680741] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1111.680857] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1111.680921] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1111.681090] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1111.681170] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1111.681253] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5f21eadf-115c-453d-a18a-ea8d6e583522" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1111.681343] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('5f21eadf-115c-453d-a18a-ea8d6e583522',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1112.186849] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock member-5f21eadf-115c-453d-a18a-ea8d6e583522 taken with stack trace [, , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1112.186849] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5f21eadf-115c-453d-a18a-ea8d6e583522" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1112.186960] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5f21eadf-115c-453d-a18a-ea8d6e583522" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1112.187137] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5f21eadf-115c-453d-a18a-ea8d6e583522" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1112.187313] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1112.187616] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1112.187616] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1112.187616] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1112.187823] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1112.187823] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5f21eadf-115c-453d-a18a-ea8d6e583522" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1112.187947] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock member-5f21eadf-115c-453d-a18a-ea8d6e583522 taken with stack trace [, , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1112.188054] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5f21eadf-115c-453d-a18a-ea8d6e583522" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1112.188116] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5f21eadf-115c-453d-a18a-ea8d6e583522" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1112.188260] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5f21eadf-115c-453d-a18a-ea8d6e583522" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1112.188396] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1112.188486] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1112.188546] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1112.188734] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1112.188811] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1112.188893] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5f21eadf-115c-453d-a18a-ea8d6e583522" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1112.188983] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('5f21eadf-115c-453d-a18a-ea8d6e583522',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1112.691105] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 5f21eadf-115c-453d-a18a-ea8d6e583522: rpc.has_security_group_logging(os_id): False [ 1112.708953] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1112.709186] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1112.709273] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1112.709451] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1112.709564] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1112.709877] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1112.710030] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1112.710077] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1112.710270] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1112.710371] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1112.710579] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1112.710696] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1112.710784] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1112.710979] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1112.711080] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1112.711322] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1112.711469] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1112.711562] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1112.711720] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1112.711832] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1112.711937] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 5f21eadf-115c-453d-a18a-ea8d6e583522 is going to be created. [ 1112.778799] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1112.778799] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1112.778799] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1112.779056] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1112.779089] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1112.790398] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 5f21eadf-115c-453d-a18a-ea8d6e583522 in Status: IN_PROGRESS for 2s [ 1113.113664] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2011abd7-ba10-4aae-84fb-1b1bfbd238fa in Status: SUCCESS [ 1113.113866] env[65370]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2011abd7-ba10-4aae-84fb-1b1bfbd238fa deletion is rescheduled due to dependency. [ 1113.113992] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2011abd7-ba10-4aae-84fb-1b1bfbd238fa" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1114.803851] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 5f21eadf-115c-453d-a18a-ea8d6e583522 in Status: SUCCESS [ 1114.803851] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-5f21eadf-115c-453d-a18a-ea8d6e583522" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1115.198064] env[65370]: INFO networking_nsxv3.common.synchronization [req-d94ff06f-b865-4062-8fd7-fc057bd1ec72 req-4f00f33c-5fea-424a-adb5-15376d44c493 tempest-AttachVolumeNegativeTest-719365731 tempest-AttachVolumeNegativeTest-719365731-project-member] Enqueued Resource ID: ff03ba53-594b-4bc2-b51c-5c04df76011d with Priority: HIGHEST for action security_group_members [ 1115.198839] env[65370]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ff03ba53-594b-4bc2-b51c-5c04df76011d with Priority: HIGHEST for action security_group_members [ 1115.199286] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock member-ff03ba53-594b-4bc2-b51c-5c04df76011d taken with stack trace [, , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1115.199463] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ff03ba53-594b-4bc2-b51c-5c04df76011d" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1115.199564] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ff03ba53-594b-4bc2-b51c-5c04df76011d" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1115.199862] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ff03ba53-594b-4bc2-b51c-5c04df76011d" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1115.200103] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1115.200274] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1115.200375] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1115.200604] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1115.200741] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1115.200883] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ff03ba53-594b-4bc2-b51c-5c04df76011d',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1115.706190] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1115.706190] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1115.706190] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1115.706190] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1115.706190] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1115.706190] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1115.706562] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1115.706562] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1115.706562] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1115.706650] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1115.706715] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ff03ba53-594b-4bc2-b51c-5c04df76011d is going to be updated. [ 1115.739861] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1115.740413] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1115.740413] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1115.740633] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1115.740774] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1115.757786] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ff03ba53-594b-4bc2-b51c-5c04df76011d in Status: IN_PROGRESS for 2s [ 1115.827061] env[65370]: INFO networking_nsxv3.common.synchronization [req-0e782e8f-c63d-49e5-a7b6-6ddbdbeb22b8 req-f630bbe7-048a-4de1-8e9c-acc492a2ed60 tempest-DeleteServersTestJSON-1160924027 tempest-DeleteServersTestJSON-1160924027-project-member] Enqueued Resource ID: 1eaa763e-4469-4428-92d0-ba20a6c99edc with Priority: HIGHEST for action security_group_members [ 1115.828384] env[65370]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1eaa763e-4469-4428-92d0-ba20a6c99edc with Priority: HIGHEST for action security_group_members [ 1115.828384] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock member-1eaa763e-4469-4428-92d0-ba20a6c99edc taken with stack trace [, , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1115.828560] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1eaa763e-4469-4428-92d0-ba20a6c99edc" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1115.828560] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1eaa763e-4469-4428-92d0-ba20a6c99edc" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1115.828774] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1eaa763e-4469-4428-92d0-ba20a6c99edc" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1115.828999] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1115.829304] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1115.829376] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1115.829661] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1115.829762] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1115.829848] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1eaa763e-4469-4428-92d0-ba20a6c99edc',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1116.209228] env[65370]: DEBUG networking_nsxv3.common.locking [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Lock network-712 taken with stack trace [, , , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1116.209228] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquiring lock "network-712" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1116.209228] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquired lock "network-712" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1116.209228] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquired external semaphore "network-712" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1116.209228] env[65370]: DEBUG networking_nsxv3.common.locking [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1116.209549] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquiring lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1116.209797] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquired lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1116.210123] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquired external semaphore "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1116.210380] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Releasing lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1116.210678] env[65370]: DEBUG dogpile.cache.region [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] No value present for key: 'zone-id' {{(pid=65370) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1116.210902] env[65370]: DEBUG dogpile.lock [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] NeedRegenerationException {{(pid=65370) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1116.211131] env[65370]: DEBUG dogpile.lock [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] no value, waiting for create lock {{(pid=65370) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1116.211351] env[65370]: DEBUG dogpile.lock [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] value creation lock acquired {{(pid=65370) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1116.211552] env[65370]: DEBUG dogpile.cache.region [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] No value present for key: 'zone-id' {{(pid=65370) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1116.211809] env[65370]: DEBUG dogpile.lock [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Calling creation function for not-yet-present value {{(pid=65370) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1116.212051] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1116.233102] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1116.235018] env[65370]: DEBUG dogpile.cache.region [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=65370) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1116.235018] env[65370]: DEBUG dogpile.lock [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Released creation lock {{(pid=65370) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1116.235018] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Releasing lock "network-712" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1116.235018] env[65370]: DEBUG networking_nsxv3.common.locking [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Lock port-2df76479-778f-42b3-ad3a-57b09179ab74 taken with stack trace [, , , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1116.235018] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquiring lock "port-2df76479-778f-42b3-ad3a-57b09179ab74" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1116.235018] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquired lock "port-2df76479-778f-42b3-ad3a-57b09179ab74" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1116.235018] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquired external semaphore "port-2df76479-778f-42b3-ad3a-57b09179ab74" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1116.235018] env[65370]: DEBUG networking_nsxv3.api.rpc [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2df76479-778f-42b3-ad3a-57b09179ab74',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1116.335322] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1116.335322] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1116.335503] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1116.335860] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1116.335860] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1116.335860] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1116.336024] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1116.336024] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1116.336395] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1116.336395] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1116.336395] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1eaa763e-4469-4428-92d0-ba20a6c99edc is going to be updated. [ 1116.366887] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1116.367093] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1116.367510] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1116.367510] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1116.367670] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1116.382694] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1eaa763e-4469-4428-92d0-ba20a6c99edc in Status: IN_PROGRESS for 2s [ 1116.737721] env[65370]: DEBUG networking_nsxv3.common.locking [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1116.737966] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquiring lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1116.738106] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquired lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1116.738403] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquired external semaphore "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1116.738757] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Releasing lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1116.738757] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Segment Port 2df76479-778f-42b3-ad3a-57b09179ab74 not found, creating... [ 1116.739029] env[65370]: DEBUG networking_nsxv3.common.locking [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1116.739191] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquiring lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1116.739303] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquired lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1116.739537] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquired external semaphore "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1116.739676] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Releasing lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1116.739994] env[65370]: DEBUG networking_nsxv3.common.locking [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1116.740173] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquiring lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1116.740289] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquired lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1116.740497] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquired external semaphore "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1116.740629] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Releasing lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1116.741576] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Resource: SegmentPort with ID: 2df76479-778f-42b3-ad3a-57b09179ab74 is going to be created. [ 1116.765420] env[65370]: DEBUG networking_nsxv3.common.locking [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1116.765626] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquiring lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1116.765746] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquired lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1116.766043] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquired external semaphore "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1116.766293] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Releasing lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1116.766604] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Releasing lock "port-2df76479-778f-42b3-ad3a-57b09179ab74" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1117.532686] env[65370]: INFO networking_nsxv3.common.synchronization [req-0e782e8f-c63d-49e5-a7b6-6ddbdbeb22b8 req-e4f911dc-1160-4880-90a4-2e094bf0fc27 service nova] Enqueued Resource ID: 1eaa763e-4469-4428-92d0-ba20a6c99edc with Priority: HIGHEST for action security_group_rules [ 1117.532964] env[65370]: INFO networking_nsxv3.common.synchronization [req-0e782e8f-c63d-49e5-a7b6-6ddbdbeb22b8 req-e4f911dc-1160-4880-90a4-2e094bf0fc27 service nova] Enqueued Resource ID: 1eaa763e-4469-4428-92d0-ba20a6c99edc with Priority: HIGHEST for action security_group_members [ 1117.533081] env[65370]: INFO networking_nsxv3.common.synchronization [req-0e782e8f-c63d-49e5-a7b6-6ddbdbeb22b8 req-e4f911dc-1160-4880-90a4-2e094bf0fc27 service nova] Enqueued Resource ID: 2df76479-778f-42b3-ad3a-57b09179ab74 with Priority: HIGHEST for action port [ 1117.533576] env[65370]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1eaa763e-4469-4428-92d0-ba20a6c99edc with Priority: HIGHEST for action security_group_rules [ 1117.533709] env[65370]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1eaa763e-4469-4428-92d0-ba20a6c99edc with Priority: HIGHEST for action security_group_members [ 1117.533805] env[65370]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2df76479-778f-42b3-ad3a-57b09179ab74 with Priority: HIGHEST for action port [ 1117.534116] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock rules-1eaa763e-4469-4428-92d0-ba20a6c99edc taken with stack trace [, , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1117.534235] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-1eaa763e-4469-4428-92d0-ba20a6c99edc" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1117.534301] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-1eaa763e-4469-4428-92d0-ba20a6c99edc" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1117.534486] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-1eaa763e-4469-4428-92d0-ba20a6c99edc" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1117.534566] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('1eaa763e-4469-4428-92d0-ba20a6c99edc',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1117.535381] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock member-1eaa763e-4469-4428-92d0-ba20a6c99edc taken with stack trace [, , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1117.535474] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1eaa763e-4469-4428-92d0-ba20a6c99edc" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1117.535658] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock port-2df76479-778f-42b3-ad3a-57b09179ab74 taken with stack trace [, , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1117.535759] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-2df76479-778f-42b3-ad3a-57b09179ab74" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1117.535821] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-2df76479-778f-42b3-ad3a-57b09179ab74" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1117.536244] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-2df76479-778f-42b3-ad3a-57b09179ab74" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1117.536244] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2df76479-778f-42b3-ad3a-57b09179ab74',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1117.768162] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ff03ba53-594b-4bc2-b51c-5c04df76011d in Status: SUCCESS [ 1117.768368] env[65370]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ff03ba53-594b-4bc2-b51c-5c04df76011d deletion is rescheduled due to dependency. [ 1117.768489] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ff03ba53-594b-4bc2-b51c-5c04df76011d" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1117.840474] env[65370]: INFO networking_nsxv3.common.synchronization [req-b47950a9-8e37-4ae7-bbc7-442a209f0f4d req-4c02244a-0da7-4632-add9-66e6a778711b tempest-AttachInterfacesTestJSON-315686657 tempest-AttachInterfacesTestJSON-315686657-project-member] Enqueued Resource ID: 826ed52a-9222-434f-a4f9-e83fd60a5345 with Priority: HIGHEST for action security_group_members [ 1117.841060] env[65370]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 826ed52a-9222-434f-a4f9-e83fd60a5345 with Priority: HIGHEST for action security_group_members [ 1117.841597] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock member-826ed52a-9222-434f-a4f9-e83fd60a5345 taken with stack trace [, , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1117.841836] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-826ed52a-9222-434f-a4f9-e83fd60a5345" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1117.842642] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-826ed52a-9222-434f-a4f9-e83fd60a5345" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1117.842857] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-826ed52a-9222-434f-a4f9-e83fd60a5345" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1117.843068] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1117.843210] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1117.843290] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1117.843478] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1117.843589] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1117.843708] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('826ed52a-9222-434f-a4f9-e83fd60a5345',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1118.038353] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock member-1eaa763e-4469-4428-92d0-ba20a6c99edc taken with stack trace [, , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1118.038538] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1eaa763e-4469-4428-92d0-ba20a6c99edc" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1118.038784] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 2df76479-778f-42b3-ad3a-57b09179ab74 with status ACTIVE [ 1118.038996] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1118.039146] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1118.039234] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1118.039482] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1118.039595] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1118.039823] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1118.039933] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1118.040022] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1118.040271] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1118.040330] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1118.040535] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1118.040635] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1118.040712] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1118.040888] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1118.042246] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1118.042246] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 2df76479-778f-42b3-ad3a-57b09179ab74 is going to be updated. [ 1118.062422] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1118.062618] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1118.062686] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1118.062840] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1118.063468] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1118.064175] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-2df76479-778f-42b3-ad3a-57b09179ab74" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1118.190271] env[65370]: DEBUG networking_nsxv3.common.locking [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Lock network-309 taken with stack trace [, , , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1118.190271] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquiring lock "network-309" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1118.190493] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquired lock "network-309" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1118.190639] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquired external semaphore "network-309" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1118.190890] env[65370]: DEBUG networking_nsxv3.common.locking [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1118.191064] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquiring lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1118.191244] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquired lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1118.191484] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquired external semaphore "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1118.191689] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Releasing lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1118.191937] env[65370]: DEBUG dogpile.cache.region [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] No value present for key: 'zone-id' {{(pid=65370) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1118.192135] env[65370]: DEBUG dogpile.lock [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] NeedRegenerationException {{(pid=65370) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1118.192262] env[65370]: DEBUG dogpile.lock [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] no value, waiting for create lock {{(pid=65370) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1118.192369] env[65370]: DEBUG dogpile.lock [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] value creation lock acquired {{(pid=65370) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1118.192479] env[65370]: DEBUG dogpile.cache.region [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] No value present for key: 'zone-id' {{(pid=65370) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1118.192594] env[65370]: DEBUG dogpile.lock [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Calling creation function for not-yet-present value {{(pid=65370) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1118.192725] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1118.223242] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1118.223444] env[65370]: DEBUG dogpile.cache.region [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Cache value generated in 0.031 seconds for key(s): 'zone-id' {{(pid=65370) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1118.223936] env[65370]: DEBUG dogpile.lock [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Released creation lock {{(pid=65370) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1118.224269] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Releasing lock "network-309" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1118.224617] env[65370]: DEBUG networking_nsxv3.common.locking [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Lock port-fe765be2-620a-437b-9c20-47e7c80578db taken with stack trace [, , , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1118.224807] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquiring lock "port-fe765be2-620a-437b-9c20-47e7c80578db" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1118.224938] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquired lock "port-fe765be2-620a-437b-9c20-47e7c80578db" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1118.225316] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquired external semaphore "port-fe765be2-620a-437b-9c20-47e7c80578db" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1118.225447] env[65370]: DEBUG networking_nsxv3.api.rpc [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('fe765be2-620a-437b-9c20-47e7c80578db',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1118.346494] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1118.346494] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1118.346833] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1118.346889] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1118.346942] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1118.347189] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1118.347306] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1118.347384] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1118.349541] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1118.349641] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1118.349765] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 826ed52a-9222-434f-a4f9-e83fd60a5345 is going to be updated. [ 1118.376625] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1118.376807] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1118.376864] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1118.377070] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1118.377221] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1118.386408] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 826ed52a-9222-434f-a4f9-e83fd60a5345 in Status: IN_PROGRESS for 2s [ 1118.397443] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1eaa763e-4469-4428-92d0-ba20a6c99edc in Status: SUCCESS [ 1118.397701] env[65370]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1eaa763e-4469-4428-92d0-ba20a6c99edc deletion is rescheduled due to dependency. [ 1118.397938] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1eaa763e-4469-4428-92d0-ba20a6c99edc" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1118.398154] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1eaa763e-4469-4428-92d0-ba20a6c99edc" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1118.398418] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1eaa763e-4469-4428-92d0-ba20a6c99edc" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1118.398667] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1118.398856] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1118.398972] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1118.399223] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1118.399369] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1118.399525] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1eaa763e-4469-4428-92d0-ba20a6c99edc',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1118.729082] env[65370]: DEBUG networking_nsxv3.common.locking [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1118.729439] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquiring lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1118.729439] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquired lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1118.729721] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquired external semaphore "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1118.729872] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Releasing lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1118.730122] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Segment Port fe765be2-620a-437b-9c20-47e7c80578db not found, creating... [ 1118.730376] env[65370]: DEBUG networking_nsxv3.common.locking [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1118.730534] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquiring lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1118.730716] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquired lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1118.730952] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquired external semaphore "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1118.731140] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Releasing lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1118.731460] env[65370]: DEBUG networking_nsxv3.common.locking [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1118.731617] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquiring lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1118.731731] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquired lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1118.731940] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquired external semaphore "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1118.732088] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Releasing lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1118.732223] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Resource: SegmentPort with ID: fe765be2-620a-437b-9c20-47e7c80578db is going to be created. [ 1118.752212] env[65370]: DEBUG networking_nsxv3.common.locking [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1118.752464] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquiring lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1118.752647] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquired lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1118.753077] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquired external semaphore "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1118.753371] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Releasing lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1118.753620] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Releasing lock "port-fe765be2-620a-437b-9c20-47e7c80578db" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1118.901824] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('1eaa763e-4469-4428-92d0-ba20a6c99edc',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1119.405748] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('1eaa763e-4469-4428-92d0-ba20a6c99edc',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1119.467473] env[65370]: INFO networking_nsxv3.common.synchronization [req-b47950a9-8e37-4ae7-bbc7-442a209f0f4d req-9e822293-104c-48b0-b3c4-8ed387101395 service nova] Enqueued Resource ID: 826ed52a-9222-434f-a4f9-e83fd60a5345 with Priority: HIGHEST for action security_group_rules [ 1119.467678] env[65370]: INFO networking_nsxv3.common.synchronization [req-b47950a9-8e37-4ae7-bbc7-442a209f0f4d req-9e822293-104c-48b0-b3c4-8ed387101395 service nova] Enqueued Resource ID: 826ed52a-9222-434f-a4f9-e83fd60a5345 with Priority: HIGHEST for action security_group_members [ 1119.467820] env[65370]: INFO networking_nsxv3.common.synchronization [req-b47950a9-8e37-4ae7-bbc7-442a209f0f4d req-9e822293-104c-48b0-b3c4-8ed387101395 service nova] Enqueued Resource ID: fe765be2-620a-437b-9c20-47e7c80578db with Priority: HIGHEST for action port [ 1119.468747] env[65370]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 826ed52a-9222-434f-a4f9-e83fd60a5345 with Priority: HIGHEST for action security_group_rules [ 1119.468865] env[65370]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 826ed52a-9222-434f-a4f9-e83fd60a5345 with Priority: HIGHEST for action security_group_members [ 1119.468967] env[65370]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fe765be2-620a-437b-9c20-47e7c80578db with Priority: HIGHEST for action port [ 1119.469856] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock rules-826ed52a-9222-434f-a4f9-e83fd60a5345 taken with stack trace [, , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1119.470132] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-826ed52a-9222-434f-a4f9-e83fd60a5345" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1119.470238] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-826ed52a-9222-434f-a4f9-e83fd60a5345" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1119.470496] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-826ed52a-9222-434f-a4f9-e83fd60a5345" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1119.470621] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('826ed52a-9222-434f-a4f9-e83fd60a5345',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1119.471621] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock member-826ed52a-9222-434f-a4f9-e83fd60a5345 taken with stack trace [, , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1119.472202] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-826ed52a-9222-434f-a4f9-e83fd60a5345" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1119.472495] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock port-fe765be2-620a-437b-9c20-47e7c80578db taken with stack trace [, , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1119.472675] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-fe765be2-620a-437b-9c20-47e7c80578db" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1119.472805] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-fe765be2-620a-437b-9c20-47e7c80578db" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1119.473439] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-fe765be2-620a-437b-9c20-47e7c80578db" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1119.473912] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('fe765be2-620a-437b-9c20-47e7c80578db',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1119.542057] env[65370]: DEBUG networking_nsxv3.common.locking [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Lock network-611 taken with stack trace [, , , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1119.542057] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquiring lock "network-611" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1119.542057] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquired lock "network-611" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1119.542286] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquired external semaphore "network-611" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1119.542492] env[65370]: DEBUG networking_nsxv3.common.locking [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1119.542806] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquiring lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1119.543140] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquired lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1119.544836] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquired external semaphore "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1119.544836] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Releasing lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1119.544836] env[65370]: DEBUG dogpile.cache.region [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] No value present for key: 'zone-id' {{(pid=65370) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1119.544836] env[65370]: DEBUG dogpile.lock [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] NeedRegenerationException {{(pid=65370) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1119.544836] env[65370]: DEBUG dogpile.lock [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] no value, waiting for create lock {{(pid=65370) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1119.544836] env[65370]: DEBUG dogpile.lock [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] value creation lock acquired {{(pid=65370) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1119.545098] env[65370]: DEBUG dogpile.cache.region [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] No value present for key: 'zone-id' {{(pid=65370) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1119.545098] env[65370]: DEBUG dogpile.lock [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Calling creation function for not-yet-present value {{(pid=65370) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1119.545317] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1119.569642] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1119.569642] env[65370]: DEBUG dogpile.cache.region [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Cache value generated in 0.024 seconds for key(s): 'zone-id' {{(pid=65370) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1119.569642] env[65370]: DEBUG dogpile.lock [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Released creation lock {{(pid=65370) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1119.569642] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Releasing lock "network-611" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1119.570702] env[65370]: DEBUG networking_nsxv3.common.locking [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Lock port-f94879de-dc14-4034-9d4b-ab2f91d6de6a taken with stack trace [, , , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1119.570702] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquiring lock "port-f94879de-dc14-4034-9d4b-ab2f91d6de6a" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1119.570702] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquired lock "port-f94879de-dc14-4034-9d4b-ab2f91d6de6a" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1119.570702] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquired external semaphore "port-f94879de-dc14-4034-9d4b-ab2f91d6de6a" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1119.570702] env[65370]: DEBUG networking_nsxv3.api.rpc [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f94879de-dc14-4034-9d4b-ab2f91d6de6a',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1119.908092] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1119.908441] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1119.908441] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1119.908513] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1119.908603] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1119.908750] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1eaa763e-4469-4428-92d0-ba20a6c99edc is going to be updated. [ 1119.939039] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1119.939039] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1119.939039] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1119.939039] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1119.939322] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1119.947992] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1eaa763e-4469-4428-92d0-ba20a6c99edc in Status: IN_PROGRESS for 2s [ 1119.976448] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port fe765be2-620a-437b-9c20-47e7c80578db with status ACTIVE [ 1119.976770] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1119.976924] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1119.976977] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1119.977203] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1119.977290] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1119.977460] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1119.977558] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1119.977618] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1119.977794] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1119.977885] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1119.978087] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1119.978184] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1119.978246] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1119.978383] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1119.978455] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1119.978535] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: fe765be2-620a-437b-9c20-47e7c80578db is going to be updated. [ 1119.979719] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock member-826ed52a-9222-434f-a4f9-e83fd60a5345 taken with stack trace [, , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1119.979824] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-826ed52a-9222-434f-a4f9-e83fd60a5345" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1120.000125] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1120.000281] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1120.000339] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1120.000536] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1120.000671] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1120.000923] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-fe765be2-620a-437b-9c20-47e7c80578db" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1120.072878] env[65370]: DEBUG networking_nsxv3.common.locking [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1120.073134] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquiring lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1120.073250] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquired lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1120.073501] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquired external semaphore "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1120.073647] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Releasing lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1120.073939] env[65370]: DEBUG networking_nsxv3.common.locking [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1120.074095] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquiring lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1120.074212] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquired lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1120.074421] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquired external semaphore "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1120.074552] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Releasing lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1120.074827] env[65370]: DEBUG networking_nsxv3.common.locking [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1120.074995] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquiring lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1120.075114] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquired lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1120.075478] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquired external semaphore "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1120.075568] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Releasing lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1120.075639] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Resource: SegmentPort with ID: f94879de-dc14-4034-9d4b-ab2f91d6de6a is going to be updated. [ 1120.099146] env[65370]: DEBUG networking_nsxv3.common.locking [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1120.099345] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquiring lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1120.099467] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquired lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1120.099720] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquired external semaphore "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1120.099910] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Releasing lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1120.100135] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Releasing lock "port-f94879de-dc14-4034-9d4b-ab2f91d6de6a" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1120.398658] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 826ed52a-9222-434f-a4f9-e83fd60a5345 in Status: SUCCESS [ 1120.398891] env[65370]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 826ed52a-9222-434f-a4f9-e83fd60a5345 deletion is rescheduled due to dependency. [ 1120.399027] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-826ed52a-9222-434f-a4f9-e83fd60a5345" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1120.399243] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-826ed52a-9222-434f-a4f9-e83fd60a5345" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1120.399462] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-826ed52a-9222-434f-a4f9-e83fd60a5345" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1120.399649] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1120.399786] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1120.399855] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1120.400020] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1120.400098] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1120.400199] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('826ed52a-9222-434f-a4f9-e83fd60a5345',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1120.833877] env[65370]: INFO networking_nsxv3.common.synchronization [req-be9fe6b0-a565-4636-b22b-5d1bffe3574a req-b585a474-4f6e-44f3-b8f1-9d92ecc70c86 service nova] Enqueued Resource ID: eba16cc3-e8ee-4772-ba0d-2b7b582b7844 with Priority: HIGHEST for action security_group_rules [ 1120.834116] env[65370]: INFO networking_nsxv3.common.synchronization [req-be9fe6b0-a565-4636-b22b-5d1bffe3574a req-b585a474-4f6e-44f3-b8f1-9d92ecc70c86 service nova] Enqueued Resource ID: eba16cc3-e8ee-4772-ba0d-2b7b582b7844 with Priority: HIGHEST for action security_group_members [ 1120.834289] env[65370]: INFO networking_nsxv3.common.synchronization [req-be9fe6b0-a565-4636-b22b-5d1bffe3574a req-b585a474-4f6e-44f3-b8f1-9d92ecc70c86 service nova] Enqueued Resource ID: f94879de-dc14-4034-9d4b-ab2f91d6de6a with Priority: HIGHEST for action port [ 1120.834829] env[65370]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: eba16cc3-e8ee-4772-ba0d-2b7b582b7844 with Priority: HIGHEST for action security_group_rules [ 1120.834979] env[65370]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: eba16cc3-e8ee-4772-ba0d-2b7b582b7844 with Priority: HIGHEST for action security_group_members [ 1120.835338] env[65370]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f94879de-dc14-4034-9d4b-ab2f91d6de6a with Priority: HIGHEST for action port [ 1120.835699] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock rules-eba16cc3-e8ee-4772-ba0d-2b7b582b7844 taken with stack trace [, , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1120.835834] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-eba16cc3-e8ee-4772-ba0d-2b7b582b7844" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1120.835905] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-eba16cc3-e8ee-4772-ba0d-2b7b582b7844" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1120.836161] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-eba16cc3-e8ee-4772-ba0d-2b7b582b7844" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1120.836494] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('eba16cc3-e8ee-4772-ba0d-2b7b582b7844',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1120.837235] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock member-eba16cc3-e8ee-4772-ba0d-2b7b582b7844 taken with stack trace [, , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1120.837352] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-eba16cc3-e8ee-4772-ba0d-2b7b582b7844" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1120.837419] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-eba16cc3-e8ee-4772-ba0d-2b7b582b7844" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1120.837997] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-eba16cc3-e8ee-4772-ba0d-2b7b582b7844" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1120.838390] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1120.838390] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1120.838390] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1120.838511] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1120.838580] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1120.838688] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('eba16cc3-e8ee-4772-ba0d-2b7b582b7844',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1120.839512] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock port-f94879de-dc14-4034-9d4b-ab2f91d6de6a taken with stack trace [, , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1120.839616] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-f94879de-dc14-4034-9d4b-ab2f91d6de6a" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1120.839678] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-f94879de-dc14-4034-9d4b-ab2f91d6de6a" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1120.839834] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-f94879de-dc14-4034-9d4b-ab2f91d6de6a" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1120.839906] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f94879de-dc14-4034-9d4b-ab2f91d6de6a',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1120.903823] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('826ed52a-9222-434f-a4f9-e83fd60a5345',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1121.342524] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock member-eba16cc3-e8ee-4772-ba0d-2b7b582b7844 taken with stack trace [, , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1121.343070] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-eba16cc3-e8ee-4772-ba0d-2b7b582b7844" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1121.343070] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('eba16cc3-e8ee-4772-ba0d-2b7b582b7844',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1121.343842] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port f94879de-dc14-4034-9d4b-ab2f91d6de6a with status ACTIVE [ 1121.344064] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1121.344179] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1121.344247] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1121.344472] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1121.344600] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1121.344762] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1121.344945] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1121.345042] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1121.345221] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1121.345302] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1121.345481] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1121.345577] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1121.345639] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1121.345775] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1121.345850] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1121.345945] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: f94879de-dc14-4034-9d4b-ab2f91d6de6a is going to be updated. [ 1121.365911] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1121.366106] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1121.366167] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1121.366320] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1121.366450] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1121.366633] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-f94879de-dc14-4034-9d4b-ab2f91d6de6a" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1121.405859] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('826ed52a-9222-434f-a4f9-e83fd60a5345',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1121.701124] env[65370]: INFO networking_nsxv3.common.synchronization [req-3de78224-9700-4bfd-846a-840349b5400c req-b2ce6c71-5949-4b8f-bb1d-18f6bc13cafb tempest-ServersNegativeTestMultiTenantJSON-1552301997 tempest-ServersNegativeTestMultiTenantJSON-1552301997-project-member] Enqueued Resource ID: 5f21eadf-115c-453d-a18a-ea8d6e583522 with Priority: HIGHEST for action security_group_members [ 1121.701931] env[65370]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5f21eadf-115c-453d-a18a-ea8d6e583522 with Priority: HIGHEST for action security_group_members [ 1121.702938] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock member-5f21eadf-115c-453d-a18a-ea8d6e583522 taken with stack trace [, , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1121.703200] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5f21eadf-115c-453d-a18a-ea8d6e583522" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1121.703200] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5f21eadf-115c-453d-a18a-ea8d6e583522" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1121.703622] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5f21eadf-115c-453d-a18a-ea8d6e583522" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1121.703782] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1121.703943] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1121.704039] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1121.704273] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1121.704412] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1121.704653] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5f21eadf-115c-453d-a18a-ea8d6e583522',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1121.847708] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('eba16cc3-e8ee-4772-ba0d-2b7b582b7844',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1121.908360] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1121.908599] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1121.908691] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1121.908945] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1121.909046] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1121.909154] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 826ed52a-9222-434f-a4f9-e83fd60a5345 is going to be updated. [ 1121.939303] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1121.939517] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1121.939517] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1121.939758] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1121.939906] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1121.949047] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 826ed52a-9222-434f-a4f9-e83fd60a5345 in Status: IN_PROGRESS for 2s [ 1121.957299] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1eaa763e-4469-4428-92d0-ba20a6c99edc in Status: SUCCESS [ 1121.957511] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1eaa763e-4469-4428-92d0-ba20a6c99edc" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1121.957688] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1eaa763e-4469-4428-92d0-ba20a6c99edc" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1121.957902] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1eaa763e-4469-4428-92d0-ba20a6c99edc" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1121.958113] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1121.958231] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1121.958333] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1121.958450] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1121.958531] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1121.958616] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1eaa763e-4469-4428-92d0-ba20a6c99edc" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1121.958741] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('1eaa763e-4469-4428-92d0-ba20a6c99edc',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1122.208105] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1122.208278] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1122.208352] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1122.208574] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1122.208680] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1122.208902] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1122.209018] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1122.209082] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1122.209232] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1122.209309] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1122.209395] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5f21eadf-115c-453d-a18a-ea8d6e583522 is going to be updated. [ 1122.241970] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1122.241970] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1122.241970] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1122.241970] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1122.241970] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1122.252021] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5f21eadf-115c-453d-a18a-ea8d6e583522 in Status: IN_PROGRESS for 2s [ 1122.351342] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1122.351342] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1122.351342] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1122.351342] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1122.351342] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1122.351803] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: eba16cc3-e8ee-4772-ba0d-2b7b582b7844 is going to be updated. [ 1122.387403] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1122.387573] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1122.387647] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1122.387927] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1122.388029] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1122.398671] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: eba16cc3-e8ee-4772-ba0d-2b7b582b7844 in Status: IN_PROGRESS for 2s [ 1122.462127] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock member-1eaa763e-4469-4428-92d0-ba20a6c99edc taken with stack trace [, , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1122.462127] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1eaa763e-4469-4428-92d0-ba20a6c99edc" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1122.462127] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1eaa763e-4469-4428-92d0-ba20a6c99edc" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1122.462127] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1eaa763e-4469-4428-92d0-ba20a6c99edc" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1122.462127] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1122.462423] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1122.462423] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1122.462423] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1122.462507] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1122.462553] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1eaa763e-4469-4428-92d0-ba20a6c99edc" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1122.462699] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock member-1eaa763e-4469-4428-92d0-ba20a6c99edc taken with stack trace [, , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1122.462795] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1eaa763e-4469-4428-92d0-ba20a6c99edc" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1122.462856] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1eaa763e-4469-4428-92d0-ba20a6c99edc" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1122.462998] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1eaa763e-4469-4428-92d0-ba20a6c99edc" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1122.463148] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1122.463404] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1122.463404] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1122.463490] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1122.463490] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1122.463563] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1eaa763e-4469-4428-92d0-ba20a6c99edc" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1122.463640] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('1eaa763e-4469-4428-92d0-ba20a6c99edc',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1122.965619] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 1eaa763e-4469-4428-92d0-ba20a6c99edc: rpc.has_security_group_logging(os_id): False [ 1122.984032] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1122.984186] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1122.984298] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1122.984523] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1122.984616] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1122.984807] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1122.984905] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1122.984993] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1122.985169] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1122.985443] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1122.985443] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1122.985579] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1122.985579] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1122.985711] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1122.985783] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1122.985975] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1122.986082] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1122.986136] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1122.986276] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1122.986351] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1122.986429] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 1eaa763e-4469-4428-92d0-ba20a6c99edc is going to be updated. [ 1123.047269] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1123.047269] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1123.047269] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1123.047269] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1123.047269] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1123.060100] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 1eaa763e-4469-4428-92d0-ba20a6c99edc in Status: IN_PROGRESS for 2s [ 1123.962046] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 826ed52a-9222-434f-a4f9-e83fd60a5345 in Status: SUCCESS [ 1123.962046] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-826ed52a-9222-434f-a4f9-e83fd60a5345" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1123.962046] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-826ed52a-9222-434f-a4f9-e83fd60a5345" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1123.962046] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-826ed52a-9222-434f-a4f9-e83fd60a5345" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1123.962474] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1123.962474] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1123.962474] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1123.962654] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1123.962714] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1123.962843] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-826ed52a-9222-434f-a4f9-e83fd60a5345" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1123.962934] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('826ed52a-9222-434f-a4f9-e83fd60a5345',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1124.263458] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5f21eadf-115c-453d-a18a-ea8d6e583522 in Status: SUCCESS [ 1124.264187] env[65370]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5f21eadf-115c-453d-a18a-ea8d6e583522 deletion is rescheduled due to dependency. [ 1124.264187] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5f21eadf-115c-453d-a18a-ea8d6e583522" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1124.413441] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: eba16cc3-e8ee-4772-ba0d-2b7b582b7844 in Status: SUCCESS [ 1124.413766] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-eba16cc3-e8ee-4772-ba0d-2b7b582b7844" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1124.413932] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-eba16cc3-e8ee-4772-ba0d-2b7b582b7844" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1124.414171] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-eba16cc3-e8ee-4772-ba0d-2b7b582b7844" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1124.414375] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1124.414782] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1124.414782] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1124.414963] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1124.414963] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1124.415233] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-eba16cc3-e8ee-4772-ba0d-2b7b582b7844" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1124.415293] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('eba16cc3-e8ee-4772-ba0d-2b7b582b7844',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1124.441352] env[65370]: INFO networking_nsxv3.common.synchronization [None req-0d861d2b-82cf-4d49-80e4-2b51e665a47f tempest-AttachInterfacesTestJSON-315686657 tempest-AttachInterfacesTestJSON-315686657-project-member] Enqueued Resource ID: 826ed52a-9222-434f-a4f9-e83fd60a5345 with Priority: HIGHEST for action security_group_members [ 1124.442350] env[65370]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 826ed52a-9222-434f-a4f9-e83fd60a5345 with Priority: HIGHEST for action security_group_members [ 1124.442910] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock member-826ed52a-9222-434f-a4f9-e83fd60a5345 taken with stack trace [, , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1124.442910] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-826ed52a-9222-434f-a4f9-e83fd60a5345" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1124.443308] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-826ed52a-9222-434f-a4f9-e83fd60a5345" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1124.443568] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-826ed52a-9222-434f-a4f9-e83fd60a5345" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1124.443742] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1124.443853] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1124.443911] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1124.444481] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1124.444579] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1124.444683] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('826ed52a-9222-434f-a4f9-e83fd60a5345',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1124.466791] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock member-826ed52a-9222-434f-a4f9-e83fd60a5345 taken with stack trace [, , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1124.466791] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-826ed52a-9222-434f-a4f9-e83fd60a5345" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1124.917531] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock member-eba16cc3-e8ee-4772-ba0d-2b7b582b7844 taken with stack trace [, , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1124.917726] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-eba16cc3-e8ee-4772-ba0d-2b7b582b7844" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1124.917767] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-eba16cc3-e8ee-4772-ba0d-2b7b582b7844" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1124.918173] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-eba16cc3-e8ee-4772-ba0d-2b7b582b7844" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1124.918579] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1124.918714] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1124.918810] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1124.918935] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1124.919054] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1124.919153] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-eba16cc3-e8ee-4772-ba0d-2b7b582b7844" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1124.919327] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock member-eba16cc3-e8ee-4772-ba0d-2b7b582b7844 taken with stack trace [, , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1124.919420] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-eba16cc3-e8ee-4772-ba0d-2b7b582b7844" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1124.919479] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-eba16cc3-e8ee-4772-ba0d-2b7b582b7844" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1124.919612] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-eba16cc3-e8ee-4772-ba0d-2b7b582b7844" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1124.919770] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1124.919858] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1124.919927] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1124.920178] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1124.920257] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1124.920863] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-eba16cc3-e8ee-4772-ba0d-2b7b582b7844" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1124.920863] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('eba16cc3-e8ee-4772-ba0d-2b7b582b7844',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1124.947071] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('826ed52a-9222-434f-a4f9-e83fd60a5345',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1125.079097] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 1eaa763e-4469-4428-92d0-ba20a6c99edc in Status: SUCCESS [ 1125.080104] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-1eaa763e-4469-4428-92d0-ba20a6c99edc" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1125.423105] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for eba16cc3-e8ee-4772-ba0d-2b7b582b7844: rpc.has_security_group_logging(os_id): False [ 1125.445666] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1125.445666] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1125.445927] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1125.446133] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1125.446133] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1125.446342] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1125.446502] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1125.446573] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1125.446808] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1125.446888] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1125.447170] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1125.447292] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1125.447337] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1125.447480] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1125.447556] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1125.447740] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1125.447836] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1125.447900] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1125.448414] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1125.448414] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1125.448414] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: eba16cc3-e8ee-4772-ba0d-2b7b582b7844 is going to be updated. [ 1125.449510] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('826ed52a-9222-434f-a4f9-e83fd60a5345',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1125.551427] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1125.551555] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1125.551610] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1125.552531] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1125.552531] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1125.574983] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: eba16cc3-e8ee-4772-ba0d-2b7b582b7844 in Status: IN_PROGRESS for 2s [ 1125.952824] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1125.953034] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1125.953088] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1125.953320] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1125.953480] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1125.953654] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 826ed52a-9222-434f-a4f9-e83fd60a5345 is going to be updated. [ 1125.996704] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1125.996929] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1125.997129] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1125.997954] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1125.998352] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1126.009483] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 826ed52a-9222-434f-a4f9-e83fd60a5345 in Status: IN_PROGRESS for 2s [ 1126.776614] env[65370]: DEBUG networking_nsxv3.common.locking [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Lock network-309 taken with stack trace [, , , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1126.777072] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquiring lock "network-309" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1126.777232] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquired lock "network-309" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1126.777570] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquired external semaphore "network-309" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1126.778030] env[65370]: DEBUG networking_nsxv3.common.locking [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1126.778273] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquiring lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1126.778487] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquired lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1126.778791] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquired external semaphore "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1126.779050] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Releasing lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1126.779318] env[65370]: DEBUG dogpile.cache.region [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] No value present for key: 'zone-id' {{(pid=65370) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1126.779464] env[65370]: DEBUG dogpile.lock [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] NeedRegenerationException {{(pid=65370) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1126.779609] env[65370]: DEBUG dogpile.lock [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] no value, waiting for create lock {{(pid=65370) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1126.779715] env[65370]: DEBUG dogpile.lock [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] value creation lock acquired {{(pid=65370) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1126.779841] env[65370]: DEBUG dogpile.cache.region [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] No value present for key: 'zone-id' {{(pid=65370) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1126.779981] env[65370]: DEBUG dogpile.lock [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Calling creation function for not-yet-present value {{(pid=65370) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1126.780144] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1126.809174] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1126.809386] env[65370]: DEBUG dogpile.cache.region [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Cache value generated in 0.029 seconds for key(s): 'zone-id' {{(pid=65370) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1126.809586] env[65370]: DEBUG dogpile.lock [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Released creation lock {{(pid=65370) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1126.809854] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Releasing lock "network-309" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1126.810303] env[65370]: DEBUG networking_nsxv3.common.locking [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Lock port-c33a2c7d-b4b0-46b2-9ed7-1776058f589a taken with stack trace [, , , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1126.810542] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquiring lock "port-c33a2c7d-b4b0-46b2-9ed7-1776058f589a" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1126.810732] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquired lock "port-c33a2c7d-b4b0-46b2-9ed7-1776058f589a" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1126.811263] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquired external semaphore "port-c33a2c7d-b4b0-46b2-9ed7-1776058f589a" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1126.811474] env[65370]: DEBUG networking_nsxv3.api.rpc [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c33a2c7d-b4b0-46b2-9ed7-1776058f589a',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1127.315018] env[65370]: DEBUG networking_nsxv3.common.locking [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1127.315354] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquiring lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1127.315565] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquired lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1127.315931] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquired external semaphore "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1127.316128] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Releasing lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1127.316326] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Segment Port c33a2c7d-b4b0-46b2-9ed7-1776058f589a not found, creating... [ 1127.316643] env[65370]: DEBUG networking_nsxv3.common.locking [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1127.316837] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquiring lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1127.316977] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquired lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1127.317270] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquired external semaphore "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1127.317452] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Releasing lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1127.317826] env[65370]: DEBUG networking_nsxv3.common.locking [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1127.317985] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquiring lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1127.318158] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquired lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1127.318436] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquired external semaphore "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1127.318666] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Releasing lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1127.318904] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Resource: SegmentPort with ID: c33a2c7d-b4b0-46b2-9ed7-1776058f589a is going to be created. [ 1127.340189] env[65370]: DEBUG networking_nsxv3.common.locking [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1127.340441] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquiring lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1127.340584] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquired lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1127.340907] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquired external semaphore "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1127.341185] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Releasing lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1127.341452] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Releasing lock "port-c33a2c7d-b4b0-46b2-9ed7-1776058f589a" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1127.593739] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: eba16cc3-e8ee-4772-ba0d-2b7b582b7844 in Status: SUCCESS [ 1127.594243] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-eba16cc3-e8ee-4772-ba0d-2b7b582b7844" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1128.032401] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 826ed52a-9222-434f-a4f9-e83fd60a5345 in Status: SUCCESS [ 1128.032768] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-826ed52a-9222-434f-a4f9-e83fd60a5345" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1128.032842] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-826ed52a-9222-434f-a4f9-e83fd60a5345" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1128.033078] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-826ed52a-9222-434f-a4f9-e83fd60a5345" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1128.033345] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1128.033469] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1128.033532] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1128.033689] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1128.033788] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1128.033904] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-826ed52a-9222-434f-a4f9-e83fd60a5345" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1128.034091] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock member-826ed52a-9222-434f-a4f9-e83fd60a5345 taken with stack trace [, , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1128.034189] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-826ed52a-9222-434f-a4f9-e83fd60a5345" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1128.034295] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-826ed52a-9222-434f-a4f9-e83fd60a5345" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1128.034435] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-826ed52a-9222-434f-a4f9-e83fd60a5345" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1128.034601] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1128.034698] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1128.034756] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1128.034958] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1128.035038] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1128.035125] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-826ed52a-9222-434f-a4f9-e83fd60a5345" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1128.035214] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('826ed52a-9222-434f-a4f9-e83fd60a5345',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1128.085745] env[65370]: INFO networking_nsxv3.common.synchronization [req-f66ea91c-9c7d-4fb0-b136-ad7245d180d4 req-8fe4cce4-4d2d-499f-8fe9-02bea71c063f service nova] Enqueued Resource ID: 826ed52a-9222-434f-a4f9-e83fd60a5345 with Priority: HIGHEST for action security_group_rules [ 1128.085977] env[65370]: INFO networking_nsxv3.common.synchronization [req-f66ea91c-9c7d-4fb0-b136-ad7245d180d4 req-8fe4cce4-4d2d-499f-8fe9-02bea71c063f service nova] Enqueued Resource ID: 826ed52a-9222-434f-a4f9-e83fd60a5345 with Priority: HIGHEST for action security_group_members [ 1128.086115] env[65370]: INFO networking_nsxv3.common.synchronization [req-f66ea91c-9c7d-4fb0-b136-ad7245d180d4 req-8fe4cce4-4d2d-499f-8fe9-02bea71c063f service nova] Enqueued Resource ID: c33a2c7d-b4b0-46b2-9ed7-1776058f589a with Priority: HIGHEST for action port [ 1128.086752] env[65370]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 826ed52a-9222-434f-a4f9-e83fd60a5345 with Priority: HIGHEST for action security_group_rules [ 1128.086906] env[65370]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 826ed52a-9222-434f-a4f9-e83fd60a5345 with Priority: HIGHEST for action security_group_members [ 1128.087037] env[65370]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c33a2c7d-b4b0-46b2-9ed7-1776058f589a with Priority: HIGHEST for action port [ 1128.087364] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock rules-826ed52a-9222-434f-a4f9-e83fd60a5345 taken with stack trace [, , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1128.087554] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-826ed52a-9222-434f-a4f9-e83fd60a5345" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1128.087808] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock member-826ed52a-9222-434f-a4f9-e83fd60a5345 taken with stack trace [, , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1128.087935] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-826ed52a-9222-434f-a4f9-e83fd60a5345" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1128.088010] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-826ed52a-9222-434f-a4f9-e83fd60a5345" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1128.088259] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-826ed52a-9222-434f-a4f9-e83fd60a5345" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1128.088448] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1128.088616] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1128.088681] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1128.088883] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1128.088991] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1128.089099] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('826ed52a-9222-434f-a4f9-e83fd60a5345',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1128.090569] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock port-c33a2c7d-b4b0-46b2-9ed7-1776058f589a taken with stack trace [, , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1128.090685] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-c33a2c7d-b4b0-46b2-9ed7-1776058f589a" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1128.090753] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-c33a2c7d-b4b0-46b2-9ed7-1776058f589a" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1128.090931] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-c33a2c7d-b4b0-46b2-9ed7-1776058f589a" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1128.090997] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c33a2c7d-b4b0-46b2-9ed7-1776058f589a',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1128.538207] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 826ed52a-9222-434f-a4f9-e83fd60a5345: rpc.has_security_group_logging(os_id): False [ 1128.561319] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1128.561530] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1128.561530] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1128.561848] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1128.561970] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1128.562191] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1128.562323] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1128.562418] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1128.562509] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1128.562595] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1128.562807] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1128.562933] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1128.563057] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1128.563173] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1128.563250] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1128.563456] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1128.563552] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1128.563619] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1128.563744] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1128.563820] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1128.563919] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 826ed52a-9222-434f-a4f9-e83fd60a5345 is going to be updated. [ 1128.571920] env[65370]: INFO networking_nsxv3.common.synchronization [None req-0a29627e-30d4-41ed-af69-015cc48f2293 tempest-AttachVolumeNegativeTest-719365731 tempest-AttachVolumeNegativeTest-719365731-project-member] Enqueued Resource ID: e32dcc83-5b25-41d1-bde2-d13514b085ad with Priority: HIGHEST for action security_group_rules [ 1128.572575] env[65370]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e32dcc83-5b25-41d1-bde2-d13514b085ad with Priority: HIGHEST for action security_group_rules [ 1128.572974] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e32dcc83-5b25-41d1-bde2-d13514b085ad taken with stack trace [, , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1128.573165] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e32dcc83-5b25-41d1-bde2-d13514b085ad" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1128.573265] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e32dcc83-5b25-41d1-bde2-d13514b085ad" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1128.573587] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e32dcc83-5b25-41d1-bde2-d13514b085ad" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1128.573631] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e32dcc83-5b25-41d1-bde2-d13514b085ad',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1128.749554] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1128.749795] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1128.749795] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1128.750050] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1128.750207] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1128.751480] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('826ed52a-9222-434f-a4f9-e83fd60a5345',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1128.752386] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port c33a2c7d-b4b0-46b2-9ed7-1776058f589a with status ACTIVE [ 1128.752823] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1128.752823] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1128.752823] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1128.753043] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1128.753043] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1128.753245] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1128.753337] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1128.753388] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1128.753551] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1128.753645] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1128.753819] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1128.753944] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1128.753982] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1128.754127] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1128.754202] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1128.754289] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: c33a2c7d-b4b0-46b2-9ed7-1776058f589a is going to be updated. [ 1128.756536] env[65370]: INFO networking_nsxv3.common.synchronization [None req-561b6fce-ce54-4c17-b099-85e7bc5aa986 tempest-AttachVolumeNegativeTest-719365731 tempest-AttachVolumeNegativeTest-719365731-project-member] Enqueued Resource ID: e32dcc83-5b25-41d1-bde2-d13514b085ad with Priority: HIGHEST for action security_group_rules [ 1128.757933] env[65370]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e32dcc83-5b25-41d1-bde2-d13514b085ad with Priority: HIGHEST for action security_group_rules [ 1128.758973] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e32dcc83-5b25-41d1-bde2-d13514b085ad taken with stack trace [, , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1128.759131] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e32dcc83-5b25-41d1-bde2-d13514b085ad" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1128.774249] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 826ed52a-9222-434f-a4f9-e83fd60a5345 in Status: IN_PROGRESS for 2s [ 1128.785234] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1128.785234] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1128.785234] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1128.785234] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1128.785234] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1128.785234] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-c33a2c7d-b4b0-46b2-9ed7-1776058f589a" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1129.094605] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1129.094987] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1129.094987] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1129.095139] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1129.095234] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1129.095336] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e32dcc83-5b25-41d1-bde2-d13514b085ad already deleted. [ 1129.095453] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e32dcc83-5b25-41d1-bde2-d13514b085ad" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1129.095673] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e32dcc83-5b25-41d1-bde2-d13514b085ad" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1129.095877] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e32dcc83-5b25-41d1-bde2-d13514b085ad" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1129.095974] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e32dcc83-5b25-41d1-bde2-d13514b085ad',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1129.258350] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('826ed52a-9222-434f-a4f9-e83fd60a5345',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1129.626767] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1129.626954] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1129.627041] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1129.627339] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1129.627442] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1129.627570] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e32dcc83-5b25-41d1-bde2-d13514b085ad already deleted. [ 1129.627654] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e32dcc83-5b25-41d1-bde2-d13514b085ad" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1129.762017] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1129.762017] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1129.762017] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1129.762017] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1129.762017] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1129.762379] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 826ed52a-9222-434f-a4f9-e83fd60a5345 is going to be updated. [ 1129.796129] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1129.796281] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1129.796353] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1129.796572] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1129.796780] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1129.807951] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 826ed52a-9222-434f-a4f9-e83fd60a5345 in Status: IN_PROGRESS for 2s [ 1130.788343] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 826ed52a-9222-434f-a4f9-e83fd60a5345 in Status: SUCCESS [ 1130.788704] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-826ed52a-9222-434f-a4f9-e83fd60a5345" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1130.788815] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-826ed52a-9222-434f-a4f9-e83fd60a5345" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1130.789071] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-826ed52a-9222-434f-a4f9-e83fd60a5345" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1130.789165] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('826ed52a-9222-434f-a4f9-e83fd60a5345',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1130.861723] env[65370]: INFO networking_nsxv3.common.synchronization [req-da0c681d-1253-4e76-a0b0-575951e79396 req-162d6980-198f-4ead-97dc-898c927baf48 tempest-DeleteServersTestJSON-1160924027 tempest-DeleteServersTestJSON-1160924027-project-member] Enqueued Resource ID: 1eaa763e-4469-4428-92d0-ba20a6c99edc with Priority: HIGHEST for action security_group_members [ 1130.863900] env[65370]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1eaa763e-4469-4428-92d0-ba20a6c99edc with Priority: HIGHEST for action security_group_members [ 1130.863900] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock member-1eaa763e-4469-4428-92d0-ba20a6c99edc taken with stack trace [, , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1130.863900] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1eaa763e-4469-4428-92d0-ba20a6c99edc" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1130.863900] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1eaa763e-4469-4428-92d0-ba20a6c99edc" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1130.863900] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1eaa763e-4469-4428-92d0-ba20a6c99edc" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1130.863900] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1130.863900] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1130.863900] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1130.863900] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1130.863900] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1130.863900] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1eaa763e-4469-4428-92d0-ba20a6c99edc',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1131.292273] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock member-826ed52a-9222-434f-a4f9-e83fd60a5345 taken with stack trace [, , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1131.292411] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-826ed52a-9222-434f-a4f9-e83fd60a5345" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1131.369590] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1131.369590] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1131.369590] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1131.369590] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1131.369590] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1131.369590] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1131.369590] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1131.369590] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1131.369590] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1131.369590] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1131.369590] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1eaa763e-4469-4428-92d0-ba20a6c99edc is going to be updated. [ 1131.401149] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1131.401149] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1131.401149] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1131.401397] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1131.401825] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1131.411766] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1eaa763e-4469-4428-92d0-ba20a6c99edc in Status: IN_PROGRESS for 2s [ 1131.818918] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 826ed52a-9222-434f-a4f9-e83fd60a5345 in Status: SUCCESS [ 1131.819289] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-826ed52a-9222-434f-a4f9-e83fd60a5345" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1131.819370] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-826ed52a-9222-434f-a4f9-e83fd60a5345" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1131.819586] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-826ed52a-9222-434f-a4f9-e83fd60a5345" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1131.819775] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1131.819892] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1131.819951] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1131.820114] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1131.820190] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1131.820273] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-826ed52a-9222-434f-a4f9-e83fd60a5345" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1131.820792] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('826ed52a-9222-434f-a4f9-e83fd60a5345',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1132.324181] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock member-826ed52a-9222-434f-a4f9-e83fd60a5345 taken with stack trace [, , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1132.324332] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-826ed52a-9222-434f-a4f9-e83fd60a5345" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1132.324380] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-826ed52a-9222-434f-a4f9-e83fd60a5345" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1132.324601] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-826ed52a-9222-434f-a4f9-e83fd60a5345" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1132.324750] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1132.324856] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1132.324920] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1132.325114] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1132.325201] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1132.325270] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-826ed52a-9222-434f-a4f9-e83fd60a5345" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1132.325384] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock member-826ed52a-9222-434f-a4f9-e83fd60a5345 taken with stack trace [, , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1132.325489] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-826ed52a-9222-434f-a4f9-e83fd60a5345" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1132.325540] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-826ed52a-9222-434f-a4f9-e83fd60a5345" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1132.325675] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-826ed52a-9222-434f-a4f9-e83fd60a5345" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1132.325853] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1132.325955] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1132.326115] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1132.326296] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1132.326362] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1132.326447] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-826ed52a-9222-434f-a4f9-e83fd60a5345" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1132.326534] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('826ed52a-9222-434f-a4f9-e83fd60a5345',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1132.826145] env[65370]: INFO networking_nsxv3.common.synchronization [req-3a9c8a38-1596-4c8d-9681-930214097aa0 req-eaf37f39-c178-4232-ae43-8b491b0f267c tempest-ServerActionsTestOtherB-1099767447 tempest-ServerActionsTestOtherB-1099767447-project-member] Enqueued Resource ID: 2011abd7-ba10-4aae-84fb-1b1bfbd238fa with Priority: HIGHEST for action security_group_members [ 1132.827810] env[65370]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2011abd7-ba10-4aae-84fb-1b1bfbd238fa with Priority: HIGHEST for action security_group_members [ 1132.827810] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock member-2011abd7-ba10-4aae-84fb-1b1bfbd238fa taken with stack trace [, , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1132.827810] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2011abd7-ba10-4aae-84fb-1b1bfbd238fa" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1132.827810] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2011abd7-ba10-4aae-84fb-1b1bfbd238fa" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1132.827810] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2011abd7-ba10-4aae-84fb-1b1bfbd238fa" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1132.828082] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1132.828082] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1132.828156] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1132.828428] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1132.828428] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1132.828428] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2011abd7-ba10-4aae-84fb-1b1bfbd238fa',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1132.830936] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 826ed52a-9222-434f-a4f9-e83fd60a5345: rpc.has_security_group_logging(os_id): False [ 1132.849756] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1132.849756] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1132.849951] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1132.850626] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1132.850626] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1132.850823] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1132.850931] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1132.850997] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1132.851336] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1132.851438] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1132.851650] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1132.851750] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1132.851814] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1132.852180] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1132.852180] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1132.852422] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1132.852559] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1132.852611] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1132.852716] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1132.852790] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1132.852892] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 826ed52a-9222-434f-a4f9-e83fd60a5345 is going to be updated. [ 1132.927343] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1132.927343] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1132.927343] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1132.927495] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1132.927534] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1132.943438] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 826ed52a-9222-434f-a4f9-e83fd60a5345 in Status: IN_PROGRESS for 2s [ 1133.257419] env[65370]: DEBUG networking_nsxv3.common.locking [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Lock network-93 taken with stack trace [, , , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1133.257745] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquiring lock "network-93" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1133.258145] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquired lock "network-93" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1133.258519] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquired external semaphore "network-93" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1133.258992] env[65370]: DEBUG networking_nsxv3.common.locking [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1133.259319] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquiring lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1133.259443] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquired lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1133.259883] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquired external semaphore "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1133.260145] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Releasing lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1133.260363] env[65370]: DEBUG dogpile.cache.region [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] No value present for key: 'zone-id' {{(pid=65370) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1133.260494] env[65370]: DEBUG dogpile.lock [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] NeedRegenerationException {{(pid=65370) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1133.260773] env[65370]: DEBUG dogpile.lock [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] no value, waiting for create lock {{(pid=65370) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1133.260874] env[65370]: DEBUG dogpile.lock [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] value creation lock acquired {{(pid=65370) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1133.260987] env[65370]: DEBUG dogpile.cache.region [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] No value present for key: 'zone-id' {{(pid=65370) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1133.261380] env[65370]: DEBUG dogpile.lock [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Calling creation function for not-yet-present value {{(pid=65370) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1133.261380] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1133.283761] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1133.284095] env[65370]: DEBUG dogpile.cache.region [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=65370) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1133.284231] env[65370]: DEBUG dogpile.lock [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Released creation lock {{(pid=65370) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1133.284493] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Releasing lock "network-93" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1133.284845] env[65370]: DEBUG networking_nsxv3.common.locking [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Lock port-beb9aaec-73ed-43b5-b8b2-371d04a3ff0c taken with stack trace [, , , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1133.285127] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquiring lock "port-beb9aaec-73ed-43b5-b8b2-371d04a3ff0c" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1133.285203] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquired lock "port-beb9aaec-73ed-43b5-b8b2-371d04a3ff0c" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1133.285567] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquired external semaphore "port-beb9aaec-73ed-43b5-b8b2-371d04a3ff0c" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1133.285718] env[65370]: DEBUG networking_nsxv3.api.rpc [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('beb9aaec-73ed-43b5-b8b2-371d04a3ff0c',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1133.331852] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1133.332052] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1133.332149] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1133.332339] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1133.332431] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1133.332673] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1133.332813] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1133.333076] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1133.333345] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1133.333434] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1133.333531] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2011abd7-ba10-4aae-84fb-1b1bfbd238fa is going to be updated. [ 1133.368034] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1133.368270] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1133.368270] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1133.368509] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1133.368656] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1133.384899] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2011abd7-ba10-4aae-84fb-1b1bfbd238fa in Status: IN_PROGRESS for 2s [ 1133.422206] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1eaa763e-4469-4428-92d0-ba20a6c99edc in Status: SUCCESS [ 1133.422576] env[65370]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1eaa763e-4469-4428-92d0-ba20a6c99edc deletion is rescheduled due to dependency. [ 1133.422785] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1eaa763e-4469-4428-92d0-ba20a6c99edc" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1133.789066] env[65370]: DEBUG networking_nsxv3.common.locking [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1133.789770] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquiring lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1133.789770] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquired lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1133.789997] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquired external semaphore "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1133.790216] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Releasing lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1133.790425] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Segment Port beb9aaec-73ed-43b5-b8b2-371d04a3ff0c not found, creating... [ 1133.790779] env[65370]: DEBUG networking_nsxv3.common.locking [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1133.791453] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquiring lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1133.791453] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquired lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1133.791453] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquired external semaphore "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1133.791594] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Releasing lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1133.791881] env[65370]: DEBUG networking_nsxv3.common.locking [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1133.792125] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquiring lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1133.792289] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquired lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1133.792962] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquired external semaphore "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1133.792962] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Releasing lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1133.793151] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Resource: SegmentPort with ID: beb9aaec-73ed-43b5-b8b2-371d04a3ff0c is going to be created. [ 1133.820994] env[65370]: DEBUG networking_nsxv3.common.locking [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1133.821247] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquiring lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1133.821811] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquired lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1133.821811] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquired external semaphore "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1133.821951] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Releasing lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1133.822156] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Releasing lock "port-beb9aaec-73ed-43b5-b8b2-371d04a3ff0c" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1134.566208] env[65370]: INFO networking_nsxv3.common.synchronization [req-3a9c8a38-1596-4c8d-9681-930214097aa0 req-323b6e62-39e9-4525-b130-bf88cf958e49 service nova] Enqueued Resource ID: 2011abd7-ba10-4aae-84fb-1b1bfbd238fa with Priority: HIGHEST for action security_group_rules [ 1134.566208] env[65370]: INFO networking_nsxv3.common.synchronization [req-3a9c8a38-1596-4c8d-9681-930214097aa0 req-323b6e62-39e9-4525-b130-bf88cf958e49 service nova] Enqueued Resource ID: 2011abd7-ba10-4aae-84fb-1b1bfbd238fa with Priority: HIGHEST for action security_group_members [ 1134.566616] env[65370]: INFO networking_nsxv3.common.synchronization [req-3a9c8a38-1596-4c8d-9681-930214097aa0 req-323b6e62-39e9-4525-b130-bf88cf958e49 service nova] Enqueued Resource ID: beb9aaec-73ed-43b5-b8b2-371d04a3ff0c with Priority: HIGHEST for action port [ 1134.567157] env[65370]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2011abd7-ba10-4aae-84fb-1b1bfbd238fa with Priority: HIGHEST for action security_group_rules [ 1134.567157] env[65370]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2011abd7-ba10-4aae-84fb-1b1bfbd238fa with Priority: HIGHEST for action security_group_members [ 1134.567242] env[65370]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: beb9aaec-73ed-43b5-b8b2-371d04a3ff0c with Priority: HIGHEST for action port [ 1134.567543] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock rules-2011abd7-ba10-4aae-84fb-1b1bfbd238fa taken with stack trace [, , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1134.567643] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-2011abd7-ba10-4aae-84fb-1b1bfbd238fa" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1134.567726] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-2011abd7-ba10-4aae-84fb-1b1bfbd238fa" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1134.567958] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-2011abd7-ba10-4aae-84fb-1b1bfbd238fa" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1134.568062] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('2011abd7-ba10-4aae-84fb-1b1bfbd238fa',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1134.568963] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock member-2011abd7-ba10-4aae-84fb-1b1bfbd238fa taken with stack trace [, , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1134.569103] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2011abd7-ba10-4aae-84fb-1b1bfbd238fa" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1134.569351] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock port-beb9aaec-73ed-43b5-b8b2-371d04a3ff0c taken with stack trace [, , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1134.569479] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-beb9aaec-73ed-43b5-b8b2-371d04a3ff0c" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1134.569555] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-beb9aaec-73ed-43b5-b8b2-371d04a3ff0c" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1134.569751] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-beb9aaec-73ed-43b5-b8b2-371d04a3ff0c" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1134.569842] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('beb9aaec-73ed-43b5-b8b2-371d04a3ff0c',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1134.964294] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 826ed52a-9222-434f-a4f9-e83fd60a5345 in Status: SUCCESS [ 1134.964405] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-826ed52a-9222-434f-a4f9-e83fd60a5345" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1135.071269] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock member-2011abd7-ba10-4aae-84fb-1b1bfbd238fa taken with stack trace [, , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1135.071431] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2011abd7-ba10-4aae-84fb-1b1bfbd238fa" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1135.072709] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port beb9aaec-73ed-43b5-b8b2-371d04a3ff0c with status ACTIVE [ 1135.072891] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1135.073020] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1135.073088] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1135.073303] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1135.073389] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1135.073602] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1135.073653] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1135.073717] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1135.073870] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1135.073968] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1135.074175] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1135.074272] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1135.074331] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1135.074473] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1135.074545] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1135.074627] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: beb9aaec-73ed-43b5-b8b2-371d04a3ff0c is going to be updated. [ 1135.096301] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1135.096486] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1135.096531] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1135.096748] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1135.097073] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1135.097148] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-beb9aaec-73ed-43b5-b8b2-371d04a3ff0c" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1135.396220] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2011abd7-ba10-4aae-84fb-1b1bfbd238fa in Status: SUCCESS [ 1135.396220] env[65370]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2011abd7-ba10-4aae-84fb-1b1bfbd238fa deletion is rescheduled due to dependency. [ 1135.396914] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2011abd7-ba10-4aae-84fb-1b1bfbd238fa" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1135.396914] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2011abd7-ba10-4aae-84fb-1b1bfbd238fa" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1135.396914] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2011abd7-ba10-4aae-84fb-1b1bfbd238fa" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1135.396914] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1135.397141] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1135.397211] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1135.397403] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1135.397455] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1135.397550] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2011abd7-ba10-4aae-84fb-1b1bfbd238fa',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1135.899827] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('2011abd7-ba10-4aae-84fb-1b1bfbd238fa',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1136.403544] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('2011abd7-ba10-4aae-84fb-1b1bfbd238fa',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1136.906987] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1136.907386] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1136.907386] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1136.907468] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1136.907503] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1136.907601] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2011abd7-ba10-4aae-84fb-1b1bfbd238fa is going to be updated. [ 1136.937808] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1136.938023] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1136.938095] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1136.938369] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1136.938534] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1136.947847] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2011abd7-ba10-4aae-84fb-1b1bfbd238fa in Status: IN_PROGRESS for 2s [ 1138.961052] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2011abd7-ba10-4aae-84fb-1b1bfbd238fa in Status: SUCCESS [ 1138.961598] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2011abd7-ba10-4aae-84fb-1b1bfbd238fa" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1138.961598] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2011abd7-ba10-4aae-84fb-1b1bfbd238fa" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1138.961748] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2011abd7-ba10-4aae-84fb-1b1bfbd238fa" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1138.962098] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1138.962258] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1138.962302] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1138.962723] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1138.962819] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1138.962900] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2011abd7-ba10-4aae-84fb-1b1bfbd238fa" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1138.963036] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('2011abd7-ba10-4aae-84fb-1b1bfbd238fa',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1139.113680] env[65370]: INFO networking_nsxv3.common.synchronization [req-80101b3c-ce0b-47ea-93c0-9d3ef452afd7 req-228b0e79-39a8-4b1f-844a-6ba6a3b027c4 tempest-ServerActionsTestJSON-720598601 tempest-ServerActionsTestJSON-720598601-project-member] Enqueued Resource ID: fe248172-4be4-4d95-a8ca-c9c2ef203894 with Priority: HIGHEST for action security_group_members [ 1139.114352] env[65370]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fe248172-4be4-4d95-a8ca-c9c2ef203894 with Priority: HIGHEST for action security_group_members [ 1139.114675] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock member-fe248172-4be4-4d95-a8ca-c9c2ef203894 taken with stack trace [, , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1139.114787] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fe248172-4be4-4d95-a8ca-c9c2ef203894" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1139.114858] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fe248172-4be4-4d95-a8ca-c9c2ef203894" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1139.115199] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fe248172-4be4-4d95-a8ca-c9c2ef203894" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1139.115367] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1139.115477] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1139.115584] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1139.115693] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1139.115780] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1139.115952] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('fe248172-4be4-4d95-a8ca-c9c2ef203894',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1139.465839] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('2011abd7-ba10-4aae-84fb-1b1bfbd238fa',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1139.620306] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1139.620418] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1139.620463] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1139.620688] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1139.641665] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1139.642775] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1139.642775] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1139.642775] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1139.642775] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1139.642775] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1139.642775] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: fe248172-4be4-4d95-a8ca-c9c2ef203894 is going to be updated. [ 1139.672079] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1139.672367] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1139.672451] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1139.672670] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1139.672816] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1139.684021] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fe248172-4be4-4d95-a8ca-c9c2ef203894 in Status: IN_PROGRESS for 2s [ 1139.816373] env[65370]: INFO networking_nsxv3.common.synchronization [req-88256074-0fb7-4abe-b0a0-939660d3cd83 req-9aa878b4-d64b-4149-ba85-9bb3f1b6fe76 tempest-AttachVolumeNegativeTest-719365731 tempest-AttachVolumeNegativeTest-719365731-project-member] Enqueued Resource ID: e32dcc83-5b25-41d1-bde2-d13514b085ad with Priority: HIGHEST for action security_group_members [ 1139.817326] env[65370]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e32dcc83-5b25-41d1-bde2-d13514b085ad with Priority: HIGHEST for action security_group_members [ 1139.817634] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock member-e32dcc83-5b25-41d1-bde2-d13514b085ad taken with stack trace [, , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1139.817964] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e32dcc83-5b25-41d1-bde2-d13514b085ad" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1139.818051] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e32dcc83-5b25-41d1-bde2-d13514b085ad" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1139.818329] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e32dcc83-5b25-41d1-bde2-d13514b085ad" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1139.818483] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1139.818585] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1139.818649] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1139.818800] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1139.818885] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1139.819025] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e32dcc83-5b25-41d1-bde2-d13514b085ad',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1139.968539] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 2011abd7-ba10-4aae-84fb-1b1bfbd238fa: rpc.has_security_group_logging(os_id): False [ 1139.986042] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1139.986269] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1139.986320] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1139.986535] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1139.986642] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1139.986921] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1139.987070] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1139.987154] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1139.987329] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1139.987419] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1139.987509] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 2011abd7-ba10-4aae-84fb-1b1bfbd238fa is going to be updated. [ 1140.047802] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1140.047979] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1140.048081] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1140.048294] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1140.048466] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1140.060358] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 2011abd7-ba10-4aae-84fb-1b1bfbd238fa in Status: IN_PROGRESS for 2s [ 1140.182044] env[65370]: DEBUG networking_nsxv3.common.locking [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Lock network-600 taken with stack trace [, , , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1140.182377] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquiring lock "network-600" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1140.182578] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquired lock "network-600" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1140.182984] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquired external semaphore "network-600" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1140.183442] env[65370]: DEBUG networking_nsxv3.common.locking [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1140.183711] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquiring lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1140.183908] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquired lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1140.184276] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquired external semaphore "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1140.184499] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Releasing lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1140.184820] env[65370]: DEBUG dogpile.cache.region [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] No value present for key: 'zone-id' {{(pid=65370) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1140.185018] env[65370]: DEBUG dogpile.lock [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] NeedRegenerationException {{(pid=65370) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1140.185199] env[65370]: DEBUG dogpile.lock [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] no value, waiting for create lock {{(pid=65370) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1140.185381] env[65370]: DEBUG dogpile.lock [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] value creation lock acquired {{(pid=65370) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1140.185568] env[65370]: DEBUG dogpile.cache.region [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] No value present for key: 'zone-id' {{(pid=65370) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1140.185743] env[65370]: DEBUG dogpile.lock [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Calling creation function for not-yet-present value {{(pid=65370) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1140.185995] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1140.205555] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1140.205719] env[65370]: DEBUG dogpile.cache.region [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=65370) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1140.205845] env[65370]: DEBUG dogpile.lock [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Released creation lock {{(pid=65370) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1140.206035] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Releasing lock "network-600" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1140.206360] env[65370]: DEBUG networking_nsxv3.common.locking [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Lock port-8468da3d-89f9-46c6-9567-10264caf81ff taken with stack trace [, , , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1140.206532] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquiring lock "port-8468da3d-89f9-46c6-9567-10264caf81ff" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1140.206649] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquired lock "port-8468da3d-89f9-46c6-9567-10264caf81ff" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1140.207030] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquired external semaphore "port-8468da3d-89f9-46c6-9567-10264caf81ff" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1140.207171] env[65370]: DEBUG networking_nsxv3.api.rpc [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8468da3d-89f9-46c6-9567-10264caf81ff',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1140.322846] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1140.322846] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1140.322846] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1140.322846] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1140.322846] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1140.322846] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1140.322846] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1140.322846] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1140.322846] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1140.322846] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1140.323533] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e32dcc83-5b25-41d1-bde2-d13514b085ad already deleted. [ 1140.323533] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e32dcc83-5b25-41d1-bde2-d13514b085ad" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1140.709752] env[65370]: DEBUG networking_nsxv3.common.locking [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1140.712044] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquiring lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1140.712505] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquired lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1140.712936] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquired external semaphore "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1140.717024] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Releasing lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1140.717024] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Segment Port 8468da3d-89f9-46c6-9567-10264caf81ff not found, creating... [ 1140.717024] env[65370]: DEBUG networking_nsxv3.common.locking [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1140.717024] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquiring lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1140.717024] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquired lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1140.717024] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquired external semaphore "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1140.717024] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Releasing lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1140.717024] env[65370]: DEBUG networking_nsxv3.common.locking [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1140.717024] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquiring lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1140.717024] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquired lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1140.717484] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquired external semaphore "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1140.717750] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Releasing lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1140.717921] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Resource: SegmentPort with ID: 8468da3d-89f9-46c6-9567-10264caf81ff is going to be created. [ 1140.746221] env[65370]: DEBUG networking_nsxv3.common.locking [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1140.746221] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquiring lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1140.746221] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquired lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1140.746616] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquired external semaphore "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1140.746616] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Releasing lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1140.746785] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Releasing lock "port-8468da3d-89f9-46c6-9567-10264caf81ff" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1141.242063] env[65370]: INFO networking_nsxv3.common.synchronization [req-f686aeb6-2005-4fab-a70c-bf427261d796 req-73f6a5f1-7a03-4ab5-b555-89f9b6675645 tempest-AttachInterfacesTestJSON-315686657 tempest-AttachInterfacesTestJSON-315686657-project-member] Enqueued Resource ID: 826ed52a-9222-434f-a4f9-e83fd60a5345 with Priority: HIGHEST for action security_group_members [ 1141.242630] env[65370]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 826ed52a-9222-434f-a4f9-e83fd60a5345 with Priority: HIGHEST for action security_group_members [ 1141.242931] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock member-826ed52a-9222-434f-a4f9-e83fd60a5345 taken with stack trace [, , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1141.243067] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-826ed52a-9222-434f-a4f9-e83fd60a5345" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1141.243135] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-826ed52a-9222-434f-a4f9-e83fd60a5345" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1141.243332] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-826ed52a-9222-434f-a4f9-e83fd60a5345" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1141.243482] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1141.243577] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1141.243629] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1141.243769] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1141.243849] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1141.243940] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('826ed52a-9222-434f-a4f9-e83fd60a5345',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1141.474043] env[65370]: INFO networking_nsxv3.common.synchronization [req-88256074-0fb7-4abe-b0a0-939660d3cd83 req-16a0a3b1-0866-410e-aad8-0bc23a76c039 service nova] Enqueued Resource ID: e32dcc83-5b25-41d1-bde2-d13514b085ad with Priority: HIGHEST for action security_group_rules [ 1141.474262] env[65370]: INFO networking_nsxv3.common.synchronization [req-88256074-0fb7-4abe-b0a0-939660d3cd83 req-16a0a3b1-0866-410e-aad8-0bc23a76c039 service nova] Enqueued Resource ID: e32dcc83-5b25-41d1-bde2-d13514b085ad with Priority: HIGHEST for action security_group_members [ 1141.474335] env[65370]: INFO networking_nsxv3.common.synchronization [req-88256074-0fb7-4abe-b0a0-939660d3cd83 req-16a0a3b1-0866-410e-aad8-0bc23a76c039 service nova] Enqueued Resource ID: 8468da3d-89f9-46c6-9567-10264caf81ff with Priority: HIGHEST for action port [ 1141.474837] env[65370]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e32dcc83-5b25-41d1-bde2-d13514b085ad with Priority: HIGHEST for action security_group_rules [ 1141.474971] env[65370]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e32dcc83-5b25-41d1-bde2-d13514b085ad with Priority: HIGHEST for action security_group_members [ 1141.475079] env[65370]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8468da3d-89f9-46c6-9567-10264caf81ff with Priority: HIGHEST for action port [ 1141.475367] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e32dcc83-5b25-41d1-bde2-d13514b085ad taken with stack trace [, , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1141.475494] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e32dcc83-5b25-41d1-bde2-d13514b085ad" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1141.475549] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e32dcc83-5b25-41d1-bde2-d13514b085ad" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1141.475730] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e32dcc83-5b25-41d1-bde2-d13514b085ad" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1141.475812] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e32dcc83-5b25-41d1-bde2-d13514b085ad',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1141.476664] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock member-e32dcc83-5b25-41d1-bde2-d13514b085ad taken with stack trace [, , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1141.476774] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e32dcc83-5b25-41d1-bde2-d13514b085ad" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1141.476841] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e32dcc83-5b25-41d1-bde2-d13514b085ad" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1141.477067] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e32dcc83-5b25-41d1-bde2-d13514b085ad" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1141.477221] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1141.477316] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1141.477377] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1141.477516] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1141.478687] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1141.478687] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e32dcc83-5b25-41d1-bde2-d13514b085ad',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1141.479330] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock port-8468da3d-89f9-46c6-9567-10264caf81ff taken with stack trace [, , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1141.479330] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-8468da3d-89f9-46c6-9567-10264caf81ff" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1141.479330] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-8468da3d-89f9-46c6-9567-10264caf81ff" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1141.479330] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-8468da3d-89f9-46c6-9567-10264caf81ff" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1141.479330] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8468da3d-89f9-46c6-9567-10264caf81ff',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1141.695064] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fe248172-4be4-4d95-a8ca-c9c2ef203894 in Status: SUCCESS [ 1141.695064] env[65370]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: fe248172-4be4-4d95-a8ca-c9c2ef203894 deletion is rescheduled due to dependency. [ 1141.695337] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fe248172-4be4-4d95-a8ca-c9c2ef203894" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1141.745714] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('826ed52a-9222-434f-a4f9-e83fd60a5345',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1141.960491] env[65370]: INFO networking_nsxv3.common.synchronization [None req-254cf1ce-ad8b-4065-9b65-5da2f9716e61 tempest-AttachInterfacesTestJSON-315686657 tempest-AttachInterfacesTestJSON-315686657-project-member] Enqueued Resource ID: 826ed52a-9222-434f-a4f9-e83fd60a5345 with Priority: HIGHEST for action security_group_members [ 1141.961200] env[65370]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 826ed52a-9222-434f-a4f9-e83fd60a5345 with Priority: HIGHEST for action security_group_members [ 1141.961539] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock member-826ed52a-9222-434f-a4f9-e83fd60a5345 taken with stack trace [, , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1141.961669] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-826ed52a-9222-434f-a4f9-e83fd60a5345" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1141.980946] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock member-e32dcc83-5b25-41d1-bde2-d13514b085ad taken with stack trace [, , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1141.981134] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e32dcc83-5b25-41d1-bde2-d13514b085ad" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1141.981976] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('e32dcc83-5b25-41d1-bde2-d13514b085ad',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1141.983528] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 8468da3d-89f9-46c6-9567-10264caf81ff with status ACTIVE [ 1141.983830] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1141.984032] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1141.984183] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1141.984457] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1141.984604] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1141.985837] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1141.985837] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1141.985837] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1141.985837] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1141.985837] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1141.986062] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1141.986205] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1141.986205] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1141.986448] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1141.986537] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1141.986671] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 8468da3d-89f9-46c6-9567-10264caf81ff is going to be updated. [ 1142.015278] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1142.015465] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1142.015525] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1142.015703] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1142.015841] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1142.015998] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-8468da3d-89f9-46c6-9567-10264caf81ff" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1142.074387] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 2011abd7-ba10-4aae-84fb-1b1bfbd238fa in Status: SUCCESS [ 1142.074387] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-2011abd7-ba10-4aae-84fb-1b1bfbd238fa" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1142.251248] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('826ed52a-9222-434f-a4f9-e83fd60a5345',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1142.489375] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('e32dcc83-5b25-41d1-bde2-d13514b085ad',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1142.754194] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1142.754390] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1142.754438] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1142.754639] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1142.754731] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1142.754839] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 826ed52a-9222-434f-a4f9-e83fd60a5345 is going to be updated. [ 1142.786674] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1142.786674] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1142.786790] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1142.786953] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1142.787151] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1142.796256] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 826ed52a-9222-434f-a4f9-e83fd60a5345 in Status: IN_PROGRESS for 2s [ 1142.991769] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1142.991932] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1142.991987] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1142.992217] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1142.992310] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1142.992412] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e32dcc83-5b25-41d1-bde2-d13514b085ad is going to be created. [ 1143.017566] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1143.017689] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1143.017689] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1143.017935] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1143.018333] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1143.031184] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e32dcc83-5b25-41d1-bde2-d13514b085ad in Status: UNINITIALIZED for 2s [ 1144.803973] env[65370]: INFO networking_nsxv3.common.synchronization [req-f105ea8d-82d8-498e-af6b-8f23a9aad38a req-39a6fc4d-4f47-4d71-8e38-81078d00a39e tempest-AttachInterfacesTestJSON-315686657 tempest-AttachInterfacesTestJSON-315686657-project-member] Enqueued Resource ID: 87bbb461-0dea-430b-adcd-ee0e3f4ed609 with Priority: HIGHEST for action security_group_members [ 1144.804702] env[65370]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 87bbb461-0dea-430b-adcd-ee0e3f4ed609 with Priority: HIGHEST for action security_group_members [ 1144.805874] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock member-87bbb461-0dea-430b-adcd-ee0e3f4ed609 taken with stack trace [, , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1144.805874] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-87bbb461-0dea-430b-adcd-ee0e3f4ed609" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1144.805874] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-87bbb461-0dea-430b-adcd-ee0e3f4ed609" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1144.805874] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-87bbb461-0dea-430b-adcd-ee0e3f4ed609" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1144.805874] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1144.805874] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1144.805874] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1144.805874] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1144.806356] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1144.806356] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('87bbb461-0dea-430b-adcd-ee0e3f4ed609',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1144.807690] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 826ed52a-9222-434f-a4f9-e83fd60a5345 in Status: SUCCESS [ 1144.808055] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-826ed52a-9222-434f-a4f9-e83fd60a5345" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1144.808319] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-826ed52a-9222-434f-a4f9-e83fd60a5345" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1144.808536] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-826ed52a-9222-434f-a4f9-e83fd60a5345" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1144.808632] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1144.808732] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1144.808788] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1144.808921] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1144.808994] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1144.809145] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('826ed52a-9222-434f-a4f9-e83fd60a5345',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1145.042161] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e32dcc83-5b25-41d1-bde2-d13514b085ad in Status: SUCCESS [ 1145.042288] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e32dcc83-5b25-41d1-bde2-d13514b085ad" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1145.042452] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e32dcc83-5b25-41d1-bde2-d13514b085ad" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1145.042671] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e32dcc83-5b25-41d1-bde2-d13514b085ad" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1145.042861] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1145.042997] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1145.043136] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1145.043374] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1145.043449] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1145.043574] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e32dcc83-5b25-41d1-bde2-d13514b085ad" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1145.043691] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('e32dcc83-5b25-41d1-bde2-d13514b085ad',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1145.310803] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1145.310990] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1145.311067] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1145.311328] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1145.311445] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1145.311652] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1145.311756] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1145.311813] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1145.311958] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1145.312043] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1145.312137] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 87bbb461-0dea-430b-adcd-ee0e3f4ed609 is going to be updated. [ 1145.313277] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1145.313385] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1145.313443] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1145.313589] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1145.313667] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1145.313829] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1145.313919] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1145.313977] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1145.314131] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1145.314206] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1145.314288] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 826ed52a-9222-434f-a4f9-e83fd60a5345 is going to be updated. [ 1145.344565] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1145.344565] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1145.344565] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1145.344841] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1145.345195] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1145.347484] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1145.347484] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1145.347484] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1145.348432] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1145.348432] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1145.363200] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 87bbb461-0dea-430b-adcd-ee0e3f4ed609 in Status: IN_PROGRESS for 2s [ 1145.363400] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 826ed52a-9222-434f-a4f9-e83fd60a5345 in Status: IN_PROGRESS for 2s [ 1145.545999] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('e32dcc83-5b25-41d1-bde2-d13514b085ad',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1146.050219] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for e32dcc83-5b25-41d1-bde2-d13514b085ad: rpc.has_security_group_logging(os_id): False [ 1146.070449] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1146.070449] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1146.070757] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1146.070907] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1146.070992] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1146.072034] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1146.072034] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1146.072034] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1146.072034] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1146.072034] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1146.072034] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e32dcc83-5b25-41d1-bde2-d13514b085ad is going to be created. [ 1146.127962] env[65370]: DEBUG networking_nsxv3.common.locking [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Lock network-745 taken with stack trace [, , , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1146.128211] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquiring lock "network-745" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1146.128337] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquired lock "network-745" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1146.129027] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquired external semaphore "network-745" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1146.129379] env[65370]: DEBUG networking_nsxv3.common.locking [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1146.129689] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquiring lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1146.129689] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquired lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1146.129892] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquired external semaphore "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1146.130056] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Releasing lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1146.130282] env[65370]: DEBUG dogpile.cache.region [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] No value present for key: 'zone-id' {{(pid=65370) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1146.130391] env[65370]: DEBUG dogpile.lock [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] NeedRegenerationException {{(pid=65370) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1146.130498] env[65370]: DEBUG dogpile.lock [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] no value, waiting for create lock {{(pid=65370) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1146.130598] env[65370]: DEBUG dogpile.lock [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] value creation lock acquired {{(pid=65370) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1146.130715] env[65370]: DEBUG dogpile.cache.region [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] No value present for key: 'zone-id' {{(pid=65370) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1146.130819] env[65370]: DEBUG dogpile.lock [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Calling creation function for not-yet-present value {{(pid=65370) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1146.130929] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1146.154642] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1146.154825] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1146.154901] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1146.155203] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1146.155432] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1146.157495] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1146.157688] env[65370]: DEBUG dogpile.cache.region [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Cache value generated in 0.027 seconds for key(s): 'zone-id' {{(pid=65370) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1146.157876] env[65370]: DEBUG dogpile.lock [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Released creation lock {{(pid=65370) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1146.158083] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Releasing lock "network-745" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1146.158410] env[65370]: DEBUG networking_nsxv3.common.locking [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Lock port-96286831-489e-48b7-be37-b5399f00007b taken with stack trace [, , , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1146.158664] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquiring lock "port-96286831-489e-48b7-be37-b5399f00007b" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1146.158731] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquired lock "port-96286831-489e-48b7-be37-b5399f00007b" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1146.159023] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquired external semaphore "port-96286831-489e-48b7-be37-b5399f00007b" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1146.159476] env[65370]: DEBUG networking_nsxv3.api.rpc [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('96286831-489e-48b7-be37-b5399f00007b',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1146.173490] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e32dcc83-5b25-41d1-bde2-d13514b085ad in Status: IN_PROGRESS for 2s [ 1146.662170] env[65370]: DEBUG networking_nsxv3.common.locking [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1146.662402] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquiring lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1146.662528] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquired lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1146.662803] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquired external semaphore "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1146.662950] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Releasing lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1146.663247] env[65370]: DEBUG networking_nsxv3.common.locking [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1146.663403] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquiring lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1146.663516] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquired lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1146.663731] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquired external semaphore "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1146.663862] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Releasing lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1146.664224] env[65370]: DEBUG networking_nsxv3.common.locking [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1146.664410] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquiring lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1146.664525] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquired lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1146.664728] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquired external semaphore "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1146.664856] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Releasing lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1146.664994] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Resource: SegmentPort with ID: 96286831-489e-48b7-be37-b5399f00007b is going to be updated. [ 1146.693250] env[65370]: DEBUG networking_nsxv3.common.locking [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1146.693473] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquiring lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1146.693579] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquired lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1146.693866] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquired external semaphore "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1146.694106] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Releasing lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1146.694348] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Releasing lock "port-96286831-489e-48b7-be37-b5399f00007b" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1147.374749] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 826ed52a-9222-434f-a4f9-e83fd60a5345 in Status: SUCCESS [ 1147.375110] env[65370]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 826ed52a-9222-434f-a4f9-e83fd60a5345 deletion is rescheduled due to dependency. [ 1147.375110] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-826ed52a-9222-434f-a4f9-e83fd60a5345" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1147.375838] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 87bbb461-0dea-430b-adcd-ee0e3f4ed609 in Status: SUCCESS [ 1147.375982] env[65370]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 87bbb461-0dea-430b-adcd-ee0e3f4ed609 deletion is rescheduled due to dependency. [ 1147.376104] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-87bbb461-0dea-430b-adcd-ee0e3f4ed609" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1147.386539] env[65370]: INFO networking_nsxv3.common.synchronization [req-13debe75-c8a5-41ac-997e-42169be939cf req-a415ed0c-7bd3-430b-bd4b-da0e1d7f5353 service nova] Enqueued Resource ID: 154b7e30-9d22-43f4-84bb-7d8dd4d7cc9a with Priority: HIGHEST for action security_group_rules [ 1147.386736] env[65370]: INFO networking_nsxv3.common.synchronization [req-13debe75-c8a5-41ac-997e-42169be939cf req-a415ed0c-7bd3-430b-bd4b-da0e1d7f5353 service nova] Enqueued Resource ID: 154b7e30-9d22-43f4-84bb-7d8dd4d7cc9a with Priority: HIGHEST for action security_group_members [ 1147.386901] env[65370]: INFO networking_nsxv3.common.synchronization [req-13debe75-c8a5-41ac-997e-42169be939cf req-a415ed0c-7bd3-430b-bd4b-da0e1d7f5353 service nova] Enqueued Resource ID: 96286831-489e-48b7-be37-b5399f00007b with Priority: HIGHEST for action port [ 1147.388248] env[65370]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 154b7e30-9d22-43f4-84bb-7d8dd4d7cc9a with Priority: HIGHEST for action security_group_rules [ 1147.388248] env[65370]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 154b7e30-9d22-43f4-84bb-7d8dd4d7cc9a with Priority: HIGHEST for action security_group_members [ 1147.388248] env[65370]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 96286831-489e-48b7-be37-b5399f00007b with Priority: HIGHEST for action port [ 1147.388248] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock rules-154b7e30-9d22-43f4-84bb-7d8dd4d7cc9a taken with stack trace [, , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1147.388248] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-154b7e30-9d22-43f4-84bb-7d8dd4d7cc9a" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1147.388248] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-154b7e30-9d22-43f4-84bb-7d8dd4d7cc9a" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1147.388589] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-154b7e30-9d22-43f4-84bb-7d8dd4d7cc9a" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1147.388589] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('154b7e30-9d22-43f4-84bb-7d8dd4d7cc9a',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1147.389594] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock member-154b7e30-9d22-43f4-84bb-7d8dd4d7cc9a taken with stack trace [, , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1147.389729] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-154b7e30-9d22-43f4-84bb-7d8dd4d7cc9a" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1147.389794] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-154b7e30-9d22-43f4-84bb-7d8dd4d7cc9a" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1147.390251] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-154b7e30-9d22-43f4-84bb-7d8dd4d7cc9a" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1147.390347] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1147.390540] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1147.390540] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1147.390719] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1147.390719] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1147.390719] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('154b7e30-9d22-43f4-84bb-7d8dd4d7cc9a',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1147.391523] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock port-96286831-489e-48b7-be37-b5399f00007b taken with stack trace [, , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1147.391657] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-96286831-489e-48b7-be37-b5399f00007b" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1147.391992] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-96286831-489e-48b7-be37-b5399f00007b" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1147.391992] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-96286831-489e-48b7-be37-b5399f00007b" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1147.391992] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('96286831-489e-48b7-be37-b5399f00007b',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1147.894124] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('154b7e30-9d22-43f4-84bb-7d8dd4d7cc9a',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1147.895506] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock member-154b7e30-9d22-43f4-84bb-7d8dd4d7cc9a taken with stack trace [, , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1147.895506] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-154b7e30-9d22-43f4-84bb-7d8dd4d7cc9a" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1147.895506] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 96286831-489e-48b7-be37-b5399f00007b with status ACTIVE [ 1147.895738] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1147.895799] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1147.895831] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1147.896111] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1147.896161] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1147.896309] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1147.896405] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1147.896463] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1147.896658] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1147.896688] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1147.896850] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1147.896938] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1147.896997] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1147.897150] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1147.897222] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1147.897303] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 96286831-489e-48b7-be37-b5399f00007b is going to be updated. [ 1147.920295] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1147.920504] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1147.920504] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1147.920707] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1147.920891] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1147.921100] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-96286831-489e-48b7-be37-b5399f00007b" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1148.187388] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e32dcc83-5b25-41d1-bde2-d13514b085ad in Status: SUCCESS [ 1148.187579] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e32dcc83-5b25-41d1-bde2-d13514b085ad" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1148.399348] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('154b7e30-9d22-43f4-84bb-7d8dd4d7cc9a',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1148.902512] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1148.902512] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1148.902512] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1148.902512] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1148.902512] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1148.902830] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 154b7e30-9d22-43f4-84bb-7d8dd4d7cc9a is going to be updated. [ 1148.936509] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1148.936722] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1148.936838] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1148.937054] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1148.937229] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1148.947741] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 154b7e30-9d22-43f4-84bb-7d8dd4d7cc9a in Status: IN_PROGRESS for 2s [ 1150.961196] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 154b7e30-9d22-43f4-84bb-7d8dd4d7cc9a in Status: SUCCESS [ 1150.961807] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-154b7e30-9d22-43f4-84bb-7d8dd4d7cc9a" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1150.961807] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-154b7e30-9d22-43f4-84bb-7d8dd4d7cc9a" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1150.961807] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-154b7e30-9d22-43f4-84bb-7d8dd4d7cc9a" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1150.961956] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1150.962081] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1150.962141] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1150.962325] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1150.962408] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1150.962490] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-154b7e30-9d22-43f4-84bb-7d8dd4d7cc9a" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1150.962579] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('154b7e30-9d22-43f4-84bb-7d8dd4d7cc9a',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1151.465535] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('154b7e30-9d22-43f4-84bb-7d8dd4d7cc9a',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1151.778707] env[65370]: INFO networking_nsxv3.common.synchronization [req-96a0ebff-3a3b-485c-827d-cf2ee837d4ba req-ba63a405-d1ee-41f7-8eae-593103bf799c tempest-ServersNegativeTestJSON-226836032 tempest-ServersNegativeTestJSON-226836032-project-member] Enqueued Resource ID: eba16cc3-e8ee-4772-ba0d-2b7b582b7844 with Priority: HIGHEST for action security_group_members [ 1151.779963] env[65370]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: eba16cc3-e8ee-4772-ba0d-2b7b582b7844 with Priority: HIGHEST for action security_group_members [ 1151.780847] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock member-eba16cc3-e8ee-4772-ba0d-2b7b582b7844 taken with stack trace [, , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1151.781423] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-eba16cc3-e8ee-4772-ba0d-2b7b582b7844" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1151.781623] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-eba16cc3-e8ee-4772-ba0d-2b7b582b7844" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1151.782089] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-eba16cc3-e8ee-4772-ba0d-2b7b582b7844" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1151.782410] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1151.782658] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1151.782831] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1151.783330] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1151.783494] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1151.783750] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('eba16cc3-e8ee-4772-ba0d-2b7b582b7844',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1151.968584] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 154b7e30-9d22-43f4-84bb-7d8dd4d7cc9a: rpc.has_security_group_logging(os_id): False [ 1151.988218] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1151.988411] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1151.988644] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1151.988980] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1151.989074] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1151.989465] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1151.989581] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1151.989706] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1151.989880] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1151.989958] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1151.990064] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 154b7e30-9d22-43f4-84bb-7d8dd4d7cc9a is going to be updated. [ 1152.051475] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1152.051692] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1152.051771] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1152.052068] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1152.052280] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1152.066615] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 154b7e30-9d22-43f4-84bb-7d8dd4d7cc9a in Status: IN_PROGRESS for 2s [ 1152.274680] env[65370]: INFO networking_nsxv3.common.synchronization [req-a5ca30b9-5048-441d-9cd4-c0dc658ef6a0 req-de9c8cdd-6d55-4c97-b467-34e3af41395e tempest-DeleteServersTestJSON-1160924027 tempest-DeleteServersTestJSON-1160924027-project-member] Enqueued Resource ID: 1eaa763e-4469-4428-92d0-ba20a6c99edc with Priority: HIGHEST for action security_group_members [ 1152.275267] env[65370]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1eaa763e-4469-4428-92d0-ba20a6c99edc with Priority: HIGHEST for action security_group_members [ 1152.275562] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock member-1eaa763e-4469-4428-92d0-ba20a6c99edc taken with stack trace [, , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1152.275680] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1eaa763e-4469-4428-92d0-ba20a6c99edc" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1152.275770] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1eaa763e-4469-4428-92d0-ba20a6c99edc" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1152.275946] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1eaa763e-4469-4428-92d0-ba20a6c99edc" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1152.276435] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1152.276435] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1152.276435] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1152.276435] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1152.277140] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1152.277140] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1eaa763e-4469-4428-92d0-ba20a6c99edc',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1152.290042] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1152.290042] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1152.290042] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1152.290042] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1152.290042] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1152.290042] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1152.290511] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1152.290511] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1152.290511] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1152.290511] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1152.290623] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: eba16cc3-e8ee-4772-ba0d-2b7b582b7844 is going to be updated. [ 1152.323025] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1152.323025] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1152.323025] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1152.323025] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1152.323025] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1152.333685] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: eba16cc3-e8ee-4772-ba0d-2b7b582b7844 in Status: IN_PROGRESS for 2s [ 1152.638957] env[65370]: DEBUG networking_nsxv3.common.locking [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Lock network-712 taken with stack trace [, , , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1152.639124] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquiring lock "network-712" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1152.639310] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquired lock "network-712" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1152.639580] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquired external semaphore "network-712" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1152.639847] env[65370]: DEBUG networking_nsxv3.common.locking [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1152.640012] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquiring lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1152.640140] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquired lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1152.640384] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquired external semaphore "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1152.640529] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Releasing lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1152.640735] env[65370]: DEBUG dogpile.cache.region [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] No value present for key: 'zone-id' {{(pid=65370) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1152.640844] env[65370]: DEBUG dogpile.lock [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] NeedRegenerationException {{(pid=65370) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1152.640947] env[65370]: DEBUG dogpile.lock [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] no value, waiting for create lock {{(pid=65370) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1152.641087] env[65370]: DEBUG dogpile.lock [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] value creation lock acquired {{(pid=65370) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1152.641201] env[65370]: DEBUG dogpile.cache.region [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] No value present for key: 'zone-id' {{(pid=65370) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1152.641312] env[65370]: DEBUG dogpile.lock [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Calling creation function for not-yet-present value {{(pid=65370) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1152.641435] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1152.661390] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1152.661674] env[65370]: DEBUG dogpile.cache.region [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=65370) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1152.661892] env[65370]: DEBUG dogpile.lock [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Released creation lock {{(pid=65370) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1152.662189] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Releasing lock "network-712" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1152.662664] env[65370]: DEBUG networking_nsxv3.common.locking [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Lock port-d7d92208-6435-4152-b546-c6bab77f0fa9 taken with stack trace [, , , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1152.663178] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquiring lock "port-d7d92208-6435-4152-b546-c6bab77f0fa9" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1152.663390] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquired lock "port-d7d92208-6435-4152-b546-c6bab77f0fa9" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1152.663854] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquired external semaphore "port-d7d92208-6435-4152-b546-c6bab77f0fa9" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1152.664092] env[65370]: DEBUG networking_nsxv3.api.rpc [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d7d92208-6435-4152-b546-c6bab77f0fa9',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1152.778657] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1152.778736] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1152.778775] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1152.778995] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1152.779109] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1152.779427] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1152.779565] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1152.779624] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1152.779765] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1152.779840] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1152.779931] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1eaa763e-4469-4428-92d0-ba20a6c99edc is going to be updated. [ 1152.809187] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1152.809187] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1152.809187] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1152.809187] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1152.809187] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1152.821616] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1eaa763e-4469-4428-92d0-ba20a6c99edc in Status: IN_PROGRESS for 2s [ 1153.167514] env[65370]: DEBUG networking_nsxv3.common.locking [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1153.167839] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquiring lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1153.168031] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquired lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1153.168420] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquired external semaphore "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1153.168653] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Releasing lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1153.168884] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Segment Port d7d92208-6435-4152-b546-c6bab77f0fa9 not found, creating... [ 1153.169303] env[65370]: DEBUG networking_nsxv3.common.locking [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1153.169543] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquiring lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1153.169725] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquired lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1153.170054] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquired external semaphore "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1153.170270] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Releasing lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1153.170699] env[65370]: DEBUG networking_nsxv3.common.locking [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1153.170931] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquiring lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1153.171164] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquired lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1153.171433] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquired external semaphore "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1153.171638] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Releasing lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1153.171845] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Resource: SegmentPort with ID: d7d92208-6435-4152-b546-c6bab77f0fa9 is going to be created. [ 1153.194410] env[65370]: DEBUG networking_nsxv3.common.locking [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1153.194638] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquiring lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1153.194749] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquired lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1153.195034] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquired external semaphore "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1153.195268] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Releasing lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1153.195512] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Releasing lock "port-d7d92208-6435-4152-b546-c6bab77f0fa9" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1153.927962] env[65370]: INFO networking_nsxv3.common.synchronization [req-a5ca30b9-5048-441d-9cd4-c0dc658ef6a0 req-e5acc53b-0ded-43c6-ad0c-bff959785f88 service nova] Enqueued Resource ID: 1eaa763e-4469-4428-92d0-ba20a6c99edc with Priority: HIGHEST for action security_group_rules [ 1153.928209] env[65370]: INFO networking_nsxv3.common.synchronization [req-a5ca30b9-5048-441d-9cd4-c0dc658ef6a0 req-e5acc53b-0ded-43c6-ad0c-bff959785f88 service nova] Enqueued Resource ID: 1eaa763e-4469-4428-92d0-ba20a6c99edc with Priority: HIGHEST for action security_group_members [ 1153.928274] env[65370]: INFO networking_nsxv3.common.synchronization [req-a5ca30b9-5048-441d-9cd4-c0dc658ef6a0 req-e5acc53b-0ded-43c6-ad0c-bff959785f88 service nova] Enqueued Resource ID: d7d92208-6435-4152-b546-c6bab77f0fa9 with Priority: HIGHEST for action port [ 1153.928771] env[65370]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1eaa763e-4469-4428-92d0-ba20a6c99edc with Priority: HIGHEST for action security_group_rules [ 1153.928904] env[65370]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1eaa763e-4469-4428-92d0-ba20a6c99edc with Priority: HIGHEST for action security_group_members [ 1153.928999] env[65370]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d7d92208-6435-4152-b546-c6bab77f0fa9 with Priority: HIGHEST for action port [ 1153.929459] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock rules-1eaa763e-4469-4428-92d0-ba20a6c99edc taken with stack trace [, , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1153.929545] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-1eaa763e-4469-4428-92d0-ba20a6c99edc" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1153.929620] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-1eaa763e-4469-4428-92d0-ba20a6c99edc" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1153.929813] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-1eaa763e-4469-4428-92d0-ba20a6c99edc" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1153.929894] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('1eaa763e-4469-4428-92d0-ba20a6c99edc',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1153.931957] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock member-1eaa763e-4469-4428-92d0-ba20a6c99edc taken with stack trace [, , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1153.931957] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1eaa763e-4469-4428-92d0-ba20a6c99edc" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1153.931957] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock port-d7d92208-6435-4152-b546-c6bab77f0fa9 taken with stack trace [, , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1153.931957] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-d7d92208-6435-4152-b546-c6bab77f0fa9" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1153.931957] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-d7d92208-6435-4152-b546-c6bab77f0fa9" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1153.932361] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-d7d92208-6435-4152-b546-c6bab77f0fa9" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1153.932361] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d7d92208-6435-4152-b546-c6bab77f0fa9',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1154.080474] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 154b7e30-9d22-43f4-84bb-7d8dd4d7cc9a in Status: SUCCESS [ 1154.080705] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-154b7e30-9d22-43f4-84bb-7d8dd4d7cc9a" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1154.345468] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: eba16cc3-e8ee-4772-ba0d-2b7b582b7844 in Status: SUCCESS [ 1154.345837] env[65370]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: eba16cc3-e8ee-4772-ba0d-2b7b582b7844 deletion is rescheduled due to dependency. [ 1154.345837] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-eba16cc3-e8ee-4772-ba0d-2b7b582b7844" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1154.433465] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock member-1eaa763e-4469-4428-92d0-ba20a6c99edc taken with stack trace [, , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1154.433682] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1eaa763e-4469-4428-92d0-ba20a6c99edc" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1154.433860] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port d7d92208-6435-4152-b546-c6bab77f0fa9 with status ACTIVE [ 1154.434069] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1154.434257] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1154.434257] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1154.434450] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1154.434554] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1154.434737] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1154.434834] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1154.434896] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1154.435052] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1154.435141] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1154.435337] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1154.435434] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1154.435491] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1154.435630] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1154.435702] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1154.435797] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: d7d92208-6435-4152-b546-c6bab77f0fa9 is going to be updated. [ 1154.594533] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1154.594701] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1154.594851] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1154.595189] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1154.595332] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1154.595609] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-d7d92208-6435-4152-b546-c6bab77f0fa9" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1154.834743] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1eaa763e-4469-4428-92d0-ba20a6c99edc in Status: SUCCESS [ 1154.834743] env[65370]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1eaa763e-4469-4428-92d0-ba20a6c99edc deletion is rescheduled due to dependency. [ 1154.834743] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1eaa763e-4469-4428-92d0-ba20a6c99edc" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1154.834743] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1eaa763e-4469-4428-92d0-ba20a6c99edc" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1154.834743] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1eaa763e-4469-4428-92d0-ba20a6c99edc" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1154.834743] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1154.834743] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1154.834743] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1154.834743] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1154.834743] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1154.834743] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1eaa763e-4469-4428-92d0-ba20a6c99edc',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1155.336775] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('1eaa763e-4469-4428-92d0-ba20a6c99edc',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1155.839695] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('1eaa763e-4469-4428-92d0-ba20a6c99edc',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1156.128839] env[65370]: INFO networking_nsxv3.common.synchronization [None req-b17e874d-4f10-4298-978c-8f2527e3d6b7 tempest-AttachInterfacesTestJSON-315686657 tempest-AttachInterfacesTestJSON-315686657-project-member] Enqueued Resource ID: be9c9972-d782-43b4-ba55-a29e461a1378 with Priority: HIGHEST for action security_group_rules [ 1156.129531] env[65370]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: be9c9972-d782-43b4-ba55-a29e461a1378 with Priority: HIGHEST for action security_group_rules [ 1156.129887] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock rules-be9c9972-d782-43b4-ba55-a29e461a1378 taken with stack trace [, , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1156.130077] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-be9c9972-d782-43b4-ba55-a29e461a1378" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1156.130146] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-be9c9972-d782-43b4-ba55-a29e461a1378" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1156.130715] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-be9c9972-d782-43b4-ba55-a29e461a1378" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1156.130715] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('be9c9972-d782-43b4-ba55-a29e461a1378',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1156.232339] env[65370]: INFO networking_nsxv3.common.synchronization [None req-37cdd7f0-c8db-41b4-9363-2ff0702eff3b tempest-AttachInterfacesTestJSON-315686657 tempest-AttachInterfacesTestJSON-315686657-project-member] Enqueued Resource ID: be9c9972-d782-43b4-ba55-a29e461a1378 with Priority: HIGHEST for action security_group_rules [ 1156.232936] env[65370]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: be9c9972-d782-43b4-ba55-a29e461a1378 with Priority: HIGHEST for action security_group_rules [ 1156.233264] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock rules-be9c9972-d782-43b4-ba55-a29e461a1378 taken with stack trace [, , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1156.233402] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-be9c9972-d782-43b4-ba55-a29e461a1378" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1156.342482] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1156.342707] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1156.342780] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1156.343057] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1156.343177] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1156.343308] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1eaa763e-4469-4428-92d0-ba20a6c99edc is going to be updated. [ 1156.390476] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1156.390814] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1156.390814] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1156.391016] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1156.391123] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1156.401400] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1eaa763e-4469-4428-92d0-ba20a6c99edc in Status: IN_PROGRESS for 2s [ 1156.661603] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1156.661811] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1156.661811] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1156.662062] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1156.662155] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1156.662259] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: be9c9972-d782-43b4-ba55-a29e461a1378 already deleted. [ 1156.662365] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-be9c9972-d782-43b4-ba55-a29e461a1378" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1156.662520] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-be9c9972-d782-43b4-ba55-a29e461a1378" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1156.662683] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-be9c9972-d782-43b4-ba55-a29e461a1378" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1156.662764] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('be9c9972-d782-43b4-ba55-a29e461a1378',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1157.189522] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1157.189822] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1157.189859] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1157.190384] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1157.190384] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1157.190384] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: be9c9972-d782-43b4-ba55-a29e461a1378 already deleted. [ 1157.191147] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-be9c9972-d782-43b4-ba55-a29e461a1378" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1158.117865] env[65370]: INFO networking_nsxv3.common.synchronization [req-934f2c1a-ec89-4dcd-b8c9-831e73d260d1 req-843a5866-1a1b-4f4e-b183-b71916baa732 tempest-ServerActionsTestJSON-720598601 tempest-ServerActionsTestJSON-720598601-project-member] Enqueued Resource ID: fe248172-4be4-4d95-a8ca-c9c2ef203894 with Priority: HIGHEST for action security_group_members [ 1158.118129] env[65370]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fe248172-4be4-4d95-a8ca-c9c2ef203894 with Priority: HIGHEST for action security_group_members [ 1158.118626] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock member-fe248172-4be4-4d95-a8ca-c9c2ef203894 taken with stack trace [, , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1158.118721] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fe248172-4be4-4d95-a8ca-c9c2ef203894" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1158.118872] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fe248172-4be4-4d95-a8ca-c9c2ef203894" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1158.119071] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fe248172-4be4-4d95-a8ca-c9c2ef203894" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1158.119346] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1158.119460] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1158.119540] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1158.120611] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1158.120611] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1158.120611] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('fe248172-4be4-4d95-a8ca-c9c2ef203894',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1158.414653] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1eaa763e-4469-4428-92d0-ba20a6c99edc in Status: SUCCESS [ 1158.414975] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1eaa763e-4469-4428-92d0-ba20a6c99edc" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1158.415116] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1eaa763e-4469-4428-92d0-ba20a6c99edc" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1158.415364] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1eaa763e-4469-4428-92d0-ba20a6c99edc" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1158.415593] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1158.415738] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1158.415818] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1158.416019] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1158.416180] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1158.416311] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1eaa763e-4469-4428-92d0-ba20a6c99edc" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1158.416506] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('1eaa763e-4469-4428-92d0-ba20a6c99edc',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1158.561217] env[65370]: DEBUG networking_nsxv3.common.locking [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Lock network-609 taken with stack trace [, , , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1158.561531] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquiring lock "network-609" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1158.561745] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquired lock "network-609" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1158.562185] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquired external semaphore "network-609" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1158.562554] env[65370]: DEBUG networking_nsxv3.common.locking [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1158.562801] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquiring lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1158.562984] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquired lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1158.563353] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquired external semaphore "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1158.563577] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Releasing lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1158.563917] env[65370]: DEBUG dogpile.cache.region [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] No value present for key: 'zone-id' {{(pid=65370) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1158.564057] env[65370]: DEBUG dogpile.lock [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] NeedRegenerationException {{(pid=65370) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1158.564190] env[65370]: DEBUG dogpile.lock [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] no value, waiting for create lock {{(pid=65370) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1158.564322] env[65370]: DEBUG dogpile.lock [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] value creation lock acquired {{(pid=65370) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1158.564451] env[65370]: DEBUG dogpile.cache.region [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] No value present for key: 'zone-id' {{(pid=65370) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1158.564560] env[65370]: DEBUG dogpile.lock [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Calling creation function for not-yet-present value {{(pid=65370) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1158.564691] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1158.584555] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1158.584850] env[65370]: DEBUG dogpile.cache.region [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=65370) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1158.585081] env[65370]: DEBUG dogpile.lock [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Released creation lock {{(pid=65370) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1158.585466] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Releasing lock "network-609" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1158.585922] env[65370]: DEBUG networking_nsxv3.common.locking [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Lock port-e5e5bf2a-e09c-4c76-8d8b-40dbecb55d0b taken with stack trace [, , , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1158.586206] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquiring lock "port-e5e5bf2a-e09c-4c76-8d8b-40dbecb55d0b" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1158.586392] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquired lock "port-e5e5bf2a-e09c-4c76-8d8b-40dbecb55d0b" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1158.586834] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquired external semaphore "port-e5e5bf2a-e09c-4c76-8d8b-40dbecb55d0b" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1158.587042] env[65370]: DEBUG networking_nsxv3.api.rpc [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e5e5bf2a-e09c-4c76-8d8b-40dbecb55d0b',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1158.623061] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1158.623235] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1158.623332] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1158.623597] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1158.623710] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1158.623963] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1158.624106] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1158.624190] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1158.624387] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1158.624488] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1158.624598] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: fe248172-4be4-4d95-a8ca-c9c2ef203894 is going to be updated. [ 1158.656263] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1158.656464] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1158.656566] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1158.656849] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1158.657061] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1158.671097] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fe248172-4be4-4d95-a8ca-c9c2ef203894 in Status: IN_PROGRESS for 2s [ 1158.922870] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock member-1eaa763e-4469-4428-92d0-ba20a6c99edc taken with stack trace [, , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1158.923108] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1eaa763e-4469-4428-92d0-ba20a6c99edc" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1158.923108] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1eaa763e-4469-4428-92d0-ba20a6c99edc" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1158.923346] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1eaa763e-4469-4428-92d0-ba20a6c99edc" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1158.923518] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1158.923624] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1158.923831] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1158.923831] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1158.923912] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1158.923989] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1eaa763e-4469-4428-92d0-ba20a6c99edc" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1158.924774] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock member-1eaa763e-4469-4428-92d0-ba20a6c99edc taken with stack trace [, , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1158.924774] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1eaa763e-4469-4428-92d0-ba20a6c99edc" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1158.924774] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1eaa763e-4469-4428-92d0-ba20a6c99edc" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1158.924774] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1eaa763e-4469-4428-92d0-ba20a6c99edc" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1158.924774] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1158.924774] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1158.924774] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1158.924774] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1158.925050] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1158.925050] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1eaa763e-4469-4428-92d0-ba20a6c99edc" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1158.925050] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('1eaa763e-4469-4428-92d0-ba20a6c99edc',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1159.089791] env[65370]: DEBUG networking_nsxv3.common.locking [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1159.089877] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquiring lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1159.089999] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquired lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1159.090295] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquired external semaphore "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1159.090445] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Releasing lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1159.090612] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Segment Port e5e5bf2a-e09c-4c76-8d8b-40dbecb55d0b not found, creating... [ 1159.090870] env[65370]: DEBUG networking_nsxv3.common.locking [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1159.091045] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquiring lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1159.091161] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquired lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1159.091383] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquired external semaphore "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1159.091517] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Releasing lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1159.091797] env[65370]: DEBUG networking_nsxv3.common.locking [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1159.091950] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquiring lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1159.092075] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquired lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1159.092278] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquired external semaphore "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1159.092410] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Releasing lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1159.092543] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Resource: SegmentPort with ID: e5e5bf2a-e09c-4c76-8d8b-40dbecb55d0b is going to be created. [ 1159.113160] env[65370]: DEBUG networking_nsxv3.common.locking [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1159.113401] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquiring lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1159.113485] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquired lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1159.113763] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquired external semaphore "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1159.113991] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Releasing lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1159.114250] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Releasing lock "port-e5e5bf2a-e09c-4c76-8d8b-40dbecb55d0b" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1159.427698] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 1eaa763e-4469-4428-92d0-ba20a6c99edc: rpc.has_security_group_logging(os_id): False [ 1159.450900] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1159.451202] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1159.451202] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1159.451338] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1159.451428] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1159.451735] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1159.451856] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1159.451919] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1159.452105] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1159.452190] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1159.452402] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1159.452502] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1159.452565] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1159.452708] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1159.452782] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1159.452977] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1159.453131] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1159.453131] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1159.453276] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1159.453352] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1159.453438] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 1eaa763e-4469-4428-92d0-ba20a6c99edc is going to be updated. [ 1159.516719] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1159.516896] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1159.516944] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1159.517175] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1159.517320] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1159.529881] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 1eaa763e-4469-4428-92d0-ba20a6c99edc in Status: IN_PROGRESS for 2s [ 1159.860791] env[65370]: INFO networking_nsxv3.common.synchronization [req-934f2c1a-ec89-4dcd-b8c9-831e73d260d1 req-0ad636b5-c4f8-434c-b1fc-0e99acd4594a service nova] Enqueued Resource ID: fe248172-4be4-4d95-a8ca-c9c2ef203894 with Priority: HIGHEST for action security_group_rules [ 1159.861030] env[65370]: INFO networking_nsxv3.common.synchronization [req-934f2c1a-ec89-4dcd-b8c9-831e73d260d1 req-0ad636b5-c4f8-434c-b1fc-0e99acd4594a service nova] Enqueued Resource ID: fe248172-4be4-4d95-a8ca-c9c2ef203894 with Priority: HIGHEST for action security_group_members [ 1159.861294] env[65370]: INFO networking_nsxv3.common.synchronization [req-934f2c1a-ec89-4dcd-b8c9-831e73d260d1 req-0ad636b5-c4f8-434c-b1fc-0e99acd4594a service nova] Enqueued Resource ID: e5e5bf2a-e09c-4c76-8d8b-40dbecb55d0b with Priority: HIGHEST for action port [ 1159.862687] env[65370]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fe248172-4be4-4d95-a8ca-c9c2ef203894 with Priority: HIGHEST for action security_group_rules [ 1159.862900] env[65370]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fe248172-4be4-4d95-a8ca-c9c2ef203894 with Priority: HIGHEST for action security_group_members [ 1159.863092] env[65370]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e5e5bf2a-e09c-4c76-8d8b-40dbecb55d0b with Priority: HIGHEST for action port [ 1159.863532] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock rules-fe248172-4be4-4d95-a8ca-c9c2ef203894 taken with stack trace [, , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1159.863723] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-fe248172-4be4-4d95-a8ca-c9c2ef203894" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1159.863842] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-fe248172-4be4-4d95-a8ca-c9c2ef203894" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1159.864173] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-fe248172-4be4-4d95-a8ca-c9c2ef203894" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1159.864297] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('fe248172-4be4-4d95-a8ca-c9c2ef203894',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1159.866043] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock member-fe248172-4be4-4d95-a8ca-c9c2ef203894 taken with stack trace [, , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1159.866043] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fe248172-4be4-4d95-a8ca-c9c2ef203894" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1159.866043] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock port-e5e5bf2a-e09c-4c76-8d8b-40dbecb55d0b taken with stack trace [, , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1159.866458] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-e5e5bf2a-e09c-4c76-8d8b-40dbecb55d0b" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1159.866458] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-e5e5bf2a-e09c-4c76-8d8b-40dbecb55d0b" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1159.866593] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-e5e5bf2a-e09c-4c76-8d8b-40dbecb55d0b" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1159.866932] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e5e5bf2a-e09c-4c76-8d8b-40dbecb55d0b',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1160.369482] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock member-fe248172-4be4-4d95-a8ca-c9c2ef203894 taken with stack trace [, , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1160.369482] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fe248172-4be4-4d95-a8ca-c9c2ef203894" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1160.370810] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port e5e5bf2a-e09c-4c76-8d8b-40dbecb55d0b with status ACTIVE [ 1160.371488] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1160.371488] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1160.371488] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1160.371744] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1160.371744] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1160.372316] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1160.372316] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1160.372316] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1160.372316] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1160.372316] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1160.372785] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1160.372785] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1160.372785] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1160.373136] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1160.373136] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1160.373136] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: e5e5bf2a-e09c-4c76-8d8b-40dbecb55d0b is going to be updated. [ 1160.398062] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1160.398241] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1160.398344] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1160.398543] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1160.398713] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1160.398914] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-e5e5bf2a-e09c-4c76-8d8b-40dbecb55d0b" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1160.682270] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fe248172-4be4-4d95-a8ca-c9c2ef203894 in Status: SUCCESS [ 1160.682672] env[65370]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: fe248172-4be4-4d95-a8ca-c9c2ef203894 deletion is rescheduled due to dependency. [ 1160.682672] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fe248172-4be4-4d95-a8ca-c9c2ef203894" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1160.682750] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fe248172-4be4-4d95-a8ca-c9c2ef203894" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1160.682974] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fe248172-4be4-4d95-a8ca-c9c2ef203894" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1160.683179] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1160.683294] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1160.683355] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1160.683554] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1160.683637] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1160.683729] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('fe248172-4be4-4d95-a8ca-c9c2ef203894',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1161.186474] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('fe248172-4be4-4d95-a8ca-c9c2ef203894',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1161.551153] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 1eaa763e-4469-4428-92d0-ba20a6c99edc in Status: SUCCESS [ 1161.551323] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-1eaa763e-4469-4428-92d0-ba20a6c99edc" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1161.688954] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('fe248172-4be4-4d95-a8ca-c9c2ef203894',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1162.191672] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1162.191910] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1162.191910] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1162.192119] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1162.192206] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1162.192310] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: fe248172-4be4-4d95-a8ca-c9c2ef203894 is going to be updated. [ 1162.222022] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1162.222281] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1162.222281] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1162.222515] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1162.222625] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1162.232600] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fe248172-4be4-4d95-a8ca-c9c2ef203894 in Status: IN_PROGRESS for 2s [ 1163.236744] env[65370]: INFO networking_nsxv3.common.synchronization [req-bd148407-d174-47fc-90f5-a17ff977be86 req-82e69fd8-ec51-4e91-9ee5-dc68d60846f9 tempest-AttachInterfacesTestJSON-315686657 tempest-AttachInterfacesTestJSON-315686657-project-member] Enqueued Resource ID: be9c9972-d782-43b4-ba55-a29e461a1378 with Priority: HIGHEST for action security_group_members [ 1163.237394] env[65370]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: be9c9972-d782-43b4-ba55-a29e461a1378 with Priority: HIGHEST for action security_group_members [ 1163.237697] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock member-be9c9972-d782-43b4-ba55-a29e461a1378 taken with stack trace [, , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1163.237820] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-be9c9972-d782-43b4-ba55-a29e461a1378" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1163.237887] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-be9c9972-d782-43b4-ba55-a29e461a1378" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1163.240204] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-be9c9972-d782-43b4-ba55-a29e461a1378" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1163.240394] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1163.240510] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1163.240580] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1163.240743] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1163.240840] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1163.240919] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('be9c9972-d782-43b4-ba55-a29e461a1378',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1163.613509] env[65370]: DEBUG networking_nsxv3.common.locking [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Lock network-309 taken with stack trace [, , , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1163.613787] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquiring lock "network-309" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1163.613913] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquired lock "network-309" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1163.614185] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquired external semaphore "network-309" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1163.614434] env[65370]: DEBUG networking_nsxv3.common.locking [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1163.614593] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquiring lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1163.614704] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquired lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1163.614907] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquired external semaphore "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1163.615057] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Releasing lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1163.615259] env[65370]: DEBUG dogpile.cache.region [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] No value present for key: 'zone-id' {{(pid=65370) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1163.615367] env[65370]: DEBUG dogpile.lock [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] NeedRegenerationException {{(pid=65370) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1163.615471] env[65370]: DEBUG dogpile.lock [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] no value, waiting for create lock {{(pid=65370) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1163.615572] env[65370]: DEBUG dogpile.lock [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] value creation lock acquired {{(pid=65370) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1163.615674] env[65370]: DEBUG dogpile.cache.region [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] No value present for key: 'zone-id' {{(pid=65370) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1163.615774] env[65370]: DEBUG dogpile.lock [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Calling creation function for not-yet-present value {{(pid=65370) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1163.615952] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1163.636783] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1163.636957] env[65370]: DEBUG dogpile.cache.region [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=65370) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1163.637108] env[65370]: DEBUG dogpile.lock [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Released creation lock {{(pid=65370) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1163.637305] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Releasing lock "network-309" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1163.637615] env[65370]: DEBUG networking_nsxv3.common.locking [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Lock port-9c97bdce-301e-4f50-9b55-5cfd9a0d492e taken with stack trace [, , , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1163.637787] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquiring lock "port-9c97bdce-301e-4f50-9b55-5cfd9a0d492e" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1163.637905] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquired lock "port-9c97bdce-301e-4f50-9b55-5cfd9a0d492e" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1163.638278] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquired external semaphore "port-9c97bdce-301e-4f50-9b55-5cfd9a0d492e" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1163.638374] env[65370]: DEBUG networking_nsxv3.api.rpc [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9c97bdce-301e-4f50-9b55-5cfd9a0d492e',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1163.744603] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1163.744855] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1163.744855] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1163.745109] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1163.745209] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1163.745386] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1163.745478] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1163.745557] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1163.745980] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1163.745980] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1163.745980] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: be9c9972-d782-43b4-ba55-a29e461a1378 already deleted. [ 1163.745980] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-be9c9972-d782-43b4-ba55-a29e461a1378" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1164.140808] env[65370]: DEBUG networking_nsxv3.common.locking [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1164.141054] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquiring lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1164.141183] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquired lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1164.141459] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquired external semaphore "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1164.141614] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Releasing lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1164.141767] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Segment Port 9c97bdce-301e-4f50-9b55-5cfd9a0d492e not found, creating... [ 1164.142035] env[65370]: DEBUG networking_nsxv3.common.locking [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1164.142192] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquiring lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1164.142305] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquired lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1164.142520] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquired external semaphore "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1164.142654] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Releasing lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1164.142926] env[65370]: DEBUG networking_nsxv3.common.locking [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1164.143092] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquiring lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1164.143208] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquired lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1164.143409] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquired external semaphore "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1164.143541] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Releasing lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1164.143674] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Resource: SegmentPort with ID: 9c97bdce-301e-4f50-9b55-5cfd9a0d492e is going to be created. [ 1164.163189] env[65370]: DEBUG networking_nsxv3.common.locking [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1164.163434] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquiring lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1164.163510] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquired lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1164.163829] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquired external semaphore "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1164.164386] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Releasing lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1164.164751] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Releasing lock "port-9c97bdce-301e-4f50-9b55-5cfd9a0d492e" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1164.244315] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fe248172-4be4-4d95-a8ca-c9c2ef203894 in Status: SUCCESS [ 1164.244718] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fe248172-4be4-4d95-a8ca-c9c2ef203894" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1164.244718] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fe248172-4be4-4d95-a8ca-c9c2ef203894" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1164.244921] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fe248172-4be4-4d95-a8ca-c9c2ef203894" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1164.245127] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1164.245244] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1164.245310] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1164.245475] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1164.245557] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1164.245641] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fe248172-4be4-4d95-a8ca-c9c2ef203894" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1164.245735] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('fe248172-4be4-4d95-a8ca-c9c2ef203894',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1164.750408] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('fe248172-4be4-4d95-a8ca-c9c2ef203894',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1164.891581] env[65370]: INFO networking_nsxv3.common.synchronization [req-bd148407-d174-47fc-90f5-a17ff977be86 req-59465db8-cd5c-4cb1-961c-442b836f8f01 service nova] Enqueued Resource ID: be9c9972-d782-43b4-ba55-a29e461a1378 with Priority: HIGHEST for action security_group_rules [ 1164.891801] env[65370]: INFO networking_nsxv3.common.synchronization [req-bd148407-d174-47fc-90f5-a17ff977be86 req-59465db8-cd5c-4cb1-961c-442b836f8f01 service nova] Enqueued Resource ID: be9c9972-d782-43b4-ba55-a29e461a1378 with Priority: HIGHEST for action security_group_members [ 1164.892284] env[65370]: INFO networking_nsxv3.common.synchronization [req-bd148407-d174-47fc-90f5-a17ff977be86 req-59465db8-cd5c-4cb1-961c-442b836f8f01 service nova] Enqueued Resource ID: 9c97bdce-301e-4f50-9b55-5cfd9a0d492e with Priority: HIGHEST for action port [ 1164.892845] env[65370]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: be9c9972-d782-43b4-ba55-a29e461a1378 with Priority: HIGHEST for action security_group_rules [ 1164.892981] env[65370]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: be9c9972-d782-43b4-ba55-a29e461a1378 with Priority: HIGHEST for action security_group_members [ 1164.893094] env[65370]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9c97bdce-301e-4f50-9b55-5cfd9a0d492e with Priority: HIGHEST for action port [ 1164.893366] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock rules-be9c9972-d782-43b4-ba55-a29e461a1378 taken with stack trace [, , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1164.893484] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-be9c9972-d782-43b4-ba55-a29e461a1378" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1164.893578] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-be9c9972-d782-43b4-ba55-a29e461a1378" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1164.893739] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-be9c9972-d782-43b4-ba55-a29e461a1378" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1164.893819] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('be9c9972-d782-43b4-ba55-a29e461a1378',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1164.894914] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock member-be9c9972-d782-43b4-ba55-a29e461a1378 taken with stack trace [, , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1164.895048] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-be9c9972-d782-43b4-ba55-a29e461a1378" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1164.895079] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-be9c9972-d782-43b4-ba55-a29e461a1378" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1164.895238] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-be9c9972-d782-43b4-ba55-a29e461a1378" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1164.895411] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1164.895604] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1164.895604] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1164.895732] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1164.895779] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1164.895855] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('be9c9972-d782-43b4-ba55-a29e461a1378',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1164.897652] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock port-9c97bdce-301e-4f50-9b55-5cfd9a0d492e taken with stack trace [, , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1164.897652] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-9c97bdce-301e-4f50-9b55-5cfd9a0d492e" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1164.897652] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-9c97bdce-301e-4f50-9b55-5cfd9a0d492e" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1164.902682] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-9c97bdce-301e-4f50-9b55-5cfd9a0d492e" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1164.902682] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9c97bdce-301e-4f50-9b55-5cfd9a0d492e',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1165.253056] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for fe248172-4be4-4d95-a8ca-c9c2ef203894: rpc.has_security_group_logging(os_id): False [ 1165.270827] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1165.271037] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1165.271091] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1165.271327] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1165.271444] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1165.271741] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1165.271915] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1165.271976] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1165.272195] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1165.272299] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1165.272412] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: fe248172-4be4-4d95-a8ca-c9c2ef203894 is going to be updated. [ 1165.358310] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1165.358521] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1165.358521] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1165.358727] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1165.358907] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1165.372021] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: fe248172-4be4-4d95-a8ca-c9c2ef203894 in Status: IN_PROGRESS for 2s [ 1165.402744] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('be9c9972-d782-43b4-ba55-a29e461a1378',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1165.403661] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock member-be9c9972-d782-43b4-ba55-a29e461a1378 taken with stack trace [, , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1165.403814] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-be9c9972-d782-43b4-ba55-a29e461a1378" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1165.405276] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 9c97bdce-301e-4f50-9b55-5cfd9a0d492e with status ACTIVE [ 1165.405477] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1165.405601] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1165.405667] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1165.405906] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1165.405996] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1165.406204] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1165.406286] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1165.406626] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1165.406626] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1165.406626] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1165.406814] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1165.406814] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1165.406933] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1165.407013] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1165.407100] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1165.407186] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 9c97bdce-301e-4f50-9b55-5cfd9a0d492e is going to be updated. [ 1165.466037] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1165.466252] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1165.466252] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1165.466458] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1165.466596] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1165.466767] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-9c97bdce-301e-4f50-9b55-5cfd9a0d492e" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1165.905166] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('be9c9972-d782-43b4-ba55-a29e461a1378',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1166.407769] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1166.407769] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1166.408193] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1166.408193] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1166.408193] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1166.408388] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: be9c9972-d782-43b4-ba55-a29e461a1378 is going to be created. [ 1166.432186] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1166.432353] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1166.432426] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1166.432612] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1166.432776] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1166.444311] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: be9c9972-d782-43b4-ba55-a29e461a1378 in Status: UNINITIALIZED for 2s [ 1167.387576] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: fe248172-4be4-4d95-a8ca-c9c2ef203894 in Status: SUCCESS [ 1167.387693] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-fe248172-4be4-4d95-a8ca-c9c2ef203894" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1168.455715] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: be9c9972-d782-43b4-ba55-a29e461a1378 in Status: SUCCESS [ 1168.456199] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-be9c9972-d782-43b4-ba55-a29e461a1378" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1168.456354] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-be9c9972-d782-43b4-ba55-a29e461a1378" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1168.456575] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-be9c9972-d782-43b4-ba55-a29e461a1378" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1168.456803] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1168.456929] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1168.456994] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1168.457173] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1168.457287] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1168.457344] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-be9c9972-d782-43b4-ba55-a29e461a1378" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1168.457423] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('be9c9972-d782-43b4-ba55-a29e461a1378',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1168.959757] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('be9c9972-d782-43b4-ba55-a29e461a1378',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1169.462565] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for be9c9972-d782-43b4-ba55-a29e461a1378: rpc.has_security_group_logging(os_id): False [ 1169.485066] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1169.485066] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1169.485066] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1169.485066] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1169.485441] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1169.485441] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1169.485521] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1169.485562] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1169.485704] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1169.485767] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1169.485854] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: be9c9972-d782-43b4-ba55-a29e461a1378 is going to be created. [ 1169.547407] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1169.547588] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1169.547632] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1169.547856] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1169.548102] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1169.561101] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: be9c9972-d782-43b4-ba55-a29e461a1378 in Status: IN_PROGRESS for 2s [ 1169.894249] env[65370]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1169.894424] env[65370]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=1 [ 1171.575849] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: be9c9972-d782-43b4-ba55-a29e461a1378 in Status: SUCCESS [ 1171.575849] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-be9c9972-d782-43b4-ba55-a29e461a1378" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1174.895881] env[65370]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1174.896246] env[65370]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1178.449286] env[65370]: INFO networking_nsxv3.common.synchronization [req-9fc52105-d338-42a0-a197-c86ec1e7d02c req-b300a08d-8965-4402-ac5e-50244c011347 tempest-AttachInterfacesTestJSON-315686657 tempest-AttachInterfacesTestJSON-315686657-project-member] Enqueued Resource ID: be9c9972-d782-43b4-ba55-a29e461a1378 with Priority: HIGHEST for action security_group_members [ 1178.449625] env[65370]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: be9c9972-d782-43b4-ba55-a29e461a1378 with Priority: HIGHEST for action security_group_members [ 1178.449869] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock member-be9c9972-d782-43b4-ba55-a29e461a1378 taken with stack trace [, , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1178.449995] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-be9c9972-d782-43b4-ba55-a29e461a1378" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1178.450330] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-be9c9972-d782-43b4-ba55-a29e461a1378" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1178.450647] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-be9c9972-d782-43b4-ba55-a29e461a1378" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1178.450766] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1178.450814] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1178.450921] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1178.451037] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1178.451130] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1178.451230] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('be9c9972-d782-43b4-ba55-a29e461a1378',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1178.735298] env[65370]: DEBUG networking_nsxv3.common.locking [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Lock network-309 taken with stack trace [, , , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1178.735486] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquiring lock "network-309" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1178.735669] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquired lock "network-309" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1178.736027] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquired external semaphore "network-309" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1178.736388] env[65370]: DEBUG networking_nsxv3.common.locking [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1178.736614] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquiring lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1178.736780] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquired lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1178.737090] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquired external semaphore "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1178.737289] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Releasing lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1178.737567] env[65370]: DEBUG dogpile.cache.region [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] No value present for key: 'zone-id' {{(pid=65370) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1178.737720] env[65370]: DEBUG dogpile.lock [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] NeedRegenerationException {{(pid=65370) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1178.737873] env[65370]: DEBUG dogpile.lock [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] no value, waiting for create lock {{(pid=65370) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1178.738031] env[65370]: DEBUG dogpile.lock [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] value creation lock acquired {{(pid=65370) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1178.738189] env[65370]: DEBUG dogpile.cache.region [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] No value present for key: 'zone-id' {{(pid=65370) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1178.738337] env[65370]: DEBUG dogpile.lock [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Calling creation function for not-yet-present value {{(pid=65370) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1178.738518] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1178.759784] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1178.760024] env[65370]: DEBUG dogpile.cache.region [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=65370) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1178.760093] env[65370]: DEBUG dogpile.lock [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Released creation lock {{(pid=65370) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1178.760262] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Releasing lock "network-309" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1178.760571] env[65370]: DEBUG networking_nsxv3.common.locking [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Lock port-4b110373-91dd-4a75-b25f-1e32b6a0ea2d taken with stack trace [, , , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1178.760776] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquiring lock "port-4b110373-91dd-4a75-b25f-1e32b6a0ea2d" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1178.760899] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquired lock "port-4b110373-91dd-4a75-b25f-1e32b6a0ea2d" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1178.761252] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquired external semaphore "port-4b110373-91dd-4a75-b25f-1e32b6a0ea2d" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1178.761399] env[65370]: DEBUG networking_nsxv3.api.rpc [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4b110373-91dd-4a75-b25f-1e32b6a0ea2d',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1178.953475] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('be9c9972-d782-43b4-ba55-a29e461a1378',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1179.040763] env[65370]: INFO networking_nsxv3.common.synchronization [req-76b0ea79-b07f-44b9-8e6d-3ae139f47969 req-2e36a87f-959e-41d7-a9e9-11fd72a868e5 tempest-ServerActionsTestOtherA-1239332614 tempest-ServerActionsTestOtherA-1239332614-project-member] Enqueued Resource ID: 408a8a38-c326-4f43-84a2-818a13f7e124 with Priority: HIGHEST for action security_group_members [ 1179.041323] env[65370]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 408a8a38-c326-4f43-84a2-818a13f7e124 with Priority: HIGHEST for action security_group_members [ 1179.041635] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock member-408a8a38-c326-4f43-84a2-818a13f7e124 taken with stack trace [, , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1179.041878] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-408a8a38-c326-4f43-84a2-818a13f7e124" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1179.041975] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-408a8a38-c326-4f43-84a2-818a13f7e124" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1179.042233] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-408a8a38-c326-4f43-84a2-818a13f7e124" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1179.042332] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1179.042417] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1179.042476] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1179.042624] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1179.042708] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1179.042801] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('408a8a38-c326-4f43-84a2-818a13f7e124',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1179.263917] env[65370]: DEBUG networking_nsxv3.common.locking [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1179.264164] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquiring lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1179.264291] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquired lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1179.264573] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquired external semaphore "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1179.264725] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Releasing lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1179.264878] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Segment Port 4b110373-91dd-4a75-b25f-1e32b6a0ea2d not found, creating... [ 1179.265160] env[65370]: DEBUG networking_nsxv3.common.locking [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1179.265325] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquiring lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1179.265441] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquired lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1179.265663] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquired external semaphore "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1179.265794] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Releasing lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1179.266079] env[65370]: DEBUG networking_nsxv3.common.locking [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1179.266235] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquiring lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1179.266349] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquired lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1179.266557] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquired external semaphore "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1179.266708] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Releasing lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1179.266863] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Resource: SegmentPort with ID: 4b110373-91dd-4a75-b25f-1e32b6a0ea2d is going to be created. [ 1179.286393] env[65370]: DEBUG networking_nsxv3.common.locking [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1179.287028] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquiring lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1179.287028] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquired lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1179.287028] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquired external semaphore "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1179.287413] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Releasing lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1179.287507] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Releasing lock "port-4b110373-91dd-4a75-b25f-1e32b6a0ea2d" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1179.455380] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('be9c9972-d782-43b4-ba55-a29e461a1378',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1179.545104] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('408a8a38-c326-4f43-84a2-818a13f7e124',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1179.957366] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1179.957536] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1179.957614] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1179.957818] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1179.957930] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1179.958017] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: be9c9972-d782-43b4-ba55-a29e461a1378 is going to be updated. [ 1179.986168] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1179.986346] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1179.986393] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1179.986598] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1179.986738] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1179.992665] env[65370]: INFO networking_nsxv3.common.synchronization [req-9fc52105-d338-42a0-a197-c86ec1e7d02c req-f1ffa9e6-f164-42d0-b5e8-5ef1eeaa7d33 service nova] Enqueued Resource ID: be9c9972-d782-43b4-ba55-a29e461a1378 with Priority: HIGHEST for action security_group_rules [ 1179.992849] env[65370]: INFO networking_nsxv3.common.synchronization [req-9fc52105-d338-42a0-a197-c86ec1e7d02c req-f1ffa9e6-f164-42d0-b5e8-5ef1eeaa7d33 service nova] Enqueued Resource ID: be9c9972-d782-43b4-ba55-a29e461a1378 with Priority: HIGHEST for action security_group_members [ 1179.992985] env[65370]: INFO networking_nsxv3.common.synchronization [req-9fc52105-d338-42a0-a197-c86ec1e7d02c req-f1ffa9e6-f164-42d0-b5e8-5ef1eeaa7d33 service nova] Enqueued Resource ID: 4b110373-91dd-4a75-b25f-1e32b6a0ea2d with Priority: HIGHEST for action port [ 1179.993885] env[65370]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: be9c9972-d782-43b4-ba55-a29e461a1378 with Priority: HIGHEST for action security_group_rules [ 1179.993885] env[65370]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: be9c9972-d782-43b4-ba55-a29e461a1378 with Priority: HIGHEST for action security_group_members [ 1179.993885] env[65370]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4b110373-91dd-4a75-b25f-1e32b6a0ea2d with Priority: HIGHEST for action port [ 1179.994102] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock rules-be9c9972-d782-43b4-ba55-a29e461a1378 taken with stack trace [, , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1179.994152] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-be9c9972-d782-43b4-ba55-a29e461a1378" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1179.994183] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-be9c9972-d782-43b4-ba55-a29e461a1378" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1179.994375] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-be9c9972-d782-43b4-ba55-a29e461a1378" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1179.994452] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('be9c9972-d782-43b4-ba55-a29e461a1378',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1179.995395] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock member-be9c9972-d782-43b4-ba55-a29e461a1378 taken with stack trace [, , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1179.995494] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-be9c9972-d782-43b4-ba55-a29e461a1378" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1179.995686] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock port-4b110373-91dd-4a75-b25f-1e32b6a0ea2d taken with stack trace [, , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1179.995787] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-4b110373-91dd-4a75-b25f-1e32b6a0ea2d" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1179.995849] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-4b110373-91dd-4a75-b25f-1e32b6a0ea2d" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1179.996771] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-4b110373-91dd-4a75-b25f-1e32b6a0ea2d" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1179.996771] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4b110373-91dd-4a75-b25f-1e32b6a0ea2d',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1179.997802] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: be9c9972-d782-43b4-ba55-a29e461a1378 in Status: IN_PROGRESS for 2s [ 1180.047692] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('408a8a38-c326-4f43-84a2-818a13f7e124',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1180.498048] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock member-be9c9972-d782-43b4-ba55-a29e461a1378 taken with stack trace [, , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1180.498048] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-be9c9972-d782-43b4-ba55-a29e461a1378" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1180.499501] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 4b110373-91dd-4a75-b25f-1e32b6a0ea2d with status ACTIVE [ 1180.499663] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1180.499775] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1180.499837] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1180.500064] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1180.500357] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1180.500357] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1180.500574] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1180.500574] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1180.500681] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1180.500766] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1180.500948] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1180.501085] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1180.501167] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1180.501317] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1180.501412] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1180.501517] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 4b110373-91dd-4a75-b25f-1e32b6a0ea2d is going to be updated. [ 1180.522300] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1180.522567] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1180.522567] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1180.522701] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1180.522842] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1180.523018] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-4b110373-91dd-4a75-b25f-1e32b6a0ea2d" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1180.550310] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1180.550496] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1180.550576] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1180.550878] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1180.550977] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1180.551105] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 408a8a38-c326-4f43-84a2-818a13f7e124 is going to be updated. [ 1180.600442] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1180.600770] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1180.600880] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1180.601082] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1180.601228] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1180.614673] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 408a8a38-c326-4f43-84a2-818a13f7e124 in Status: IN_PROGRESS for 2s [ 1182.011384] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: be9c9972-d782-43b4-ba55-a29e461a1378 in Status: SUCCESS [ 1182.011384] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-be9c9972-d782-43b4-ba55-a29e461a1378" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1182.011384] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-be9c9972-d782-43b4-ba55-a29e461a1378" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1182.011384] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-be9c9972-d782-43b4-ba55-a29e461a1378" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1182.012067] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1182.012067] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1182.012067] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1182.012067] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1182.012067] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1182.012067] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('be9c9972-d782-43b4-ba55-a29e461a1378',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1182.515010] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('be9c9972-d782-43b4-ba55-a29e461a1378',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1182.626087] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 408a8a38-c326-4f43-84a2-818a13f7e124 in Status: SUCCESS [ 1182.626199] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-408a8a38-c326-4f43-84a2-818a13f7e124" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1183.017194] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('be9c9972-d782-43b4-ba55-a29e461a1378',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1183.520509] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1183.520685] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1183.520768] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1183.520987] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1183.521093] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1183.521193] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: be9c9972-d782-43b4-ba55-a29e461a1378 is going to be updated. [ 1183.554581] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1183.554747] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1183.554787] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1183.555020] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1183.555173] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1183.565164] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: be9c9972-d782-43b4-ba55-a29e461a1378 in Status: IN_PROGRESS for 2s [ 1184.994834] env[65370]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1184.995170] env[65370]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=2 [ 1185.576873] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: be9c9972-d782-43b4-ba55-a29e461a1378 in Status: SUCCESS [ 1185.577098] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-be9c9972-d782-43b4-ba55-a29e461a1378" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1185.577268] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-be9c9972-d782-43b4-ba55-a29e461a1378" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1185.577509] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-be9c9972-d782-43b4-ba55-a29e461a1378" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1185.577735] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1185.577862] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1185.577928] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1185.578106] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1185.578302] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1185.578302] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-be9c9972-d782-43b4-ba55-a29e461a1378" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1185.578461] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('be9c9972-d782-43b4-ba55-a29e461a1378',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1185.892575] env[65370]: INFO networking_nsxv3.common.synchronization [req-f6b5db5b-f71a-4a6a-9efa-fd517ef53e78 req-0a931470-2351-4583-8d34-7305872aebe4 tempest-AttachVolumeTestJSON-1795434373 tempest-AttachVolumeTestJSON-1795434373-project-member] Enqueued Resource ID: aa619879-3f9d-4aea-b1cb-1e5adfe92cfd with Priority: HIGHEST for action security_group_members [ 1185.893223] env[65370]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: aa619879-3f9d-4aea-b1cb-1e5adfe92cfd with Priority: HIGHEST for action security_group_members [ 1185.893539] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock member-aa619879-3f9d-4aea-b1cb-1e5adfe92cfd taken with stack trace [, , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1185.893687] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-aa619879-3f9d-4aea-b1cb-1e5adfe92cfd" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1185.893758] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-aa619879-3f9d-4aea-b1cb-1e5adfe92cfd" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1185.894015] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-aa619879-3f9d-4aea-b1cb-1e5adfe92cfd" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1185.894185] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1185.894289] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1185.894351] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1185.894512] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1185.894594] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1185.894688] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('aa619879-3f9d-4aea-b1cb-1e5adfe92cfd',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1186.081156] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('be9c9972-d782-43b4-ba55-a29e461a1378',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1186.396876] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1186.397069] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1186.397146] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1186.397371] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1186.397468] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1186.397710] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1186.397821] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1186.397877] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1186.398057] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1186.398132] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1186.398224] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: aa619879-3f9d-4aea-b1cb-1e5adfe92cfd is going to be updated. [ 1186.428704] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1186.428862] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1186.428954] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1186.429217] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1186.429365] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1186.438267] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: aa619879-3f9d-4aea-b1cb-1e5adfe92cfd in Status: IN_PROGRESS for 2s [ 1186.583430] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for be9c9972-d782-43b4-ba55-a29e461a1378: rpc.has_security_group_logging(os_id): False [ 1186.612384] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1186.612384] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1186.612384] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1186.612632] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1186.612632] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1186.614151] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1186.614151] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1186.614151] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1186.614151] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1186.614151] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1186.614151] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: be9c9972-d782-43b4-ba55-a29e461a1378 is going to be updated. [ 1186.695137] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1186.695137] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1186.695137] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1186.695137] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1186.695137] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1186.713016] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: be9c9972-d782-43b4-ba55-a29e461a1378 in Status: IN_PROGRESS for 2s [ 1188.448753] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: aa619879-3f9d-4aea-b1cb-1e5adfe92cfd in Status: SUCCESS [ 1188.449097] env[65370]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: aa619879-3f9d-4aea-b1cb-1e5adfe92cfd deletion is rescheduled due to dependency. [ 1188.449097] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-aa619879-3f9d-4aea-b1cb-1e5adfe92cfd" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1188.727044] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: be9c9972-d782-43b4-ba55-a29e461a1378 in Status: SUCCESS [ 1188.727044] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-be9c9972-d782-43b4-ba55-a29e461a1378" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1189.441926] env[65370]: INFO networking_nsxv3.common.synchronization [None req-79699681-9bc0-4508-9a4b-ffc89fd09b60 tempest-AttachInterfacesTestJSON-315686657 tempest-AttachInterfacesTestJSON-315686657-project-member] Enqueued Resource ID: 826ed52a-9222-434f-a4f9-e83fd60a5345 with Priority: HIGHEST for action security_group_members [ 1189.443235] env[65370]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 826ed52a-9222-434f-a4f9-e83fd60a5345 with Priority: HIGHEST for action security_group_members [ 1189.443825] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock member-826ed52a-9222-434f-a4f9-e83fd60a5345 taken with stack trace [, , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1189.444036] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-826ed52a-9222-434f-a4f9-e83fd60a5345" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1189.444147] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-826ed52a-9222-434f-a4f9-e83fd60a5345" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1189.444426] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-826ed52a-9222-434f-a4f9-e83fd60a5345" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1189.444681] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1189.444884] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1189.445344] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1189.445717] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1189.445889] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1189.446066] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('826ed52a-9222-434f-a4f9-e83fd60a5345',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1189.951413] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1189.951875] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1189.951875] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1189.951875] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1189.952081] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1189.952164] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1189.952264] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1189.952327] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1189.952474] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1189.952549] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1189.952618] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 826ed52a-9222-434f-a4f9-e83fd60a5345 is going to be updated. [ 1189.978218] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1189.978422] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1189.978422] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1189.978625] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1189.978764] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1189.989065] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 826ed52a-9222-434f-a4f9-e83fd60a5345 in Status: IN_PROGRESS for 2s [ 1191.937310] env[65370]: INFO networking_nsxv3.common.synchronization [None req-722a42c8-8526-420a-9570-6933f184a315 tempest-AttachVolumeTestJSON-1795434373 tempest-AttachVolumeTestJSON-1795434373-project-member] Enqueued Resource ID: f848ee13-2bde-41b3-b6a1-cf583163d5cd with Priority: HIGHEST for action security_group_rules [ 1191.937310] env[65370]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f848ee13-2bde-41b3-b6a1-cf583163d5cd with Priority: HIGHEST for action security_group_rules [ 1191.937310] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock rules-f848ee13-2bde-41b3-b6a1-cf583163d5cd taken with stack trace [, , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1191.937310] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-f848ee13-2bde-41b3-b6a1-cf583163d5cd" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1191.937310] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-f848ee13-2bde-41b3-b6a1-cf583163d5cd" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1191.937310] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-f848ee13-2bde-41b3-b6a1-cf583163d5cd" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1191.937310] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('f848ee13-2bde-41b3-b6a1-cf583163d5cd',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1192.001821] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 826ed52a-9222-434f-a4f9-e83fd60a5345 in Status: SUCCESS [ 1192.001821] env[65370]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 826ed52a-9222-434f-a4f9-e83fd60a5345 deletion is rescheduled due to dependency. [ 1192.001821] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-826ed52a-9222-434f-a4f9-e83fd60a5345" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1192.053273] env[65370]: INFO networking_nsxv3.common.synchronization [None req-dae60ea4-9a1f-4ed0-888d-b863d5624640 tempest-AttachVolumeTestJSON-1795434373 tempest-AttachVolumeTestJSON-1795434373-project-member] Enqueued Resource ID: f848ee13-2bde-41b3-b6a1-cf583163d5cd with Priority: HIGHEST for action security_group_rules [ 1192.054015] env[65370]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f848ee13-2bde-41b3-b6a1-cf583163d5cd with Priority: HIGHEST for action security_group_rules [ 1192.054373] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock rules-f848ee13-2bde-41b3-b6a1-cf583163d5cd taken with stack trace [, , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1192.054517] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-f848ee13-2bde-41b3-b6a1-cf583163d5cd" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1192.459205] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1192.459351] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1192.459441] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1192.459748] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1192.459850] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1192.459953] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: f848ee13-2bde-41b3-b6a1-cf583163d5cd already deleted. [ 1192.460050] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-f848ee13-2bde-41b3-b6a1-cf583163d5cd" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1192.460201] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-f848ee13-2bde-41b3-b6a1-cf583163d5cd" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1192.460360] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-f848ee13-2bde-41b3-b6a1-cf583163d5cd" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1192.460444] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('f848ee13-2bde-41b3-b6a1-cf583163d5cd',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1192.985272] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1192.985578] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1192.985578] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1192.985704] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1192.985861] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1192.986055] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: f848ee13-2bde-41b3-b6a1-cf583163d5cd already deleted. [ 1192.986201] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-f848ee13-2bde-41b3-b6a1-cf583163d5cd" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1196.919049] env[65370]: INFO networking_nsxv3.common.synchronization [req-7840b5b2-00f9-47aa-963e-8f939065d35c req-551c9da0-b10e-4a4d-89fe-508035fa45ab tempest-ServerActionsTestOtherA-1239332614 tempest-ServerActionsTestOtherA-1239332614-project-member] Enqueued Resource ID: 408a8a38-c326-4f43-84a2-818a13f7e124 with Priority: HIGHEST for action security_group_members [ 1196.919644] env[65370]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 408a8a38-c326-4f43-84a2-818a13f7e124 with Priority: HIGHEST for action security_group_members [ 1196.920116] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock member-408a8a38-c326-4f43-84a2-818a13f7e124 taken with stack trace [, , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1196.920575] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-408a8a38-c326-4f43-84a2-818a13f7e124" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1196.920575] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-408a8a38-c326-4f43-84a2-818a13f7e124" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1196.920575] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-408a8a38-c326-4f43-84a2-818a13f7e124" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1196.920790] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1196.920852] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1196.920888] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1196.921049] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1196.921140] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1196.921235] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('408a8a38-c326-4f43-84a2-818a13f7e124',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1197.257027] env[65370]: INFO networking_nsxv3.common.synchronization [req-67dc4a02-8d64-414b-8d74-325b339a19fa req-8c0b5411-d410-43df-b0fd-38777b574f71 tempest-DeleteServersTestJSON-1160924027 tempest-DeleteServersTestJSON-1160924027-project-member] Enqueued Resource ID: 1eaa763e-4469-4428-92d0-ba20a6c99edc with Priority: HIGHEST for action security_group_members [ 1197.257662] env[65370]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1eaa763e-4469-4428-92d0-ba20a6c99edc with Priority: HIGHEST for action security_group_members [ 1197.258868] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock member-1eaa763e-4469-4428-92d0-ba20a6c99edc taken with stack trace [, , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1197.259082] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1eaa763e-4469-4428-92d0-ba20a6c99edc" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1197.259626] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1eaa763e-4469-4428-92d0-ba20a6c99edc" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1197.259952] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1eaa763e-4469-4428-92d0-ba20a6c99edc" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1197.260137] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1197.260284] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1197.260377] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1197.260577] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1197.260693] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1197.260830] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1eaa763e-4469-4428-92d0-ba20a6c99edc',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1197.423918] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1197.424135] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1197.424185] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1197.424369] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1197.424460] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1197.424670] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1197.424773] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1197.424835] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1197.424987] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1197.425080] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1197.425170] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 408a8a38-c326-4f43-84a2-818a13f7e124 is going to be updated. [ 1197.453919] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1197.454174] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1197.454174] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1197.454368] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1197.454514] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1197.463433] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 408a8a38-c326-4f43-84a2-818a13f7e124 in Status: IN_PROGRESS for 2s [ 1197.763153] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1197.763361] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1197.763406] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1197.763616] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1197.763714] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1197.763942] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1197.764081] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1197.764187] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1197.764353] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1197.764431] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1197.764523] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1eaa763e-4469-4428-92d0-ba20a6c99edc is going to be updated. [ 1197.793201] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1197.793353] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1197.793435] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1197.793687] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1197.793768] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1197.802289] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1eaa763e-4469-4428-92d0-ba20a6c99edc in Status: IN_PROGRESS for 2s [ 1198.522065] env[65370]: INFO networking_nsxv3.common.synchronization [req-86460a36-0374-4372-b8ec-3c95f77e2f05 req-e5ee4800-0944-4214-831b-42a602d2cf5c tempest-AttachVolumeTestJSON-1795434373 tempest-AttachVolumeTestJSON-1795434373-project-member] Enqueued Resource ID: f848ee13-2bde-41b3-b6a1-cf583163d5cd with Priority: HIGHEST for action security_group_members [ 1198.522917] env[65370]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f848ee13-2bde-41b3-b6a1-cf583163d5cd with Priority: HIGHEST for action security_group_members [ 1198.524506] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock member-f848ee13-2bde-41b3-b6a1-cf583163d5cd taken with stack trace [, , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1198.524672] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f848ee13-2bde-41b3-b6a1-cf583163d5cd" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1198.524901] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f848ee13-2bde-41b3-b6a1-cf583163d5cd" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1198.525092] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f848ee13-2bde-41b3-b6a1-cf583163d5cd" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1198.525318] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1198.525468] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1198.525568] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1198.525766] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1198.525910] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1198.526080] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f848ee13-2bde-41b3-b6a1-cf583163d5cd',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1198.820159] env[65370]: DEBUG networking_nsxv3.common.locking [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Lock network-455 taken with stack trace [, , , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1198.820365] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquiring lock "network-455" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1198.820489] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquired lock "network-455" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1198.820748] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquired external semaphore "network-455" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1198.821012] env[65370]: DEBUG networking_nsxv3.common.locking [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1198.821172] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquiring lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1198.821283] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquired lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1198.821494] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquired external semaphore "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1198.821637] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Releasing lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1198.821843] env[65370]: DEBUG dogpile.cache.region [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] No value present for key: 'zone-id' {{(pid=65370) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1198.822056] env[65370]: DEBUG dogpile.lock [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] NeedRegenerationException {{(pid=65370) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1198.822111] env[65370]: DEBUG dogpile.lock [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] no value, waiting for create lock {{(pid=65370) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1198.822200] env[65370]: DEBUG dogpile.lock [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] value creation lock acquired {{(pid=65370) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1198.822314] env[65370]: DEBUG dogpile.cache.region [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] No value present for key: 'zone-id' {{(pid=65370) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1198.822429] env[65370]: DEBUG dogpile.lock [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Calling creation function for not-yet-present value {{(pid=65370) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1198.822561] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1198.844270] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1198.844453] env[65370]: DEBUG dogpile.cache.region [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=65370) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1198.844607] env[65370]: DEBUG dogpile.lock [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Released creation lock {{(pid=65370) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1198.844748] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Releasing lock "network-455" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1198.845114] env[65370]: DEBUG networking_nsxv3.common.locking [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Lock port-5efc65f0-5478-463a-b650-94d78fa7e3e7 taken with stack trace [, , , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1198.845304] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquiring lock "port-5efc65f0-5478-463a-b650-94d78fa7e3e7" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1198.845422] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquired lock "port-5efc65f0-5478-463a-b650-94d78fa7e3e7" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1198.845746] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquired external semaphore "port-5efc65f0-5478-463a-b650-94d78fa7e3e7" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1198.845888] env[65370]: DEBUG networking_nsxv3.api.rpc [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5efc65f0-5478-463a-b650-94d78fa7e3e7',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1199.028390] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1199.028563] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1199.028672] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1199.028857] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1199.028942] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1199.029165] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1199.029267] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1199.029328] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1199.029478] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1199.029550] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1199.029646] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f848ee13-2bde-41b3-b6a1-cf583163d5cd already deleted. [ 1199.029711] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f848ee13-2bde-41b3-b6a1-cf583163d5cd" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1199.348032] env[65370]: DEBUG networking_nsxv3.common.locking [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1199.348734] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquiring lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1199.348734] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquired lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1199.348734] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquired external semaphore "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1199.348900] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Releasing lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1199.348987] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Segment Port 5efc65f0-5478-463a-b650-94d78fa7e3e7 not found, creating... [ 1199.349267] env[65370]: DEBUG networking_nsxv3.common.locking [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1199.349436] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquiring lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1199.349551] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquired lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1199.349830] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquired external semaphore "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1199.349979] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Releasing lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1199.350280] env[65370]: DEBUG networking_nsxv3.common.locking [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1199.350433] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquiring lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1199.350556] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquired lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1199.350814] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquired external semaphore "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1199.350906] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Releasing lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1199.351056] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Resource: SegmentPort with ID: 5efc65f0-5478-463a-b650-94d78fa7e3e7 is going to be created. [ 1199.375460] env[65370]: DEBUG networking_nsxv3.common.locking [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1199.375653] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquiring lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1199.375788] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquired lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1199.376093] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquired external semaphore "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1199.376334] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Releasing lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1199.377028] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Releasing lock "port-5efc65f0-5478-463a-b650-94d78fa7e3e7" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1199.474727] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 408a8a38-c326-4f43-84a2-818a13f7e124 in Status: SUCCESS [ 1199.474727] env[65370]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 408a8a38-c326-4f43-84a2-818a13f7e124 deletion is rescheduled due to dependency. [ 1199.474727] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-408a8a38-c326-4f43-84a2-818a13f7e124" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1199.812510] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1eaa763e-4469-4428-92d0-ba20a6c99edc in Status: SUCCESS [ 1199.812510] env[65370]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1eaa763e-4469-4428-92d0-ba20a6c99edc deletion is rescheduled due to dependency. [ 1199.812510] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1eaa763e-4469-4428-92d0-ba20a6c99edc" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1200.045334] env[65370]: INFO networking_nsxv3.common.synchronization [req-86460a36-0374-4372-b8ec-3c95f77e2f05 req-3e83a206-2a5c-4169-b8e6-e96b48f89871 service nova] Enqueued Resource ID: f848ee13-2bde-41b3-b6a1-cf583163d5cd with Priority: HIGHEST for action security_group_rules [ 1200.045334] env[65370]: INFO networking_nsxv3.common.synchronization [req-86460a36-0374-4372-b8ec-3c95f77e2f05 req-3e83a206-2a5c-4169-b8e6-e96b48f89871 service nova] Enqueued Resource ID: f848ee13-2bde-41b3-b6a1-cf583163d5cd with Priority: HIGHEST for action security_group_members [ 1200.045334] env[65370]: INFO networking_nsxv3.common.synchronization [req-86460a36-0374-4372-b8ec-3c95f77e2f05 req-3e83a206-2a5c-4169-b8e6-e96b48f89871 service nova] Enqueued Resource ID: 5efc65f0-5478-463a-b650-94d78fa7e3e7 with Priority: HIGHEST for action port [ 1200.045334] env[65370]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f848ee13-2bde-41b3-b6a1-cf583163d5cd with Priority: HIGHEST for action security_group_rules [ 1200.045334] env[65370]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f848ee13-2bde-41b3-b6a1-cf583163d5cd with Priority: HIGHEST for action security_group_members [ 1200.045334] env[65370]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5efc65f0-5478-463a-b650-94d78fa7e3e7 with Priority: HIGHEST for action port [ 1200.045334] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock rules-f848ee13-2bde-41b3-b6a1-cf583163d5cd taken with stack trace [, , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1200.045334] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-f848ee13-2bde-41b3-b6a1-cf583163d5cd" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1200.045825] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-f848ee13-2bde-41b3-b6a1-cf583163d5cd" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1200.046067] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-f848ee13-2bde-41b3-b6a1-cf583163d5cd" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1200.046158] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('f848ee13-2bde-41b3-b6a1-cf583163d5cd',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1200.046981] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock member-f848ee13-2bde-41b3-b6a1-cf583163d5cd taken with stack trace [, , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1200.047295] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f848ee13-2bde-41b3-b6a1-cf583163d5cd" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1200.047295] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f848ee13-2bde-41b3-b6a1-cf583163d5cd" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1200.047394] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f848ee13-2bde-41b3-b6a1-cf583163d5cd" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1200.047530] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1200.047618] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1200.047680] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1200.047864] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1200.047900] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1200.047983] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f848ee13-2bde-41b3-b6a1-cf583163d5cd',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1200.048919] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock port-5efc65f0-5478-463a-b650-94d78fa7e3e7 taken with stack trace [, , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1200.048919] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-5efc65f0-5478-463a-b650-94d78fa7e3e7" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1200.048919] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-5efc65f0-5478-463a-b650-94d78fa7e3e7" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1200.049099] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-5efc65f0-5478-463a-b650-94d78fa7e3e7" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1200.049182] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5efc65f0-5478-463a-b650-94d78fa7e3e7',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1200.551924] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('f848ee13-2bde-41b3-b6a1-cf583163d5cd',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1200.552695] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock member-f848ee13-2bde-41b3-b6a1-cf583163d5cd taken with stack trace [, , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1200.552791] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f848ee13-2bde-41b3-b6a1-cf583163d5cd" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1200.552885] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 5efc65f0-5478-463a-b650-94d78fa7e3e7 with status ACTIVE [ 1200.553057] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1200.553670] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1200.553670] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1200.553670] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1200.553670] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1200.553670] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1200.553963] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1200.553963] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1200.553963] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1200.554073] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1200.554302] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1200.554302] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1200.554429] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1200.554471] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1200.554511] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1200.554693] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 5efc65f0-5478-463a-b650-94d78fa7e3e7 is going to be updated. [ 1200.578801] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1200.578801] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1200.578801] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1200.578801] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1200.578801] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1200.578801] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-5efc65f0-5478-463a-b650-94d78fa7e3e7" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1201.056450] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('f848ee13-2bde-41b3-b6a1-cf583163d5cd',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1201.559836] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1201.560117] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1201.560117] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1201.560321] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1201.560412] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1201.560516] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f848ee13-2bde-41b3-b6a1-cf583163d5cd is going to be created. [ 1201.586196] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1201.586444] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1201.586584] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1201.586913] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1201.587193] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1201.601085] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f848ee13-2bde-41b3-b6a1-cf583163d5cd in Status: UNINITIALIZED for 2s [ 1203.615309] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f848ee13-2bde-41b3-b6a1-cf583163d5cd in Status: SUCCESS [ 1203.615309] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f848ee13-2bde-41b3-b6a1-cf583163d5cd" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1203.615309] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f848ee13-2bde-41b3-b6a1-cf583163d5cd" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1203.615661] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f848ee13-2bde-41b3-b6a1-cf583163d5cd" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1203.615661] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1203.615760] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1203.615760] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1203.620026] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1203.620026] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1203.620026] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f848ee13-2bde-41b3-b6a1-cf583163d5cd" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1203.620026] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('f848ee13-2bde-41b3-b6a1-cf583163d5cd',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1204.118183] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('f848ee13-2bde-41b3-b6a1-cf583163d5cd',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1204.620870] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for f848ee13-2bde-41b3-b6a1-cf583163d5cd: rpc.has_security_group_logging(os_id): False [ 1204.639540] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1204.639768] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1204.639768] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1204.640066] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1204.640163] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1204.640414] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1204.640522] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1204.640584] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1204.640739] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1204.640829] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1204.640927] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: f848ee13-2bde-41b3-b6a1-cf583163d5cd is going to be created. [ 1204.730077] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1204.730077] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1204.730077] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1204.730077] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1204.730077] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1204.741773] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: f848ee13-2bde-41b3-b6a1-cf583163d5cd in Status: IN_PROGRESS for 2s [ 1205.045213] env[65370]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1205.045359] env[65370]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=1 [ 1206.771649] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: f848ee13-2bde-41b3-b6a1-cf583163d5cd in Status: SUCCESS [ 1206.771968] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-f848ee13-2bde-41b3-b6a1-cf583163d5cd" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1207.537936] env[65370]: INFO networking_nsxv3.common.synchronization [req-eaeaae2a-abfc-4851-9f5d-901f36b53819 req-a9bf8cc2-71bd-443c-b6da-15ffe023cd29 tempest-AttachVolumeNegativeTest-719365731 tempest-AttachVolumeNegativeTest-719365731-project-member] Enqueued Resource ID: e32dcc83-5b25-41d1-bde2-d13514b085ad with Priority: HIGHEST for action security_group_members [ 1207.538748] env[65370]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e32dcc83-5b25-41d1-bde2-d13514b085ad with Priority: HIGHEST for action security_group_members [ 1207.538748] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock member-e32dcc83-5b25-41d1-bde2-d13514b085ad taken with stack trace [, , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1207.538748] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e32dcc83-5b25-41d1-bde2-d13514b085ad" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1207.538748] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e32dcc83-5b25-41d1-bde2-d13514b085ad" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1207.539077] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e32dcc83-5b25-41d1-bde2-d13514b085ad" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1207.539123] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1207.539229] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1207.539289] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1207.539446] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1207.539526] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1207.539613] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e32dcc83-5b25-41d1-bde2-d13514b085ad',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1208.042178] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1208.042706] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1208.042706] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1208.043262] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1208.043262] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1208.043389] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1208.043445] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1208.043929] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1208.043929] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1208.043929] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1208.043929] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e32dcc83-5b25-41d1-bde2-d13514b085ad is going to be updated. [ 1208.073456] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1208.073740] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1208.074043] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1208.074146] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1208.074394] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1208.084283] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e32dcc83-5b25-41d1-bde2-d13514b085ad in Status: IN_PROGRESS for 2s [ 1209.083022] env[65370]: DEBUG networking_nsxv3.common.locking [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Lock network-93 taken with stack trace [, , , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1209.083022] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquiring lock "network-93" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1209.083022] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquired lock "network-93" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1209.083022] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquired external semaphore "network-93" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1209.083022] env[65370]: DEBUG networking_nsxv3.common.locking [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1209.083022] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquiring lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1209.084078] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquired lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1209.087878] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquired external semaphore "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1209.087878] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Releasing lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1209.087878] env[65370]: DEBUG dogpile.cache.region [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] No value present for key: 'zone-id' {{(pid=65370) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1209.087878] env[65370]: DEBUG dogpile.lock [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] NeedRegenerationException {{(pid=65370) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1209.087878] env[65370]: DEBUG dogpile.lock [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] no value, waiting for create lock {{(pid=65370) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1209.087878] env[65370]: DEBUG dogpile.lock [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] value creation lock acquired {{(pid=65370) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1209.087878] env[65370]: DEBUG dogpile.cache.region [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] No value present for key: 'zone-id' {{(pid=65370) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1209.087878] env[65370]: DEBUG dogpile.lock [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Calling creation function for not-yet-present value {{(pid=65370) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1209.087878] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1209.107032] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1209.107032] env[65370]: DEBUG dogpile.cache.region [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=65370) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1209.107032] env[65370]: DEBUG dogpile.lock [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Released creation lock {{(pid=65370) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1209.107032] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Releasing lock "network-93" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1209.107032] env[65370]: DEBUG networking_nsxv3.common.locking [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Lock port-beb9aaec-73ed-43b5-b8b2-371d04a3ff0c taken with stack trace [, , , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1209.107032] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquiring lock "port-beb9aaec-73ed-43b5-b8b2-371d04a3ff0c" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1209.107032] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquired lock "port-beb9aaec-73ed-43b5-b8b2-371d04a3ff0c" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1209.107032] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquired external semaphore "port-beb9aaec-73ed-43b5-b8b2-371d04a3ff0c" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1209.107032] env[65370]: DEBUG networking_nsxv3.api.rpc [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('beb9aaec-73ed-43b5-b8b2-371d04a3ff0c',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1209.299076] env[65370]: INFO networking_nsxv3.common.synchronization [None req-abcd825b-385a-490e-bca5-1a718cf23863 None None] Enqueued Resource ID: 05142fc4-80c3-4714-9763-2db08acc61db with Priority: HIGHEST for action port [ 1209.299612] env[65370]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 05142fc4-80c3-4714-9763-2db08acc61db with Priority: HIGHEST for action port [ 1209.300030] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock port-05142fc4-80c3-4714-9763-2db08acc61db taken with stack trace [, , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1209.300169] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-05142fc4-80c3-4714-9763-2db08acc61db" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1209.300279] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-05142fc4-80c3-4714-9763-2db08acc61db" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1209.300703] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-05142fc4-80c3-4714-9763-2db08acc61db" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1209.300790] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('05142fc4-80c3-4714-9763-2db08acc61db',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1209.609936] env[65370]: DEBUG networking_nsxv3.common.locking [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1209.610228] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquiring lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1209.610487] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquired lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1209.610649] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquired external semaphore "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1209.610801] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Releasing lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1209.611163] env[65370]: DEBUG networking_nsxv3.common.locking [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1209.611383] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquiring lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1209.611523] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquired lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1209.611815] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquired external semaphore "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1209.611881] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Releasing lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1209.612137] env[65370]: DEBUG networking_nsxv3.common.locking [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1209.612318] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquiring lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1209.612413] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquired lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1209.612927] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquired external semaphore "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1209.612927] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Releasing lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1209.612927] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Resource: SegmentPort with ID: beb9aaec-73ed-43b5-b8b2-371d04a3ff0c is going to be updated. [ 1209.634941] env[65370]: DEBUG networking_nsxv3.common.locking [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1209.635070] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquiring lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1209.635314] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquired lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1209.635764] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquired external semaphore "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1209.636085] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Releasing lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1209.636464] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Releasing lock "port-beb9aaec-73ed-43b5-b8b2-371d04a3ff0c" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1209.803400] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 05142fc4-80c3-4714-9763-2db08acc61db [ 1209.803633] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1209.803765] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1209.803836] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1209.804065] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1209.804159] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1209.804261] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:05142fc4-80c3-4714-9763-2db08acc61db already deleted. [ 1209.804333] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-05142fc4-80c3-4714-9763-2db08acc61db" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1210.094346] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e32dcc83-5b25-41d1-bde2-d13514b085ad in Status: SUCCESS [ 1210.094631] env[65370]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e32dcc83-5b25-41d1-bde2-d13514b085ad deletion is rescheduled due to dependency. [ 1210.094631] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e32dcc83-5b25-41d1-bde2-d13514b085ad" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1210.195257] env[65370]: INFO networking_nsxv3.common.synchronization [req-a8118eda-faf9-467f-b10d-7dafc0bbee4f req-7d88e265-9033-41c9-a5e1-fc4c3edbfac5 tempest-AttachVolumeShelveTestJSON-478164993 tempest-AttachVolumeShelveTestJSON-478164993-project-member] Enqueued Resource ID: 154b7e30-9d22-43f4-84bb-7d8dd4d7cc9a with Priority: HIGHEST for action security_group_members [ 1210.195923] env[65370]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 154b7e30-9d22-43f4-84bb-7d8dd4d7cc9a with Priority: HIGHEST for action security_group_members [ 1210.196031] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock member-154b7e30-9d22-43f4-84bb-7d8dd4d7cc9a taken with stack trace [, , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1210.197235] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-154b7e30-9d22-43f4-84bb-7d8dd4d7cc9a" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1210.197235] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-154b7e30-9d22-43f4-84bb-7d8dd4d7cc9a" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1210.197235] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-154b7e30-9d22-43f4-84bb-7d8dd4d7cc9a" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1210.197235] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1210.197235] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1210.197235] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1210.197235] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1210.197235] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1210.197235] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('154b7e30-9d22-43f4-84bb-7d8dd4d7cc9a',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1210.388430] env[65370]: INFO networking_nsxv3.common.synchronization [req-ef772d76-420f-4053-9d00-254d707490ce req-0f99bfe3-072c-4bce-808f-cf1d166bb6d3 service nova] Enqueued Resource ID: 2011abd7-ba10-4aae-84fb-1b1bfbd238fa with Priority: HIGHEST for action security_group_rules [ 1210.388574] env[65370]: INFO networking_nsxv3.common.synchronization [req-ef772d76-420f-4053-9d00-254d707490ce req-0f99bfe3-072c-4bce-808f-cf1d166bb6d3 service nova] Enqueued Resource ID: 2011abd7-ba10-4aae-84fb-1b1bfbd238fa with Priority: HIGHEST for action security_group_members [ 1210.388720] env[65370]: INFO networking_nsxv3.common.synchronization [req-ef772d76-420f-4053-9d00-254d707490ce req-0f99bfe3-072c-4bce-808f-cf1d166bb6d3 service nova] Enqueued Resource ID: beb9aaec-73ed-43b5-b8b2-371d04a3ff0c with Priority: HIGHEST for action port [ 1210.389641] env[65370]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2011abd7-ba10-4aae-84fb-1b1bfbd238fa with Priority: HIGHEST for action security_group_rules [ 1210.389779] env[65370]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2011abd7-ba10-4aae-84fb-1b1bfbd238fa with Priority: HIGHEST for action security_group_members [ 1210.389878] env[65370]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: beb9aaec-73ed-43b5-b8b2-371d04a3ff0c with Priority: HIGHEST for action port [ 1210.390565] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock rules-2011abd7-ba10-4aae-84fb-1b1bfbd238fa taken with stack trace [, , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1210.390658] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-2011abd7-ba10-4aae-84fb-1b1bfbd238fa" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1210.390658] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-2011abd7-ba10-4aae-84fb-1b1bfbd238fa" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1210.390865] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-2011abd7-ba10-4aae-84fb-1b1bfbd238fa" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1210.390942] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('2011abd7-ba10-4aae-84fb-1b1bfbd238fa',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1210.394340] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock member-2011abd7-ba10-4aae-84fb-1b1bfbd238fa taken with stack trace [, , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1210.394471] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2011abd7-ba10-4aae-84fb-1b1bfbd238fa" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1210.394541] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2011abd7-ba10-4aae-84fb-1b1bfbd238fa" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1210.394826] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2011abd7-ba10-4aae-84fb-1b1bfbd238fa" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1210.395339] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1210.395455] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1210.395522] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1210.395694] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1210.395880] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1210.396009] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2011abd7-ba10-4aae-84fb-1b1bfbd238fa',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1210.397210] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock port-beb9aaec-73ed-43b5-b8b2-371d04a3ff0c taken with stack trace [, , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1210.397341] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-beb9aaec-73ed-43b5-b8b2-371d04a3ff0c" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1210.397409] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-beb9aaec-73ed-43b5-b8b2-371d04a3ff0c" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1210.397666] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-beb9aaec-73ed-43b5-b8b2-371d04a3ff0c" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1210.397750] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('beb9aaec-73ed-43b5-b8b2-371d04a3ff0c',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1210.701148] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1210.701324] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1210.701421] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1210.701648] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1210.701740] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1210.701977] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1210.702226] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1210.702282] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1210.702501] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1210.702569] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1210.702699] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 154b7e30-9d22-43f4-84bb-7d8dd4d7cc9a is going to be updated. [ 1210.745052] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1210.745212] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1210.745286] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1210.745508] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1210.745684] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1210.755044] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 154b7e30-9d22-43f4-84bb-7d8dd4d7cc9a in Status: IN_PROGRESS for 2s [ 1210.901179] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port beb9aaec-73ed-43b5-b8b2-371d04a3ff0c with status ACTIVE [ 1210.901425] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1210.901573] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1210.901643] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1210.901853] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1210.901938] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1210.902127] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1210.902227] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1210.902286] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1210.902426] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1210.902499] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1210.902675] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1210.902768] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1210.902825] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1210.902958] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1210.903043] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1210.903125] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: beb9aaec-73ed-43b5-b8b2-371d04a3ff0c is going to be updated. [ 1210.904508] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock member-2011abd7-ba10-4aae-84fb-1b1bfbd238fa taken with stack trace [, , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1210.904605] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2011abd7-ba10-4aae-84fb-1b1bfbd238fa" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1210.904772] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('2011abd7-ba10-4aae-84fb-1b1bfbd238fa',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1210.926169] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1210.926346] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1210.926400] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1210.927437] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1210.927996] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1210.927996] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-beb9aaec-73ed-43b5-b8b2-371d04a3ff0c" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1211.407386] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('2011abd7-ba10-4aae-84fb-1b1bfbd238fa',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1211.560598] env[65370]: INFO networking_nsxv3.common.synchronization [None req-64ea8e00-1cdd-4bac-a20d-8c613ad0e4e5 None None] Enqueued Resource ID: 62b0eee2-b22e-475e-8448-9ecb5bd44963 with Priority: HIGHEST for action port [ 1211.561104] env[65370]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 62b0eee2-b22e-475e-8448-9ecb5bd44963 with Priority: HIGHEST for action port [ 1211.561681] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock port-62b0eee2-b22e-475e-8448-9ecb5bd44963 taken with stack trace [, , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1211.561681] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-62b0eee2-b22e-475e-8448-9ecb5bd44963" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1211.561681] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-62b0eee2-b22e-475e-8448-9ecb5bd44963" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1211.561917] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-62b0eee2-b22e-475e-8448-9ecb5bd44963" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1211.561917] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('62b0eee2-b22e-475e-8448-9ecb5bd44963',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1211.910534] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1211.910709] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1211.910754] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1211.911116] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1211.911569] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1211.911569] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2011abd7-ba10-4aae-84fb-1b1bfbd238fa is going to be updated. [ 1211.940830] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1211.941000] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1211.941060] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1211.941273] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1211.941476] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1211.950630] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2011abd7-ba10-4aae-84fb-1b1bfbd238fa in Status: IN_PROGRESS for 2s [ 1212.063601] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 62b0eee2-b22e-475e-8448-9ecb5bd44963 [ 1212.063841] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1212.063948] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1212.064024] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1212.064249] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1212.064340] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1212.064441] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:62b0eee2-b22e-475e-8448-9ecb5bd44963 already deleted. [ 1212.064525] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-62b0eee2-b22e-475e-8448-9ecb5bd44963" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1212.298520] env[65370]: DEBUG networking_nsxv3.common.locking [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Lock network-309 taken with stack trace [, , , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1212.298715] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquiring lock "network-309" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1212.298836] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquired lock "network-309" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1212.299116] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquired external semaphore "network-309" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1212.299369] env[65370]: DEBUG networking_nsxv3.common.locking [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1212.299523] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquiring lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1212.299636] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquired lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1212.299852] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquired external semaphore "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1212.300023] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Releasing lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1212.300228] env[65370]: DEBUG dogpile.cache.region [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] No value present for key: 'zone-id' {{(pid=65370) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1212.300337] env[65370]: DEBUG dogpile.lock [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] NeedRegenerationException {{(pid=65370) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1212.300439] env[65370]: DEBUG dogpile.lock [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] no value, waiting for create lock {{(pid=65370) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1212.300548] env[65370]: DEBUG dogpile.lock [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] value creation lock acquired {{(pid=65370) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1212.300653] env[65370]: DEBUG dogpile.cache.region [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] No value present for key: 'zone-id' {{(pid=65370) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1212.300753] env[65370]: DEBUG dogpile.lock [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Calling creation function for not-yet-present value {{(pid=65370) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1212.300880] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1212.319857] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1212.320067] env[65370]: DEBUG dogpile.cache.region [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=65370) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1212.320212] env[65370]: DEBUG dogpile.lock [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Released creation lock {{(pid=65370) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1212.320388] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Releasing lock "network-309" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1212.320697] env[65370]: DEBUG networking_nsxv3.common.locking [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Lock port-b7aab3bd-d83f-4222-8a27-b0352b774bf1 taken with stack trace [, , , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1212.320863] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquiring lock "port-b7aab3bd-d83f-4222-8a27-b0352b774bf1" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1212.321040] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquired lock "port-b7aab3bd-d83f-4222-8a27-b0352b774bf1" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1212.321362] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquired external semaphore "port-b7aab3bd-d83f-4222-8a27-b0352b774bf1" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1212.321506] env[65370]: DEBUG networking_nsxv3.api.rpc [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b7aab3bd-d83f-4222-8a27-b0352b774bf1',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1212.764783] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 154b7e30-9d22-43f4-84bb-7d8dd4d7cc9a in Status: SUCCESS [ 1212.765048] env[65370]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 154b7e30-9d22-43f4-84bb-7d8dd4d7cc9a deletion is rescheduled due to dependency. [ 1212.765123] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-154b7e30-9d22-43f4-84bb-7d8dd4d7cc9a" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1212.827121] env[65370]: DEBUG networking_nsxv3.common.locking [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1212.827349] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquiring lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1212.827470] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquired lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1212.827750] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquired external semaphore "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1212.827898] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Releasing lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1212.828058] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Segment Port b7aab3bd-d83f-4222-8a27-b0352b774bf1 not found, creating... [ 1212.828322] env[65370]: DEBUG networking_nsxv3.common.locking [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1212.828478] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquiring lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1212.828590] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquired lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1212.828863] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquired external semaphore "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1212.828999] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Releasing lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1212.829335] env[65370]: DEBUG networking_nsxv3.common.locking [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1212.829490] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquiring lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1212.829621] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquired lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1212.829808] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquired external semaphore "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1212.829928] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Releasing lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1212.830074] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Resource: SegmentPort with ID: b7aab3bd-d83f-4222-8a27-b0352b774bf1 is going to be created. [ 1212.850534] env[65370]: DEBUG networking_nsxv3.common.locking [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1212.850773] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquiring lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1212.851815] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquired lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1212.851815] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquired external semaphore "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1212.851815] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Releasing lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1212.851815] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Releasing lock "port-b7aab3bd-d83f-4222-8a27-b0352b774bf1" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1213.546036] env[65370]: INFO networking_nsxv3.common.synchronization [req-7c80d3ec-670c-49ed-95a3-17d885c88308 req-a97673a7-7496-4cad-b108-ec9dae86cbd3 service nova] Enqueued Resource ID: 826ed52a-9222-434f-a4f9-e83fd60a5345 with Priority: HIGHEST for action security_group_rules [ 1213.546036] env[65370]: INFO networking_nsxv3.common.synchronization [req-7c80d3ec-670c-49ed-95a3-17d885c88308 req-a97673a7-7496-4cad-b108-ec9dae86cbd3 service nova] Enqueued Resource ID: 826ed52a-9222-434f-a4f9-e83fd60a5345 with Priority: HIGHEST for action security_group_members [ 1213.546036] env[65370]: INFO networking_nsxv3.common.synchronization [req-7c80d3ec-670c-49ed-95a3-17d885c88308 req-a97673a7-7496-4cad-b108-ec9dae86cbd3 service nova] Enqueued Resource ID: b7aab3bd-d83f-4222-8a27-b0352b774bf1 with Priority: HIGHEST for action port [ 1213.546036] env[65370]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 826ed52a-9222-434f-a4f9-e83fd60a5345 with Priority: HIGHEST for action security_group_rules [ 1213.546036] env[65370]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 826ed52a-9222-434f-a4f9-e83fd60a5345 with Priority: HIGHEST for action security_group_members [ 1213.546606] env[65370]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b7aab3bd-d83f-4222-8a27-b0352b774bf1 with Priority: HIGHEST for action port [ 1213.547187] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock rules-826ed52a-9222-434f-a4f9-e83fd60a5345 taken with stack trace [, , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1213.547433] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-826ed52a-9222-434f-a4f9-e83fd60a5345" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1213.547572] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-826ed52a-9222-434f-a4f9-e83fd60a5345" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1213.548108] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-826ed52a-9222-434f-a4f9-e83fd60a5345" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1213.548275] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('826ed52a-9222-434f-a4f9-e83fd60a5345',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1213.549712] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock member-826ed52a-9222-434f-a4f9-e83fd60a5345 taken with stack trace [, , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1213.550090] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-826ed52a-9222-434f-a4f9-e83fd60a5345" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1213.550270] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-826ed52a-9222-434f-a4f9-e83fd60a5345" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1213.550575] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-826ed52a-9222-434f-a4f9-e83fd60a5345" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1213.551053] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1213.552284] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1213.552284] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1213.552284] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1213.552284] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1213.552284] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('826ed52a-9222-434f-a4f9-e83fd60a5345',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1213.553045] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock port-b7aab3bd-d83f-4222-8a27-b0352b774bf1 taken with stack trace [, , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1213.553281] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b7aab3bd-d83f-4222-8a27-b0352b774bf1" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1213.553477] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b7aab3bd-d83f-4222-8a27-b0352b774bf1" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1213.553866] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b7aab3bd-d83f-4222-8a27-b0352b774bf1" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1213.554082] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b7aab3bd-d83f-4222-8a27-b0352b774bf1',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1213.960362] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2011abd7-ba10-4aae-84fb-1b1bfbd238fa in Status: SUCCESS [ 1213.960702] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2011abd7-ba10-4aae-84fb-1b1bfbd238fa" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1213.960741] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2011abd7-ba10-4aae-84fb-1b1bfbd238fa" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1213.960999] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2011abd7-ba10-4aae-84fb-1b1bfbd238fa" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1213.961240] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1213.961365] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1213.961466] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1213.961599] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1213.961685] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1213.962643] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2011abd7-ba10-4aae-84fb-1b1bfbd238fa" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1213.962643] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('2011abd7-ba10-4aae-84fb-1b1bfbd238fa',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1214.053621] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('826ed52a-9222-434f-a4f9-e83fd60a5345',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1214.055694] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock member-826ed52a-9222-434f-a4f9-e83fd60a5345 taken with stack trace [, , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1214.055806] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-826ed52a-9222-434f-a4f9-e83fd60a5345" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1214.055987] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port b7aab3bd-d83f-4222-8a27-b0352b774bf1 with status ACTIVE [ 1214.056285] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1214.056440] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1214.056533] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1214.056807] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1214.056944] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1214.057227] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1214.057383] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1214.057485] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1214.057776] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1214.057832] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1214.058111] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1214.058259] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1214.058360] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1214.058575] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1214.058705] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1214.058840] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: b7aab3bd-d83f-4222-8a27-b0352b774bf1 is going to be updated. [ 1214.080359] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1214.080548] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1214.080592] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1214.080819] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1214.081047] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1214.081220] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b7aab3bd-d83f-4222-8a27-b0352b774bf1" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1214.464836] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('2011abd7-ba10-4aae-84fb-1b1bfbd238fa',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1214.556239] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('826ed52a-9222-434f-a4f9-e83fd60a5345',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1214.969100] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 2011abd7-ba10-4aae-84fb-1b1bfbd238fa: rpc.has_security_group_logging(os_id): False [ 1214.987874] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1214.988065] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1214.988114] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1214.988328] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1214.988413] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1214.988661] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1214.988778] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1214.988837] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1214.989013] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1214.989088] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1214.989171] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 2011abd7-ba10-4aae-84fb-1b1bfbd238fa is going to be updated. [ 1215.054379] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1215.054581] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1215.054581] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1215.054786] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1215.054957] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1215.059720] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1215.059868] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1215.059996] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1215.060237] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1215.060329] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1215.060448] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 826ed52a-9222-434f-a4f9-e83fd60a5345 is going to be updated. [ 1215.070638] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 2011abd7-ba10-4aae-84fb-1b1bfbd238fa in Status: IN_PROGRESS for 2s [ 1215.108980] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1215.109456] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1215.109456] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1215.109456] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1215.109613] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1215.130967] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 826ed52a-9222-434f-a4f9-e83fd60a5345 in Status: IN_PROGRESS for 2s [ 1216.516397] env[65370]: INFO networking_nsxv3.common.synchronization [None req-b1baa430-5aaa-4809-80dc-696722f65dec tempest-AttachVolumeShelveTestJSON-478164993 tempest-AttachVolumeShelveTestJSON-478164993-project-member] Enqueued Resource ID: d40b0ebb-5855-4234-b52c-c2003a5df171 with Priority: HIGHEST for action security_group_rules [ 1216.517066] env[65370]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d40b0ebb-5855-4234-b52c-c2003a5df171 with Priority: HIGHEST for action security_group_rules [ 1216.517371] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d40b0ebb-5855-4234-b52c-c2003a5df171 taken with stack trace [, , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1216.517501] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d40b0ebb-5855-4234-b52c-c2003a5df171" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1216.517570] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d40b0ebb-5855-4234-b52c-c2003a5df171" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1216.517894] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d40b0ebb-5855-4234-b52c-c2003a5df171" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1216.517985] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d40b0ebb-5855-4234-b52c-c2003a5df171',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1216.609934] env[65370]: INFO networking_nsxv3.common.synchronization [None req-314e518a-2cad-4300-9eb9-1dd34bb078eb tempest-AttachVolumeShelveTestJSON-478164993 tempest-AttachVolumeShelveTestJSON-478164993-project-member] Enqueued Resource ID: d40b0ebb-5855-4234-b52c-c2003a5df171 with Priority: HIGHEST for action security_group_rules [ 1216.610619] env[65370]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d40b0ebb-5855-4234-b52c-c2003a5df171 with Priority: HIGHEST for action security_group_rules [ 1216.610936] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d40b0ebb-5855-4234-b52c-c2003a5df171 taken with stack trace [, , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1216.611043] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d40b0ebb-5855-4234-b52c-c2003a5df171" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1217.039087] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1217.039327] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1217.039375] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1217.039611] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1217.039714] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1217.039823] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d40b0ebb-5855-4234-b52c-c2003a5df171 already deleted. [ 1217.039909] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d40b0ebb-5855-4234-b52c-c2003a5df171" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1217.040255] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d40b0ebb-5855-4234-b52c-c2003a5df171" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1217.040444] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d40b0ebb-5855-4234-b52c-c2003a5df171" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1217.040639] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d40b0ebb-5855-4234-b52c-c2003a5df171',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1217.085015] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 2011abd7-ba10-4aae-84fb-1b1bfbd238fa in Status: SUCCESS [ 1217.085375] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-2011abd7-ba10-4aae-84fb-1b1bfbd238fa" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1217.141933] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 826ed52a-9222-434f-a4f9-e83fd60a5345 in Status: SUCCESS [ 1217.142175] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-826ed52a-9222-434f-a4f9-e83fd60a5345" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1217.142354] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-826ed52a-9222-434f-a4f9-e83fd60a5345" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1217.142582] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-826ed52a-9222-434f-a4f9-e83fd60a5345" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1217.142777] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1217.142943] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1217.143079] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1217.143263] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1217.144079] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1217.144079] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-826ed52a-9222-434f-a4f9-e83fd60a5345" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1217.144079] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('826ed52a-9222-434f-a4f9-e83fd60a5345',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1217.562773] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1217.563303] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1217.563303] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1217.563434] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1217.563434] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1217.563548] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d40b0ebb-5855-4234-b52c-c2003a5df171 already deleted. [ 1217.563636] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d40b0ebb-5855-4234-b52c-c2003a5df171" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1217.647230] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock member-826ed52a-9222-434f-a4f9-e83fd60a5345 taken with stack trace [, , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1217.647230] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-826ed52a-9222-434f-a4f9-e83fd60a5345" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1217.647230] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-826ed52a-9222-434f-a4f9-e83fd60a5345" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1217.647230] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-826ed52a-9222-434f-a4f9-e83fd60a5345" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1217.647230] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1217.647230] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1217.647230] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1217.647230] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1217.647230] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1217.647622] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-826ed52a-9222-434f-a4f9-e83fd60a5345" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1217.647622] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock member-826ed52a-9222-434f-a4f9-e83fd60a5345 taken with stack trace [, , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1217.647622] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-826ed52a-9222-434f-a4f9-e83fd60a5345" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1217.647622] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-826ed52a-9222-434f-a4f9-e83fd60a5345" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1217.647760] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-826ed52a-9222-434f-a4f9-e83fd60a5345" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1217.648185] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1217.648185] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1217.648185] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1217.648344] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1217.648344] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1217.648416] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-826ed52a-9222-434f-a4f9-e83fd60a5345" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1217.648510] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('826ed52a-9222-434f-a4f9-e83fd60a5345',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1218.151465] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 826ed52a-9222-434f-a4f9-e83fd60a5345: rpc.has_security_group_logging(os_id): False [ 1218.171928] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1218.172124] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1218.172203] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1218.172538] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1218.172640] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1218.172889] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1218.173013] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1218.173077] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1218.173260] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1218.173354] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1218.173583] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1218.173760] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1218.173807] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1218.174025] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1218.174803] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1218.174803] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1218.174987] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1218.174987] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1218.175135] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1218.175324] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1218.175381] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 826ed52a-9222-434f-a4f9-e83fd60a5345 is going to be updated. [ 1218.240503] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1218.240692] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1218.240692] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1218.240969] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1218.241103] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1218.259057] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 826ed52a-9222-434f-a4f9-e83fd60a5345 in Status: IN_PROGRESS for 2s [ 1218.822127] env[65370]: INFO networking_nsxv3.common.synchronization [req-6c3308da-71a2-4387-bbad-8a9775b3a0e8 req-5938fff7-3b8f-4477-ab8b-340657bfcb78 tempest-ServerRescueTestJSON-711577094 tempest-ServerRescueTestJSON-711577094-project-member] Enqueued Resource ID: 9b250822-f6be-41a2-9506-9d3472c0c4ae with Priority: HIGHEST for action security_group_members [ 1218.822547] env[65370]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9b250822-f6be-41a2-9506-9d3472c0c4ae with Priority: HIGHEST for action security_group_members [ 1218.822848] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock member-9b250822-f6be-41a2-9506-9d3472c0c4ae taken with stack trace [, , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1218.824191] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9b250822-f6be-41a2-9506-9d3472c0c4ae" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1218.824357] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9b250822-f6be-41a2-9506-9d3472c0c4ae" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1218.824672] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9b250822-f6be-41a2-9506-9d3472c0c4ae" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1218.824866] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1218.825020] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1218.825099] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1218.825273] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1218.825381] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1218.825491] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9b250822-f6be-41a2-9506-9d3472c0c4ae',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1219.116064] env[65370]: DEBUG networking_nsxv3.common.locking [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Lock network-112 taken with stack trace [, , , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1219.116557] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquiring lock "network-112" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1219.116557] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquired lock "network-112" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1219.116725] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquired external semaphore "network-112" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1219.116973] env[65370]: DEBUG networking_nsxv3.common.locking [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1219.117142] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquiring lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1219.117255] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquired lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1219.117467] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquired external semaphore "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1219.117604] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Releasing lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1219.117807] env[65370]: DEBUG dogpile.cache.region [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] No value present for key: 'zone-id' {{(pid=65370) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1219.117955] env[65370]: DEBUG dogpile.lock [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] NeedRegenerationException {{(pid=65370) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1219.118049] env[65370]: DEBUG dogpile.lock [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] no value, waiting for create lock {{(pid=65370) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1219.118129] env[65370]: DEBUG dogpile.lock [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] value creation lock acquired {{(pid=65370) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1219.118231] env[65370]: DEBUG dogpile.cache.region [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] No value present for key: 'zone-id' {{(pid=65370) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1219.118337] env[65370]: DEBUG dogpile.lock [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Calling creation function for not-yet-present value {{(pid=65370) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1219.118464] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1219.138836] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1219.139013] env[65370]: DEBUG dogpile.cache.region [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=65370) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1219.139151] env[65370]: DEBUG dogpile.lock [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Released creation lock {{(pid=65370) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1219.139328] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Releasing lock "network-112" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1219.139632] env[65370]: DEBUG networking_nsxv3.common.locking [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Lock port-159e11ec-c6fc-4107-90ba-398e14005d0a taken with stack trace [, , , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1219.139802] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquiring lock "port-159e11ec-c6fc-4107-90ba-398e14005d0a" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1219.139915] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquired lock "port-159e11ec-c6fc-4107-90ba-398e14005d0a" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1219.140330] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquired external semaphore "port-159e11ec-c6fc-4107-90ba-398e14005d0a" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1219.140458] env[65370]: DEBUG networking_nsxv3.api.rpc [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('159e11ec-c6fc-4107-90ba-398e14005d0a',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1219.328497] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1219.328497] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1219.328497] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1219.328763] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1219.328795] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1219.329049] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1219.329278] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1219.329898] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1219.329898] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1219.329898] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1219.329898] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9b250822-f6be-41a2-9506-9d3472c0c4ae already deleted. [ 1219.329898] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9b250822-f6be-41a2-9506-9d3472c0c4ae" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1219.643212] env[65370]: DEBUG networking_nsxv3.common.locking [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1219.643541] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquiring lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1219.643541] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquired lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1219.643936] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquired external semaphore "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1219.644092] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Releasing lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1219.644269] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Segment Port 159e11ec-c6fc-4107-90ba-398e14005d0a not found, creating... [ 1219.644539] env[65370]: DEBUG networking_nsxv3.common.locking [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1219.644696] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquiring lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1219.644811] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquired lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1219.645126] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquired external semaphore "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1219.645274] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Releasing lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1219.645565] env[65370]: DEBUG networking_nsxv3.common.locking [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1219.645704] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquiring lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1219.645879] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquired lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1219.646138] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquired external semaphore "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1219.646275] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Releasing lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1219.646412] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Resource: SegmentPort with ID: 159e11ec-c6fc-4107-90ba-398e14005d0a is going to be created. [ 1219.669353] env[65370]: DEBUG networking_nsxv3.common.locking [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1219.669600] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquiring lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1219.669728] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquired lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1219.670086] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquired external semaphore "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1219.670404] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Releasing lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1219.670746] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Releasing lock "port-159e11ec-c6fc-4107-90ba-398e14005d0a" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1220.274518] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 826ed52a-9222-434f-a4f9-e83fd60a5345 in Status: SUCCESS [ 1220.274916] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-826ed52a-9222-434f-a4f9-e83fd60a5345" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1220.414396] env[65370]: INFO networking_nsxv3.common.synchronization [req-6c3308da-71a2-4387-bbad-8a9775b3a0e8 req-8e5a86f5-c9f4-4630-9234-c9e93b2b54e7 service nova] Enqueued Resource ID: 9b250822-f6be-41a2-9506-9d3472c0c4ae with Priority: HIGHEST for action security_group_rules [ 1220.414862] env[65370]: INFO networking_nsxv3.common.synchronization [req-6c3308da-71a2-4387-bbad-8a9775b3a0e8 req-8e5a86f5-c9f4-4630-9234-c9e93b2b54e7 service nova] Enqueued Resource ID: 9b250822-f6be-41a2-9506-9d3472c0c4ae with Priority: HIGHEST for action security_group_members [ 1220.415139] env[65370]: INFO networking_nsxv3.common.synchronization [req-6c3308da-71a2-4387-bbad-8a9775b3a0e8 req-8e5a86f5-c9f4-4630-9234-c9e93b2b54e7 service nova] Enqueued Resource ID: 159e11ec-c6fc-4107-90ba-398e14005d0a with Priority: HIGHEST for action port [ 1220.416432] env[65370]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9b250822-f6be-41a2-9506-9d3472c0c4ae with Priority: HIGHEST for action security_group_rules [ 1220.416432] env[65370]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9b250822-f6be-41a2-9506-9d3472c0c4ae with Priority: HIGHEST for action security_group_members [ 1220.416569] env[65370]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 159e11ec-c6fc-4107-90ba-398e14005d0a with Priority: HIGHEST for action port [ 1220.417882] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock rules-9b250822-f6be-41a2-9506-9d3472c0c4ae taken with stack trace [, , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1220.417882] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-9b250822-f6be-41a2-9506-9d3472c0c4ae" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1220.417882] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-9b250822-f6be-41a2-9506-9d3472c0c4ae" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1220.418189] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-9b250822-f6be-41a2-9506-9d3472c0c4ae" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1220.418283] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('9b250822-f6be-41a2-9506-9d3472c0c4ae',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1220.419298] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock member-9b250822-f6be-41a2-9506-9d3472c0c4ae taken with stack trace [, , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1220.419438] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9b250822-f6be-41a2-9506-9d3472c0c4ae" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1220.419512] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9b250822-f6be-41a2-9506-9d3472c0c4ae" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1220.419804] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9b250822-f6be-41a2-9506-9d3472c0c4ae" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1220.420637] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1220.420637] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1220.420637] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1220.420637] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1220.420637] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1220.420637] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9b250822-f6be-41a2-9506-9d3472c0c4ae',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1220.422126] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock port-159e11ec-c6fc-4107-90ba-398e14005d0a taken with stack trace [, , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1220.422363] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-159e11ec-c6fc-4107-90ba-398e14005d0a" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1220.422506] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-159e11ec-c6fc-4107-90ba-398e14005d0a" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1220.424980] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-159e11ec-c6fc-4107-90ba-398e14005d0a" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1220.424980] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('159e11ec-c6fc-4107-90ba-398e14005d0a',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1220.924636] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('9b250822-f6be-41a2-9506-9d3472c0c4ae',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1220.927018] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock member-9b250822-f6be-41a2-9506-9d3472c0c4ae taken with stack trace [, , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1220.927018] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9b250822-f6be-41a2-9506-9d3472c0c4ae" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1220.927018] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 159e11ec-c6fc-4107-90ba-398e14005d0a with status ACTIVE [ 1220.927018] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1220.927018] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1220.927018] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1220.927382] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1220.927382] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1220.927516] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1220.927620] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1220.927683] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1220.927845] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1220.927937] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1220.928156] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1220.928253] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1220.928315] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1220.928456] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1220.928529] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1220.928612] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 159e11ec-c6fc-4107-90ba-398e14005d0a is going to be updated. [ 1220.950878] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1220.951149] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1220.951259] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1220.951472] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1220.951608] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1220.951767] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-159e11ec-c6fc-4107-90ba-398e14005d0a" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1221.431108] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('9b250822-f6be-41a2-9506-9d3472c0c4ae',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1221.933551] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1221.933551] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1221.933551] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1221.933551] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1221.933868] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1221.933868] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9b250822-f6be-41a2-9506-9d3472c0c4ae is going to be created. [ 1221.964096] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1221.964330] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1221.964330] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1221.964622] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1221.964802] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1221.975167] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9b250822-f6be-41a2-9506-9d3472c0c4ae in Status: UNINITIALIZED for 2s [ 1222.318432] env[65370]: INFO networking_nsxv3.common.synchronization [req-b9ebccf9-67c9-4db5-bf20-8196b8c881ce req-63637439-e2dd-4372-8cf8-ff73a16f0a6b tempest-AttachVolumeShelveTestJSON-478164993 tempest-AttachVolumeShelveTestJSON-478164993-project-member] Enqueued Resource ID: d40b0ebb-5855-4234-b52c-c2003a5df171 with Priority: HIGHEST for action security_group_members [ 1222.318432] env[65370]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d40b0ebb-5855-4234-b52c-c2003a5df171 with Priority: HIGHEST for action security_group_members [ 1222.318647] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock member-d40b0ebb-5855-4234-b52c-c2003a5df171 taken with stack trace [, , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1222.318764] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d40b0ebb-5855-4234-b52c-c2003a5df171" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1222.318832] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d40b0ebb-5855-4234-b52c-c2003a5df171" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1222.319105] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d40b0ebb-5855-4234-b52c-c2003a5df171" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1222.319266] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1222.319386] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1222.319457] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1222.319622] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1222.319745] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1222.319862] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d40b0ebb-5855-4234-b52c-c2003a5df171',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1222.691067] env[65370]: DEBUG networking_nsxv3.common.locking [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Lock network-745 taken with stack trace [, , , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1222.691417] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquiring lock "network-745" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1222.691417] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquired lock "network-745" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1222.691651] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquired external semaphore "network-745" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1222.691912] env[65370]: DEBUG networking_nsxv3.common.locking [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1222.692080] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquiring lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1222.692202] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquired lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1222.692424] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquired external semaphore "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1222.692567] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Releasing lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1222.692901] env[65370]: DEBUG dogpile.cache.region [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] No value present for key: 'zone-id' {{(pid=65370) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1222.692901] env[65370]: DEBUG dogpile.lock [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] NeedRegenerationException {{(pid=65370) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1222.693051] env[65370]: DEBUG dogpile.lock [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] no value, waiting for create lock {{(pid=65370) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1222.693092] env[65370]: DEBUG dogpile.lock [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] value creation lock acquired {{(pid=65370) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1222.693195] env[65370]: DEBUG dogpile.cache.region [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] No value present for key: 'zone-id' {{(pid=65370) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1222.693293] env[65370]: DEBUG dogpile.lock [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Calling creation function for not-yet-present value {{(pid=65370) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1222.693423] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1222.714422] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1222.714678] env[65370]: DEBUG dogpile.cache.region [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=65370) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1222.714846] env[65370]: DEBUG dogpile.lock [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Released creation lock {{(pid=65370) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1222.715056] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Releasing lock "network-745" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1222.715383] env[65370]: DEBUG networking_nsxv3.common.locking [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Lock port-bda06847-f669-4ad5-80e8-361096347174 taken with stack trace [, , , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1222.715556] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquiring lock "port-bda06847-f669-4ad5-80e8-361096347174" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1222.715673] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquired lock "port-bda06847-f669-4ad5-80e8-361096347174" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1222.716034] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquired external semaphore "port-bda06847-f669-4ad5-80e8-361096347174" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1222.716400] env[65370]: DEBUG networking_nsxv3.api.rpc [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('bda06847-f669-4ad5-80e8-361096347174',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1222.823071] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1222.823071] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1222.823071] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1222.823071] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1222.823071] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1222.823071] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1222.823071] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1222.823589] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1222.823589] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1222.823589] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1222.823589] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d40b0ebb-5855-4234-b52c-c2003a5df171 already deleted. [ 1222.823589] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d40b0ebb-5855-4234-b52c-c2003a5df171" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1223.221535] env[65370]: DEBUG networking_nsxv3.common.locking [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1223.221780] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquiring lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1223.221941] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquired lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1223.222286] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquired external semaphore "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1223.222466] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Releasing lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1223.222650] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Segment Port bda06847-f669-4ad5-80e8-361096347174 not found, creating... [ 1223.222929] env[65370]: DEBUG networking_nsxv3.common.locking [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1223.223134] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquiring lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1223.223282] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquired lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1223.223543] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquired external semaphore "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1223.223711] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Releasing lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1223.224103] env[65370]: DEBUG networking_nsxv3.common.locking [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1223.224281] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquiring lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1223.224406] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquired lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1223.224638] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquired external semaphore "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1223.224790] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Releasing lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1223.224942] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Resource: SegmentPort with ID: bda06847-f669-4ad5-80e8-361096347174 is going to be created. [ 1223.246855] env[65370]: DEBUG networking_nsxv3.common.locking [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1223.247124] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquiring lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1223.247296] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquired lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1223.247596] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquired external semaphore "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1223.247862] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Releasing lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1223.248126] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Releasing lock "port-bda06847-f669-4ad5-80e8-361096347174" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1223.926445] env[65370]: INFO networking_nsxv3.common.synchronization [req-b9ebccf9-67c9-4db5-bf20-8196b8c881ce req-1be17741-aa8e-4e59-bae1-30854dbe05a4 service nova] Enqueued Resource ID: d40b0ebb-5855-4234-b52c-c2003a5df171 with Priority: HIGHEST for action security_group_rules [ 1223.926700] env[65370]: INFO networking_nsxv3.common.synchronization [req-b9ebccf9-67c9-4db5-bf20-8196b8c881ce req-1be17741-aa8e-4e59-bae1-30854dbe05a4 service nova] Enqueued Resource ID: d40b0ebb-5855-4234-b52c-c2003a5df171 with Priority: HIGHEST for action security_group_members [ 1223.926700] env[65370]: INFO networking_nsxv3.common.synchronization [req-b9ebccf9-67c9-4db5-bf20-8196b8c881ce req-1be17741-aa8e-4e59-bae1-30854dbe05a4 service nova] Enqueued Resource ID: bda06847-f669-4ad5-80e8-361096347174 with Priority: HIGHEST for action port [ 1223.928035] env[65370]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d40b0ebb-5855-4234-b52c-c2003a5df171 with Priority: HIGHEST for action security_group_rules [ 1223.928600] env[65370]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d40b0ebb-5855-4234-b52c-c2003a5df171 with Priority: HIGHEST for action security_group_members [ 1223.928600] env[65370]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bda06847-f669-4ad5-80e8-361096347174 with Priority: HIGHEST for action port [ 1223.928600] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d40b0ebb-5855-4234-b52c-c2003a5df171 taken with stack trace [, , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1223.928764] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d40b0ebb-5855-4234-b52c-c2003a5df171" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1223.928764] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d40b0ebb-5855-4234-b52c-c2003a5df171" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1223.928900] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d40b0ebb-5855-4234-b52c-c2003a5df171" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1223.929028] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d40b0ebb-5855-4234-b52c-c2003a5df171',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1223.930099] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock member-d40b0ebb-5855-4234-b52c-c2003a5df171 taken with stack trace [, , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1223.930218] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d40b0ebb-5855-4234-b52c-c2003a5df171" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1223.930308] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d40b0ebb-5855-4234-b52c-c2003a5df171" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1223.930931] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d40b0ebb-5855-4234-b52c-c2003a5df171" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1223.930931] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1223.930931] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1223.930931] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1223.930931] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1223.930931] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1223.931275] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d40b0ebb-5855-4234-b52c-c2003a5df171',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1223.931780] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock port-bda06847-f669-4ad5-80e8-361096347174 taken with stack trace [, , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1223.933748] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-bda06847-f669-4ad5-80e8-361096347174" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1223.933748] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-bda06847-f669-4ad5-80e8-361096347174" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1223.933748] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-bda06847-f669-4ad5-80e8-361096347174" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1223.933748] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('bda06847-f669-4ad5-80e8-361096347174',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1223.986150] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9b250822-f6be-41a2-9506-9d3472c0c4ae in Status: SUCCESS [ 1223.986479] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9b250822-f6be-41a2-9506-9d3472c0c4ae" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1223.986624] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9b250822-f6be-41a2-9506-9d3472c0c4ae" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1223.986837] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9b250822-f6be-41a2-9506-9d3472c0c4ae" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1223.988070] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1223.988194] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1223.988268] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1223.988447] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1223.988529] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1223.988620] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9b250822-f6be-41a2-9506-9d3472c0c4ae" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1223.988712] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('9b250822-f6be-41a2-9506-9d3472c0c4ae',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1224.435357] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('d40b0ebb-5855-4234-b52c-c2003a5df171',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1224.436737] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock member-d40b0ebb-5855-4234-b52c-c2003a5df171 taken with stack trace [, , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1224.436931] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d40b0ebb-5855-4234-b52c-c2003a5df171" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1224.437198] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port bda06847-f669-4ad5-80e8-361096347174 with status ACTIVE [ 1224.437497] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1224.437706] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1224.437835] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1224.438168] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1224.438325] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1224.439028] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1224.439028] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1224.439028] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1224.439257] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1224.439384] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1224.439645] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1224.439822] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1224.440104] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1224.440358] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1224.440516] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1224.440667] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: bda06847-f669-4ad5-80e8-361096347174 is going to be updated. [ 1224.493304] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock member-9b250822-f6be-41a2-9506-9d3472c0c4ae taken with stack trace [, , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1224.493480] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9b250822-f6be-41a2-9506-9d3472c0c4ae" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1224.493480] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9b250822-f6be-41a2-9506-9d3472c0c4ae" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1224.493664] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9b250822-f6be-41a2-9506-9d3472c0c4ae" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1224.493826] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1224.494278] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1224.494278] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1224.494278] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1224.494278] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1224.494496] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9b250822-f6be-41a2-9506-9d3472c0c4ae" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1224.494496] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock member-9b250822-f6be-41a2-9506-9d3472c0c4ae taken with stack trace [, , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1224.494578] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9b250822-f6be-41a2-9506-9d3472c0c4ae" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1224.494638] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9b250822-f6be-41a2-9506-9d3472c0c4ae" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1224.494992] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9b250822-f6be-41a2-9506-9d3472c0c4ae" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1224.494992] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1224.495138] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1224.495489] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1224.496046] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1224.496046] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1224.496046] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9b250822-f6be-41a2-9506-9d3472c0c4ae" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1224.496046] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('9b250822-f6be-41a2-9506-9d3472c0c4ae',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1224.581845] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1224.582056] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1224.582113] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1224.582333] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1224.582475] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1224.582654] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-bda06847-f669-4ad5-80e8-361096347174" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1224.943405] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('d40b0ebb-5855-4234-b52c-c2003a5df171',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1224.998563] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 9b250822-f6be-41a2-9506-9d3472c0c4ae: rpc.has_security_group_logging(os_id): False [ 1225.018933] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1225.019210] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1225.019299] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1225.019564] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1225.020244] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1225.020244] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1225.020244] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1225.020244] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1225.020244] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1225.020496] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1225.020496] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1225.020584] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1225.020629] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1225.020791] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1225.020879] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1225.021130] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1225.021234] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1225.021287] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1225.021417] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1225.021487] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1225.021588] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 9b250822-f6be-41a2-9506-9d3472c0c4ae is going to be created. [ 1225.081362] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1225.081610] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1225.081731] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1225.082030] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1225.082298] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1225.093526] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 9b250822-f6be-41a2-9506-9d3472c0c4ae in Status: IN_PROGRESS for 2s [ 1225.447051] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1225.447290] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1225.447290] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1225.447463] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1225.447520] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1225.447569] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d40b0ebb-5855-4234-b52c-c2003a5df171 is going to be created. [ 1225.472127] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1225.472376] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1225.472376] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1225.472590] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1225.472756] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1225.484115] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d40b0ebb-5855-4234-b52c-c2003a5df171 in Status: UNINITIALIZED for 2s [ 1227.106811] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 9b250822-f6be-41a2-9506-9d3472c0c4ae in Status: SUCCESS [ 1227.107198] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-9b250822-f6be-41a2-9506-9d3472c0c4ae" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1227.493421] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d40b0ebb-5855-4234-b52c-c2003a5df171 in Status: SUCCESS [ 1227.493638] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d40b0ebb-5855-4234-b52c-c2003a5df171" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1227.493796] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d40b0ebb-5855-4234-b52c-c2003a5df171" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1227.494039] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d40b0ebb-5855-4234-b52c-c2003a5df171" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1227.494244] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1227.494363] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1227.494422] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1227.494578] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1227.494657] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1227.494740] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d40b0ebb-5855-4234-b52c-c2003a5df171" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1227.494829] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('d40b0ebb-5855-4234-b52c-c2003a5df171',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1227.969326] env[65370]: INFO networking_nsxv3.common.synchronization [req-0c123661-0a94-4a83-a7ee-a365a91bd44e req-d37ac7fb-45e3-4793-a9f5-dc126bd96312 tempest-ServerActionsTestOtherB-1099767447 tempest-ServerActionsTestOtherB-1099767447-project-member] Enqueued Resource ID: 2011abd7-ba10-4aae-84fb-1b1bfbd238fa with Priority: HIGHEST for action security_group_members [ 1227.969326] env[65370]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2011abd7-ba10-4aae-84fb-1b1bfbd238fa with Priority: HIGHEST for action security_group_members [ 1227.969326] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock member-2011abd7-ba10-4aae-84fb-1b1bfbd238fa taken with stack trace [, , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1227.970176] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2011abd7-ba10-4aae-84fb-1b1bfbd238fa" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1227.970549] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2011abd7-ba10-4aae-84fb-1b1bfbd238fa" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1227.971355] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2011abd7-ba10-4aae-84fb-1b1bfbd238fa" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1227.971355] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1227.971355] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1227.971355] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1227.971760] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1227.971925] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1227.972170] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2011abd7-ba10-4aae-84fb-1b1bfbd238fa',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1227.996555] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('d40b0ebb-5855-4234-b52c-c2003a5df171',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1228.475379] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1228.475379] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1228.475379] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1228.475379] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1228.475906] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1228.475906] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1228.475996] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1228.476671] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1228.476671] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1228.476671] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1228.476671] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2011abd7-ba10-4aae-84fb-1b1bfbd238fa is going to be updated. [ 1228.500396] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for d40b0ebb-5855-4234-b52c-c2003a5df171: rpc.has_security_group_logging(os_id): False [ 1228.504129] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1228.504313] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1228.504465] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1228.504622] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1228.504813] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1228.514360] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2011abd7-ba10-4aae-84fb-1b1bfbd238fa in Status: IN_PROGRESS for 2s [ 1228.517495] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1228.517661] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1228.517743] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1228.517989] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1228.518187] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1228.518476] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1228.518614] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1228.518708] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1228.518874] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1228.518984] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1228.519103] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d40b0ebb-5855-4234-b52c-c2003a5df171 is going to be created. [ 1228.582234] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1228.582429] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1228.582493] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1228.582831] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1228.583078] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1228.596788] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d40b0ebb-5855-4234-b52c-c2003a5df171 in Status: IN_PROGRESS for 2s [ 1228.997687] env[65370]: DEBUG networking_nsxv3.common.locking [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Lock network-309 taken with stack trace [, , , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1228.997882] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquiring lock "network-309" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1228.998012] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquired lock "network-309" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1228.998342] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquired external semaphore "network-309" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1228.998602] env[65370]: DEBUG networking_nsxv3.common.locking [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1228.998763] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquiring lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1228.998878] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquired lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1228.999233] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquired external semaphore "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1228.999399] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Releasing lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1228.999611] env[65370]: DEBUG dogpile.cache.region [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] No value present for key: 'zone-id' {{(pid=65370) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1228.999722] env[65370]: DEBUG dogpile.lock [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] NeedRegenerationException {{(pid=65370) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1228.999830] env[65370]: DEBUG dogpile.lock [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] no value, waiting for create lock {{(pid=65370) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1228.999936] env[65370]: DEBUG dogpile.lock [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] value creation lock acquired {{(pid=65370) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1229.000055] env[65370]: DEBUG dogpile.cache.region [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] No value present for key: 'zone-id' {{(pid=65370) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1229.000221] env[65370]: DEBUG dogpile.lock [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Calling creation function for not-yet-present value {{(pid=65370) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1229.000361] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1229.020909] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1229.021135] env[65370]: DEBUG dogpile.cache.region [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=65370) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1229.021245] env[65370]: DEBUG dogpile.lock [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Released creation lock {{(pid=65370) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1229.021401] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Releasing lock "network-309" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1229.021729] env[65370]: DEBUG networking_nsxv3.common.locking [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Lock port-b7aab3bd-d83f-4222-8a27-b0352b774bf1 taken with stack trace [, , , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1229.021891] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquiring lock "port-b7aab3bd-d83f-4222-8a27-b0352b774bf1" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1229.022012] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquired lock "port-b7aab3bd-d83f-4222-8a27-b0352b774bf1" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1229.022285] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquired external semaphore "port-b7aab3bd-d83f-4222-8a27-b0352b774bf1" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1229.022413] env[65370]: DEBUG networking_nsxv3.api.rpc [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b7aab3bd-d83f-4222-8a27-b0352b774bf1',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1229.524343] env[65370]: DEBUG networking_nsxv3.common.locking [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1229.524692] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquiring lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1229.524692] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquired lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1229.524985] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquired external semaphore "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1229.525149] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Releasing lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1229.525425] env[65370]: DEBUG networking_nsxv3.common.locking [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1229.525580] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquiring lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1229.525693] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquired lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1229.525899] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquired external semaphore "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1229.526043] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Releasing lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1229.526317] env[65370]: DEBUG networking_nsxv3.common.locking [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1229.526470] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquiring lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1229.526583] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquired lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1229.526782] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquired external semaphore "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1229.526910] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Releasing lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1229.527061] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Resource: SegmentPort with ID: b7aab3bd-d83f-4222-8a27-b0352b774bf1 is going to be updated. [ 1229.551022] env[65370]: DEBUG networking_nsxv3.common.locking [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1229.551022] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquiring lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1229.551022] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquired lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1229.551022] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquired external semaphore "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1229.551022] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Releasing lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1229.551022] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Releasing lock "port-b7aab3bd-d83f-4222-8a27-b0352b774bf1" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1230.244287] env[65370]: INFO networking_nsxv3.common.synchronization [req-e27db934-d847-404c-9fd0-d36d16062a37 req-ce745cc8-38c3-4b35-ae99-d6b77d09b5a7 service nova] Enqueued Resource ID: 826ed52a-9222-434f-a4f9-e83fd60a5345 with Priority: HIGHEST for action security_group_rules [ 1230.244420] env[65370]: INFO networking_nsxv3.common.synchronization [req-e27db934-d847-404c-9fd0-d36d16062a37 req-ce745cc8-38c3-4b35-ae99-d6b77d09b5a7 service nova] Enqueued Resource ID: 826ed52a-9222-434f-a4f9-e83fd60a5345 with Priority: HIGHEST for action security_group_members [ 1230.244559] env[65370]: INFO networking_nsxv3.common.synchronization [req-e27db934-d847-404c-9fd0-d36d16062a37 req-ce745cc8-38c3-4b35-ae99-d6b77d09b5a7 service nova] Enqueued Resource ID: b7aab3bd-d83f-4222-8a27-b0352b774bf1 with Priority: HIGHEST for action port [ 1230.245085] env[65370]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 826ed52a-9222-434f-a4f9-e83fd60a5345 with Priority: HIGHEST for action security_group_rules [ 1230.245224] env[65370]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 826ed52a-9222-434f-a4f9-e83fd60a5345 with Priority: HIGHEST for action security_group_members [ 1230.245335] env[65370]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b7aab3bd-d83f-4222-8a27-b0352b774bf1 with Priority: HIGHEST for action port [ 1230.248330] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock rules-826ed52a-9222-434f-a4f9-e83fd60a5345 taken with stack trace [, , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1230.248520] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-826ed52a-9222-434f-a4f9-e83fd60a5345" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1230.248592] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-826ed52a-9222-434f-a4f9-e83fd60a5345" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1230.248799] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-826ed52a-9222-434f-a4f9-e83fd60a5345" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1230.248887] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('826ed52a-9222-434f-a4f9-e83fd60a5345',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1230.249742] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock member-826ed52a-9222-434f-a4f9-e83fd60a5345 taken with stack trace [, , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1230.249857] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-826ed52a-9222-434f-a4f9-e83fd60a5345" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1230.249924] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-826ed52a-9222-434f-a4f9-e83fd60a5345" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1230.250158] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-826ed52a-9222-434f-a4f9-e83fd60a5345" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1230.250318] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1230.250412] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1230.250474] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1230.250637] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1230.250726] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1230.250813] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('826ed52a-9222-434f-a4f9-e83fd60a5345',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1230.252364] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock port-b7aab3bd-d83f-4222-8a27-b0352b774bf1 taken with stack trace [, , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1230.252364] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b7aab3bd-d83f-4222-8a27-b0352b774bf1" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1230.252364] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b7aab3bd-d83f-4222-8a27-b0352b774bf1" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1230.252364] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b7aab3bd-d83f-4222-8a27-b0352b774bf1" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1230.252364] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b7aab3bd-d83f-4222-8a27-b0352b774bf1',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1230.524609] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2011abd7-ba10-4aae-84fb-1b1bfbd238fa in Status: SUCCESS [ 1230.525039] env[65370]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2011abd7-ba10-4aae-84fb-1b1bfbd238fa deletion is rescheduled due to dependency. [ 1230.525039] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2011abd7-ba10-4aae-84fb-1b1bfbd238fa" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1230.612078] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d40b0ebb-5855-4234-b52c-c2003a5df171 in Status: SUCCESS [ 1230.612383] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d40b0ebb-5855-4234-b52c-c2003a5df171" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1230.755093] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port b7aab3bd-d83f-4222-8a27-b0352b774bf1 with status ACTIVE [ 1230.755447] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1230.755941] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1230.755941] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1230.756082] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1230.756121] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1230.756432] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1230.756575] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1230.756672] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1230.756883] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1230.756975] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1230.757205] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1230.757309] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1230.757370] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1230.757514] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1230.757592] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1230.757677] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: b7aab3bd-d83f-4222-8a27-b0352b774bf1 is going to be updated. [ 1230.758974] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('826ed52a-9222-434f-a4f9-e83fd60a5345',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1230.760017] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock member-826ed52a-9222-434f-a4f9-e83fd60a5345 taken with stack trace [, , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1230.760159] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-826ed52a-9222-434f-a4f9-e83fd60a5345" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1230.784028] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1230.784255] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1230.784255] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1230.784421] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1230.784580] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1230.784752] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b7aab3bd-d83f-4222-8a27-b0352b774bf1" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1231.262067] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('826ed52a-9222-434f-a4f9-e83fd60a5345',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1231.764638] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1231.765062] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1231.765062] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1231.765062] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1231.765192] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1231.765229] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 826ed52a-9222-434f-a4f9-e83fd60a5345 is going to be updated. [ 1231.791555] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1231.791823] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1231.791823] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1231.791959] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1231.792561] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1231.800441] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 826ed52a-9222-434f-a4f9-e83fd60a5345 in Status: IN_PROGRESS for 2s [ 1233.812105] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 826ed52a-9222-434f-a4f9-e83fd60a5345 in Status: SUCCESS [ 1233.812445] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-826ed52a-9222-434f-a4f9-e83fd60a5345" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1233.812687] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-826ed52a-9222-434f-a4f9-e83fd60a5345" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1233.812997] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-826ed52a-9222-434f-a4f9-e83fd60a5345" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1233.813224] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1233.813374] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1233.813466] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1233.813579] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1233.813681] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1233.813786] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-826ed52a-9222-434f-a4f9-e83fd60a5345" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1233.813886] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('826ed52a-9222-434f-a4f9-e83fd60a5345',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1234.322021] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock member-826ed52a-9222-434f-a4f9-e83fd60a5345 taken with stack trace [, , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1234.322021] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-826ed52a-9222-434f-a4f9-e83fd60a5345" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1234.322021] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-826ed52a-9222-434f-a4f9-e83fd60a5345" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1234.322021] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-826ed52a-9222-434f-a4f9-e83fd60a5345" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1234.322021] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1234.322021] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1234.322021] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1234.322021] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1234.322021] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1234.322021] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-826ed52a-9222-434f-a4f9-e83fd60a5345" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1234.322021] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock member-826ed52a-9222-434f-a4f9-e83fd60a5345 taken with stack trace [, , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1234.322021] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-826ed52a-9222-434f-a4f9-e83fd60a5345" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1234.322021] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-826ed52a-9222-434f-a4f9-e83fd60a5345" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1234.322021] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-826ed52a-9222-434f-a4f9-e83fd60a5345" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1234.322021] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1234.322021] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1234.322678] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1234.322678] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1234.322678] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1234.322678] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-826ed52a-9222-434f-a4f9-e83fd60a5345" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1234.322678] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('826ed52a-9222-434f-a4f9-e83fd60a5345',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1234.825765] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 826ed52a-9222-434f-a4f9-e83fd60a5345: rpc.has_security_group_logging(os_id): False [ 1234.849081] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1234.849349] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1234.849467] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1234.849800] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1234.849964] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1234.850418] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1234.850535] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1234.850648] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1234.850899] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1234.851051] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1234.851412] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1234.851575] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1234.851678] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1234.851938] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1234.852070] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1234.852380] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1234.852632] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1234.852751] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1234.852993] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1234.853137] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1234.853264] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 826ed52a-9222-434f-a4f9-e83fd60a5345 is going to be updated. [ 1234.939754] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1234.939754] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1234.939754] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1234.940303] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1234.940303] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1234.955037] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 826ed52a-9222-434f-a4f9-e83fd60a5345 in Status: IN_PROGRESS for 2s [ 1235.249200] env[65370]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1235.249454] env[65370]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=1 [ 1236.970217] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 826ed52a-9222-434f-a4f9-e83fd60a5345 in Status: SUCCESS [ 1236.970684] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-826ed52a-9222-434f-a4f9-e83fd60a5345" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1240.211874] env[65370]: INFO networking_nsxv3.common.synchronization [None req-2b0378ff-91ce-45d1-a12d-fd7c25c2f946 None None] Enqueued Resource ID: aa5d9c52-45ac-451a-89d4-e16a23673e33 with Priority: HIGHEST for action port [ 1240.212437] env[65370]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: aa5d9c52-45ac-451a-89d4-e16a23673e33 with Priority: HIGHEST for action port [ 1240.212804] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock port-aa5d9c52-45ac-451a-89d4-e16a23673e33 taken with stack trace [, , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1240.212888] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-aa5d9c52-45ac-451a-89d4-e16a23673e33" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1240.212928] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-aa5d9c52-45ac-451a-89d4-e16a23673e33" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1240.213228] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-aa5d9c52-45ac-451a-89d4-e16a23673e33" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1240.213312] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('aa5d9c52-45ac-451a-89d4-e16a23673e33',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1240.715619] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port aa5d9c52-45ac-451a-89d4-e16a23673e33 [ 1240.715974] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1240.716336] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1240.716433] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1240.716987] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1240.716987] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1240.716987] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:aa5d9c52-45ac-451a-89d4-e16a23673e33 already deleted. [ 1240.717188] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-aa5d9c52-45ac-451a-89d4-e16a23673e33" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1242.364486] env[65370]: INFO networking_nsxv3.common.synchronization [None req-c593f38e-f7d6-4e6c-9700-3986c7280fe5 None None] Enqueued Resource ID: 8d450965-fe65-476d-8c3f-295b0b12f7b4 with Priority: HIGHEST for action port [ 1242.365060] env[65370]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8d450965-fe65-476d-8c3f-295b0b12f7b4 with Priority: HIGHEST for action port [ 1242.365333] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock port-8d450965-fe65-476d-8c3f-295b0b12f7b4 taken with stack trace [, , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1242.365460] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-8d450965-fe65-476d-8c3f-295b0b12f7b4" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1242.365519] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-8d450965-fe65-476d-8c3f-295b0b12f7b4" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1242.365779] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-8d450965-fe65-476d-8c3f-295b0b12f7b4" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1242.365855] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8d450965-fe65-476d-8c3f-295b0b12f7b4',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1242.870686] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 8d450965-fe65-476d-8c3f-295b0b12f7b4 [ 1242.870967] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1242.871123] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1242.871186] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1242.871421] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1242.871487] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1242.871577] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:8d450965-fe65-476d-8c3f-295b0b12f7b4 already deleted. [ 1242.871659] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-8d450965-fe65-476d-8c3f-295b0b12f7b4" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1244.622799] env[65370]: INFO networking_nsxv3.common.synchronization [req-31b7ca0b-c3d5-416e-80f7-b01b356d4b55 req-b768f4bc-8cdd-46f4-93ab-933bb881ed0c tempest-ServerRescueTestJSON-711577094 tempest-ServerRescueTestJSON-711577094-project-member] Enqueued Resource ID: 9b250822-f6be-41a2-9506-9d3472c0c4ae with Priority: HIGHEST for action security_group_members [ 1244.623389] env[65370]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9b250822-f6be-41a2-9506-9d3472c0c4ae with Priority: HIGHEST for action security_group_members [ 1244.623703] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock member-9b250822-f6be-41a2-9506-9d3472c0c4ae taken with stack trace [, , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1244.623827] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9b250822-f6be-41a2-9506-9d3472c0c4ae" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1244.623892] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9b250822-f6be-41a2-9506-9d3472c0c4ae" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1244.624108] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9b250822-f6be-41a2-9506-9d3472c0c4ae" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1244.624430] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1244.624430] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1244.624430] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1244.624576] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1244.624625] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1244.624738] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9b250822-f6be-41a2-9506-9d3472c0c4ae',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1244.941071] env[65370]: DEBUG networking_nsxv3.common.locking [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Lock network-112 taken with stack trace [, , , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1244.941239] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquiring lock "network-112" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1244.941386] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquired lock "network-112" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1244.941694] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquired external semaphore "network-112" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1244.942045] env[65370]: DEBUG networking_nsxv3.common.locking [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1244.942213] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquiring lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1244.942325] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquired lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1244.942545] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquired external semaphore "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1244.942686] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Releasing lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1244.942888] env[65370]: DEBUG dogpile.cache.region [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] No value present for key: 'zone-id' {{(pid=65370) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1244.942995] env[65370]: DEBUG dogpile.lock [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] NeedRegenerationException {{(pid=65370) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1244.943112] env[65370]: DEBUG dogpile.lock [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] no value, waiting for create lock {{(pid=65370) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1244.943225] env[65370]: DEBUG dogpile.lock [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] value creation lock acquired {{(pid=65370) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1244.943355] env[65370]: DEBUG dogpile.cache.region [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] No value present for key: 'zone-id' {{(pid=65370) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1244.943595] env[65370]: DEBUG dogpile.lock [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Calling creation function for not-yet-present value {{(pid=65370) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1244.943673] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1244.969386] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1244.969597] env[65370]: DEBUG dogpile.cache.region [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Cache value generated in 0.026 seconds for key(s): 'zone-id' {{(pid=65370) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1244.969720] env[65370]: DEBUG dogpile.lock [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Released creation lock {{(pid=65370) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1244.969906] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Releasing lock "network-112" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1244.970233] env[65370]: DEBUG networking_nsxv3.common.locking [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Lock port-6779979d-b9c2-4a10-81b8-2ff8521acd77 taken with stack trace [, , , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1244.970419] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquiring lock "port-6779979d-b9c2-4a10-81b8-2ff8521acd77" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1244.970540] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquired lock "port-6779979d-b9c2-4a10-81b8-2ff8521acd77" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1244.970858] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquired external semaphore "port-6779979d-b9c2-4a10-81b8-2ff8521acd77" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1244.970991] env[65370]: DEBUG networking_nsxv3.api.rpc [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6779979d-b9c2-4a10-81b8-2ff8521acd77',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1245.127226] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('9b250822-f6be-41a2-9506-9d3472c0c4ae',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1245.473758] env[65370]: DEBUG networking_nsxv3.common.locking [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1245.474021] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquiring lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1245.474180] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquired lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1245.474515] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquired external semaphore "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1245.474687] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Releasing lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1245.474855] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Segment Port 6779979d-b9c2-4a10-81b8-2ff8521acd77 not found, creating... [ 1245.475132] env[65370]: DEBUG networking_nsxv3.common.locking [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1245.475324] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquiring lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1245.475439] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquired lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1245.475659] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquired external semaphore "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1245.475792] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Releasing lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1245.476085] env[65370]: DEBUG networking_nsxv3.common.locking [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1245.476237] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquiring lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1245.476348] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquired lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1245.476547] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquired external semaphore "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1245.476730] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Releasing lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1245.476942] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Resource: SegmentPort with ID: 6779979d-b9c2-4a10-81b8-2ff8521acd77 is going to be created. [ 1245.501470] env[65370]: DEBUG networking_nsxv3.common.locking [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1245.501753] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquiring lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1245.501876] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquired lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1245.502187] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquired external semaphore "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1245.502422] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Releasing lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1245.502651] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Releasing lock "port-6779979d-b9c2-4a10-81b8-2ff8521acd77" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1245.629371] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('9b250822-f6be-41a2-9506-9d3472c0c4ae',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1246.087421] env[65370]: INFO networking_nsxv3.common.synchronization [req-4443c711-2d48-4874-ae58-a5b3260bbcb5 req-cfa99dc1-ed26-415c-b91d-6d15693ecffc tempest-AttachInterfacesTestJSON-315686657 tempest-AttachInterfacesTestJSON-315686657-project-member] Enqueued Resource ID: be9c9972-d782-43b4-ba55-a29e461a1378 with Priority: HIGHEST for action security_group_members [ 1246.088052] env[65370]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: be9c9972-d782-43b4-ba55-a29e461a1378 with Priority: HIGHEST for action security_group_members [ 1246.088350] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock member-be9c9972-d782-43b4-ba55-a29e461a1378 taken with stack trace [, , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1246.088475] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-be9c9972-d782-43b4-ba55-a29e461a1378" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1246.088544] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-be9c9972-d782-43b4-ba55-a29e461a1378" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1246.088758] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-be9c9972-d782-43b4-ba55-a29e461a1378" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1246.088914] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1246.089023] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1246.089085] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1246.089236] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1246.089321] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1246.089415] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('be9c9972-d782-43b4-ba55-a29e461a1378',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1246.132196] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1246.132658] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1246.132658] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1246.132658] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1246.132873] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1246.132873] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9b250822-f6be-41a2-9506-9d3472c0c4ae is going to be updated. [ 1246.180481] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1246.180626] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1246.180700] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1246.181058] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1246.181141] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1246.199747] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9b250822-f6be-41a2-9506-9d3472c0c4ae in Status: IN_PROGRESS for 2s [ 1246.283315] env[65370]: INFO networking_nsxv3.common.synchronization [req-31b7ca0b-c3d5-416e-80f7-b01b356d4b55 req-e5c5edc7-094c-45e3-aa91-129a70956bde service nova] Enqueued Resource ID: 9b250822-f6be-41a2-9506-9d3472c0c4ae with Priority: HIGHEST for action security_group_rules [ 1246.283556] env[65370]: INFO networking_nsxv3.common.synchronization [req-31b7ca0b-c3d5-416e-80f7-b01b356d4b55 req-e5c5edc7-094c-45e3-aa91-129a70956bde service nova] Enqueued Resource ID: 9b250822-f6be-41a2-9506-9d3472c0c4ae with Priority: HIGHEST for action security_group_members [ 1246.283646] env[65370]: INFO networking_nsxv3.common.synchronization [req-31b7ca0b-c3d5-416e-80f7-b01b356d4b55 req-e5c5edc7-094c-45e3-aa91-129a70956bde service nova] Enqueued Resource ID: 6779979d-b9c2-4a10-81b8-2ff8521acd77 with Priority: HIGHEST for action port [ 1246.284197] env[65370]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9b250822-f6be-41a2-9506-9d3472c0c4ae with Priority: HIGHEST for action security_group_rules [ 1246.284333] env[65370]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9b250822-f6be-41a2-9506-9d3472c0c4ae with Priority: HIGHEST for action security_group_members [ 1246.284427] env[65370]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6779979d-b9c2-4a10-81b8-2ff8521acd77 with Priority: HIGHEST for action port [ 1246.284694] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock rules-9b250822-f6be-41a2-9506-9d3472c0c4ae taken with stack trace [, , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1246.284817] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-9b250822-f6be-41a2-9506-9d3472c0c4ae" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1246.284886] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-9b250822-f6be-41a2-9506-9d3472c0c4ae" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1246.286104] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-9b250822-f6be-41a2-9506-9d3472c0c4ae" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1246.286199] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('9b250822-f6be-41a2-9506-9d3472c0c4ae',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1246.287229] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock member-9b250822-f6be-41a2-9506-9d3472c0c4ae taken with stack trace [, , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1246.287329] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9b250822-f6be-41a2-9506-9d3472c0c4ae" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1246.287535] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock port-6779979d-b9c2-4a10-81b8-2ff8521acd77 taken with stack trace [, , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1246.287628] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-6779979d-b9c2-4a10-81b8-2ff8521acd77" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1246.287682] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-6779979d-b9c2-4a10-81b8-2ff8521acd77" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1246.287863] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-6779979d-b9c2-4a10-81b8-2ff8521acd77" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1246.288254] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6779979d-b9c2-4a10-81b8-2ff8521acd77',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1246.591756] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('be9c9972-d782-43b4-ba55-a29e461a1378',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1246.790147] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock member-9b250822-f6be-41a2-9506-9d3472c0c4ae taken with stack trace [, , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1246.790504] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9b250822-f6be-41a2-9506-9d3472c0c4ae" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1246.790504] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 6779979d-b9c2-4a10-81b8-2ff8521acd77 with status ACTIVE [ 1246.790700] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1246.790875] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1246.790942] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1246.791351] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1246.791475] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1246.791704] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1246.791811] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1246.791874] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1246.792065] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1246.792145] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1246.792339] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1246.792454] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1246.792516] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1246.792692] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1246.792785] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1246.792882] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 6779979d-b9c2-4a10-81b8-2ff8521acd77 is going to be updated. [ 1246.802372] env[65370]: INFO networking_nsxv3.common.synchronization [req-c1e66273-44cc-4eb8-96fe-57a62e722e13 req-67f21d55-8665-4e67-bbf4-4336cb8481a7 tempest-ServerMetadataTestJSON-1068631085 tempest-ServerMetadataTestJSON-1068631085-project-member] Enqueued Resource ID: dce7e5a8-cd1c-43d7-bd27-e50a7be76eca with Priority: HIGHEST for action security_group_members [ 1246.802805] env[65370]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: dce7e5a8-cd1c-43d7-bd27-e50a7be76eca with Priority: HIGHEST for action security_group_members [ 1246.803135] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock member-dce7e5a8-cd1c-43d7-bd27-e50a7be76eca taken with stack trace [, , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1246.803257] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-dce7e5a8-cd1c-43d7-bd27-e50a7be76eca" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1246.803325] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-dce7e5a8-cd1c-43d7-bd27-e50a7be76eca" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1246.803580] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-dce7e5a8-cd1c-43d7-bd27-e50a7be76eca" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1246.803735] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1246.803835] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1246.803898] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1246.804073] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1246.804160] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1246.804254] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('dce7e5a8-cd1c-43d7-bd27-e50a7be76eca',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1246.824580] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1246.824751] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1246.824795] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1246.824991] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1246.825146] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1246.825321] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-6779979d-b9c2-4a10-81b8-2ff8521acd77" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1247.093979] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('be9c9972-d782-43b4-ba55-a29e461a1378',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1247.138759] env[65370]: DEBUG networking_nsxv3.common.locking [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Lock network-345 taken with stack trace [, , , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1247.138916] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquiring lock "network-345" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1247.139040] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquired lock "network-345" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1247.139340] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquired external semaphore "network-345" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1247.139608] env[65370]: DEBUG networking_nsxv3.common.locking [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1247.139765] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquiring lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1247.139879] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquired lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1247.140133] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquired external semaphore "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1247.140246] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Releasing lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1247.140481] env[65370]: DEBUG dogpile.cache.region [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] No value present for key: 'zone-id' {{(pid=65370) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1247.140592] env[65370]: DEBUG dogpile.lock [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] NeedRegenerationException {{(pid=65370) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1247.140698] env[65370]: DEBUG dogpile.lock [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] no value, waiting for create lock {{(pid=65370) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1247.140805] env[65370]: DEBUG dogpile.lock [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] value creation lock acquired {{(pid=65370) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1247.140911] env[65370]: DEBUG dogpile.cache.region [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] No value present for key: 'zone-id' {{(pid=65370) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1247.141046] env[65370]: DEBUG dogpile.lock [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Calling creation function for not-yet-present value {{(pid=65370) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1247.141182] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1247.144736] env[65370]: INFO networking_nsxv3.common.synchronization [req-207cbab7-67a9-4d30-8699-33aad93d3930 req-220a9cb8-fce7-46ab-bf73-7fd715ed3886 tempest-ServerActionsTestJSON-720598601 tempest-ServerActionsTestJSON-720598601-project-member] Enqueued Resource ID: fe248172-4be4-4d95-a8ca-c9c2ef203894 with Priority: HIGHEST for action security_group_members [ 1247.145584] env[65370]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fe248172-4be4-4d95-a8ca-c9c2ef203894 with Priority: HIGHEST for action security_group_members [ 1247.145991] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock member-fe248172-4be4-4d95-a8ca-c9c2ef203894 taken with stack trace [, , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1247.145991] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fe248172-4be4-4d95-a8ca-c9c2ef203894" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1247.146117] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fe248172-4be4-4d95-a8ca-c9c2ef203894" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1247.146376] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fe248172-4be4-4d95-a8ca-c9c2ef203894" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1247.146376] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1247.146523] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1247.146523] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1247.146671] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1247.146752] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1247.146841] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('fe248172-4be4-4d95-a8ca-c9c2ef203894',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1247.168049] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1247.168049] env[65370]: DEBUG dogpile.cache.region [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Cache value generated in 0.027 seconds for key(s): 'zone-id' {{(pid=65370) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1247.168049] env[65370]: DEBUG dogpile.lock [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Released creation lock {{(pid=65370) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1247.168049] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Releasing lock "network-345" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1247.168350] env[65370]: DEBUG networking_nsxv3.common.locking [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Lock port-8d0271c8-b10c-41ae-b16f-4ab2a517ae14 taken with stack trace [, , , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1247.168518] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquiring lock "port-8d0271c8-b10c-41ae-b16f-4ab2a517ae14" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1247.168632] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquired lock "port-8d0271c8-b10c-41ae-b16f-4ab2a517ae14" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1247.168969] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquired external semaphore "port-8d0271c8-b10c-41ae-b16f-4ab2a517ae14" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1247.169124] env[65370]: DEBUG networking_nsxv3.api.rpc [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8d0271c8-b10c-41ae-b16f-4ab2a517ae14',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1247.306647] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1247.307014] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1247.307014] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1247.307302] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1247.307435] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1247.307672] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1247.308012] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1247.308012] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1247.308196] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1247.308305] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1247.308434] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: dce7e5a8-cd1c-43d7-bd27-e50a7be76eca already deleted. [ 1247.308554] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-dce7e5a8-cd1c-43d7-bd27-e50a7be76eca" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1247.597571] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1247.597774] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1247.597863] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1247.598072] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1247.598167] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1247.598374] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: be9c9972-d782-43b4-ba55-a29e461a1378 is going to be updated. [ 1247.629934] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1247.630165] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1247.630165] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1247.630435] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1247.630595] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1247.639515] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: be9c9972-d782-43b4-ba55-a29e461a1378 in Status: IN_PROGRESS for 2s [ 1247.649403] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1247.649542] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1247.649639] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1247.649903] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1247.650010] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1247.650665] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1247.651104] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1247.651104] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1247.651104] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1247.651104] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1247.651268] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: fe248172-4be4-4d95-a8ca-c9c2ef203894 is going to be updated. [ 1247.672048] env[65370]: DEBUG networking_nsxv3.common.locking [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1247.672288] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquiring lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1247.672398] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquired lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1247.672694] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquired external semaphore "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1247.672846] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Releasing lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1247.673011] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Segment Port 8d0271c8-b10c-41ae-b16f-4ab2a517ae14 not found, creating... [ 1247.673282] env[65370]: DEBUG networking_nsxv3.common.locking [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1247.673442] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquiring lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1247.673559] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquired lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1247.673776] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquired external semaphore "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1247.673910] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Releasing lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1247.674204] env[65370]: DEBUG networking_nsxv3.common.locking [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1247.674357] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquiring lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1247.674474] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquired lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1247.674677] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquired external semaphore "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1247.674804] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Releasing lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1247.674938] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Resource: SegmentPort with ID: 8d0271c8-b10c-41ae-b16f-4ab2a517ae14 is going to be created. [ 1247.707848] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1247.708119] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1247.708119] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1247.708293] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1247.708435] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1247.718849] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fe248172-4be4-4d95-a8ca-c9c2ef203894 in Status: IN_PROGRESS for 2s [ 1247.722279] env[65370]: DEBUG networking_nsxv3.common.locking [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1247.722473] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquiring lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1247.722577] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquired lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1247.722863] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquired external semaphore "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1247.723104] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Releasing lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1247.723333] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Releasing lock "port-8d0271c8-b10c-41ae-b16f-4ab2a517ae14" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1248.210503] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9b250822-f6be-41a2-9506-9d3472c0c4ae in Status: SUCCESS [ 1248.210846] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9b250822-f6be-41a2-9506-9d3472c0c4ae" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1248.210846] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9b250822-f6be-41a2-9506-9d3472c0c4ae" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1248.211949] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9b250822-f6be-41a2-9506-9d3472c0c4ae" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1248.211949] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1248.211949] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1248.211949] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1248.211949] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1248.211949] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1248.211949] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9b250822-f6be-41a2-9506-9d3472c0c4ae',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1248.401749] env[65370]: INFO networking_nsxv3.common.synchronization [req-c1e66273-44cc-4eb8-96fe-57a62e722e13 req-5b35e21e-8eef-4e79-ab9d-0ae4d186b984 service nova] Enqueued Resource ID: dce7e5a8-cd1c-43d7-bd27-e50a7be76eca with Priority: HIGHEST for action security_group_rules [ 1248.401954] env[65370]: INFO networking_nsxv3.common.synchronization [req-c1e66273-44cc-4eb8-96fe-57a62e722e13 req-5b35e21e-8eef-4e79-ab9d-0ae4d186b984 service nova] Enqueued Resource ID: dce7e5a8-cd1c-43d7-bd27-e50a7be76eca with Priority: HIGHEST for action security_group_members [ 1248.402092] env[65370]: INFO networking_nsxv3.common.synchronization [req-c1e66273-44cc-4eb8-96fe-57a62e722e13 req-5b35e21e-8eef-4e79-ab9d-0ae4d186b984 service nova] Enqueued Resource ID: 8d0271c8-b10c-41ae-b16f-4ab2a517ae14 with Priority: HIGHEST for action port [ 1248.402794] env[65370]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: dce7e5a8-cd1c-43d7-bd27-e50a7be76eca with Priority: HIGHEST for action security_group_rules [ 1248.402977] env[65370]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: dce7e5a8-cd1c-43d7-bd27-e50a7be76eca with Priority: HIGHEST for action security_group_members [ 1248.403136] env[65370]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8d0271c8-b10c-41ae-b16f-4ab2a517ae14 with Priority: HIGHEST for action port [ 1248.403531] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock rules-dce7e5a8-cd1c-43d7-bd27-e50a7be76eca taken with stack trace [, , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1248.403706] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-dce7e5a8-cd1c-43d7-bd27-e50a7be76eca" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1248.403784] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-dce7e5a8-cd1c-43d7-bd27-e50a7be76eca" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1248.404099] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-dce7e5a8-cd1c-43d7-bd27-e50a7be76eca" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1248.404182] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('dce7e5a8-cd1c-43d7-bd27-e50a7be76eca',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1248.405445] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock member-dce7e5a8-cd1c-43d7-bd27-e50a7be76eca taken with stack trace [, , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1248.405877] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-dce7e5a8-cd1c-43d7-bd27-e50a7be76eca" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1248.405877] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-dce7e5a8-cd1c-43d7-bd27-e50a7be76eca" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1248.405877] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-dce7e5a8-cd1c-43d7-bd27-e50a7be76eca" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1248.406026] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1248.407029] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1248.407029] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1248.407029] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1248.407029] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1248.407029] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('dce7e5a8-cd1c-43d7-bd27-e50a7be76eca',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1248.407737] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock port-8d0271c8-b10c-41ae-b16f-4ab2a517ae14 taken with stack trace [, , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1248.407737] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-8d0271c8-b10c-41ae-b16f-4ab2a517ae14" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1248.407737] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-8d0271c8-b10c-41ae-b16f-4ab2a517ae14" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1248.408541] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-8d0271c8-b10c-41ae-b16f-4ab2a517ae14" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1248.408541] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8d0271c8-b10c-41ae-b16f-4ab2a517ae14',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1248.714371] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('9b250822-f6be-41a2-9506-9d3472c0c4ae',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1248.909151] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('dce7e5a8-cd1c-43d7-bd27-e50a7be76eca',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1248.910212] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock member-dce7e5a8-cd1c-43d7-bd27-e50a7be76eca taken with stack trace [, , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1248.910412] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-dce7e5a8-cd1c-43d7-bd27-e50a7be76eca" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1248.910698] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 8d0271c8-b10c-41ae-b16f-4ab2a517ae14 with status ACTIVE [ 1248.910867] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1248.910976] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1248.911050] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1248.911255] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1248.911385] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1248.911546] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1248.911645] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1248.911706] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1248.911867] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1248.911945] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1248.912133] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1248.912225] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1248.912281] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1248.912418] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1248.912492] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1248.912577] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 8d0271c8-b10c-41ae-b16f-4ab2a517ae14 is going to be updated. [ 1248.935946] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1248.936273] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1248.936273] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1248.936402] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1248.936579] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1248.936684] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-8d0271c8-b10c-41ae-b16f-4ab2a517ae14" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1249.217251] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('9b250822-f6be-41a2-9506-9d3472c0c4ae',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1249.411978] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('dce7e5a8-cd1c-43d7-bd27-e50a7be76eca',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1249.649047] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: be9c9972-d782-43b4-ba55-a29e461a1378 in Status: SUCCESS [ 1249.649047] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-be9c9972-d782-43b4-ba55-a29e461a1378" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1249.719502] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1249.719663] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1249.719735] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1249.719958] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1249.720059] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1249.720154] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9b250822-f6be-41a2-9506-9d3472c0c4ae is going to be updated. [ 1249.746401] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fe248172-4be4-4d95-a8ca-c9c2ef203894 in Status: SUCCESS [ 1249.746699] env[65370]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: fe248172-4be4-4d95-a8ca-c9c2ef203894 deletion is rescheduled due to dependency. [ 1249.746831] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fe248172-4be4-4d95-a8ca-c9c2ef203894" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1249.764808] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1249.764944] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1249.765029] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1249.765282] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1249.765454] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1249.777172] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9b250822-f6be-41a2-9506-9d3472c0c4ae in Status: IN_PROGRESS for 2s [ 1249.916248] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1249.916415] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1249.916547] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1249.916724] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1249.916823] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1249.916929] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: dce7e5a8-cd1c-43d7-bd27-e50a7be76eca is going to be created. [ 1249.939978] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1249.939978] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1249.940149] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1249.940261] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1249.940459] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1249.953884] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: dce7e5a8-cd1c-43d7-bd27-e50a7be76eca in Status: UNINITIALIZED for 2s [ 1251.789890] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9b250822-f6be-41a2-9506-9d3472c0c4ae in Status: SUCCESS [ 1251.789890] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9b250822-f6be-41a2-9506-9d3472c0c4ae" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1251.789890] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9b250822-f6be-41a2-9506-9d3472c0c4ae" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1251.790476] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9b250822-f6be-41a2-9506-9d3472c0c4ae" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1251.790476] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1251.790476] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1251.790623] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1251.790745] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1251.790886] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1251.791042] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9b250822-f6be-41a2-9506-9d3472c0c4ae" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1251.791156] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('9b250822-f6be-41a2-9506-9d3472c0c4ae',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1251.964968] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: dce7e5a8-cd1c-43d7-bd27-e50a7be76eca in Status: SUCCESS [ 1251.965210] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-dce7e5a8-cd1c-43d7-bd27-e50a7be76eca" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1251.965380] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-dce7e5a8-cd1c-43d7-bd27-e50a7be76eca" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1251.965604] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-dce7e5a8-cd1c-43d7-bd27-e50a7be76eca" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1251.965794] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1251.965910] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1251.965975] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1251.966141] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1251.966221] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1251.966307] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-dce7e5a8-cd1c-43d7-bd27-e50a7be76eca" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1251.966400] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('dce7e5a8-cd1c-43d7-bd27-e50a7be76eca',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1252.294663] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock member-9b250822-f6be-41a2-9506-9d3472c0c4ae taken with stack trace [, , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1252.294893] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9b250822-f6be-41a2-9506-9d3472c0c4ae" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1252.294985] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9b250822-f6be-41a2-9506-9d3472c0c4ae" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1252.295264] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9b250822-f6be-41a2-9506-9d3472c0c4ae" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1252.295491] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1252.295612] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1252.295678] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1252.295839] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1252.295923] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1252.296021] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9b250822-f6be-41a2-9506-9d3472c0c4ae" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1252.296177] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock member-9b250822-f6be-41a2-9506-9d3472c0c4ae taken with stack trace [, , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1252.296297] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9b250822-f6be-41a2-9506-9d3472c0c4ae" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1252.296385] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9b250822-f6be-41a2-9506-9d3472c0c4ae" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1252.296548] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9b250822-f6be-41a2-9506-9d3472c0c4ae" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1252.296701] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1252.296792] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1252.296856] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1252.296995] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1252.297083] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1252.297165] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9b250822-f6be-41a2-9506-9d3472c0c4ae" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1252.297256] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('9b250822-f6be-41a2-9506-9d3472c0c4ae',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1252.469212] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock member-dce7e5a8-cd1c-43d7-bd27-e50a7be76eca taken with stack trace [, , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1252.469435] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-dce7e5a8-cd1c-43d7-bd27-e50a7be76eca" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1252.469492] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-dce7e5a8-cd1c-43d7-bd27-e50a7be76eca" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1252.469695] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-dce7e5a8-cd1c-43d7-bd27-e50a7be76eca" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1252.469873] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1252.470043] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1252.470158] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1252.470253] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1252.470340] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1252.470479] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-dce7e5a8-cd1c-43d7-bd27-e50a7be76eca" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1252.470632] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock member-dce7e5a8-cd1c-43d7-bd27-e50a7be76eca taken with stack trace [, , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1252.470726] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-dce7e5a8-cd1c-43d7-bd27-e50a7be76eca" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1252.470787] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-dce7e5a8-cd1c-43d7-bd27-e50a7be76eca" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1252.470928] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-dce7e5a8-cd1c-43d7-bd27-e50a7be76eca" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1252.471085] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1252.471174] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1252.471232] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1252.471413] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1252.471515] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1252.471570] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-dce7e5a8-cd1c-43d7-bd27-e50a7be76eca" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1252.471682] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('dce7e5a8-cd1c-43d7-bd27-e50a7be76eca',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1252.799712] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 9b250822-f6be-41a2-9506-9d3472c0c4ae: rpc.has_security_group_logging(os_id): False [ 1252.819809] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1252.819948] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1252.819948] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1252.820235] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1252.820428] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1252.820716] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1252.820824] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1252.820891] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1252.821100] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1252.821185] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1252.821434] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1252.821614] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1252.821680] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1252.821855] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1252.821936] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1252.822350] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1252.822462] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1252.822536] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1252.822782] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1252.822883] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1252.822999] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 9b250822-f6be-41a2-9506-9d3472c0c4ae is going to be updated. [ 1252.855947] env[65370]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-22548ca9-c949-4428-b53c-fd85bd762917 None None] NSXv3 Agent Agent loop - iteration:2 completed [ 1252.856163] env[65370]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-22548ca9-c949-4428-b53c-fd85bd762917 None None] NSXv3 Agent Agent loop - iteration:3 started [ 1252.886486] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1252.886651] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1252.886741] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1252.886973] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1252.887164] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1252.899034] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 9b250822-f6be-41a2-9506-9d3472c0c4ae in Status: IN_PROGRESS for 2s [ 1252.974022] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for dce7e5a8-cd1c-43d7-bd27-e50a7be76eca: rpc.has_security_group_logging(os_id): False [ 1252.991444] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1252.991649] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1252.991754] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1252.991984] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1252.992118] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1252.992351] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1252.992479] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1252.992555] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1252.992764] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1252.992921] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1252.993058] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1252.993162] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1252.993242] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1252.993391] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1252.993466] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1252.993655] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1252.993836] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1252.993836] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1252.993948] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1252.994012] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1252.994099] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: dce7e5a8-cd1c-43d7-bd27-e50a7be76eca is going to be created. [ 1253.058680] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1253.059095] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1253.059847] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1253.059847] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1253.059847] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1253.072143] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: dce7e5a8-cd1c-43d7-bd27-e50a7be76eca in Status: IN_PROGRESS for 2s [ 1253.079064] env[65370]: INFO networking_nsxv3.common.synchronization [req-65d311e2-436b-4b03-927d-303975090023 req-d5962e8b-6095-4c00-8e4c-7162872cc147 tempest-AttachInterfacesTestJSON-315686657 tempest-AttachInterfacesTestJSON-315686657-project-member] Enqueued Resource ID: be9c9972-d782-43b4-ba55-a29e461a1378 with Priority: HIGHEST for action security_group_members [ 1253.079805] env[65370]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: be9c9972-d782-43b4-ba55-a29e461a1378 with Priority: HIGHEST for action security_group_members [ 1253.080189] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock member-be9c9972-d782-43b4-ba55-a29e461a1378 taken with stack trace [, , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1253.080432] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-be9c9972-d782-43b4-ba55-a29e461a1378" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1253.080508] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-be9c9972-d782-43b4-ba55-a29e461a1378" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1253.080747] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-be9c9972-d782-43b4-ba55-a29e461a1378" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1253.080904] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1253.081097] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1253.081197] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1253.081342] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1253.081459] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1253.081622] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('be9c9972-d782-43b4-ba55-a29e461a1378',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1253.585396] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1253.585640] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1253.585640] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1253.585880] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1253.586051] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1253.586187] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1253.586286] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1253.586349] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1253.586523] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1253.586606] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1253.586711] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: be9c9972-d782-43b4-ba55-a29e461a1378 is going to be updated. [ 1253.612332] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1253.612498] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1253.612572] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1253.612898] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1253.613073] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1253.622670] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: be9c9972-d782-43b4-ba55-a29e461a1378 in Status: IN_PROGRESS for 2s [ 1254.923643] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 9b250822-f6be-41a2-9506-9d3472c0c4ae in Status: SUCCESS [ 1254.924066] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-9b250822-f6be-41a2-9506-9d3472c0c4ae" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1255.084266] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: dce7e5a8-cd1c-43d7-bd27-e50a7be76eca in Status: SUCCESS [ 1255.084572] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-dce7e5a8-cd1c-43d7-bd27-e50a7be76eca" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1255.259563] env[65370]: INFO networking_nsxv3.common.synchronization [req-92b02e68-213f-4b5e-b315-8e252f577c7c req-0b649c9f-1c78-4983-82f6-7e19ab80700d tempest-ServerActionsTestJSON-720598601 tempest-ServerActionsTestJSON-720598601-project-member] Enqueued Resource ID: fe248172-4be4-4d95-a8ca-c9c2ef203894 with Priority: HIGHEST for action security_group_members [ 1255.260029] env[65370]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fe248172-4be4-4d95-a8ca-c9c2ef203894 with Priority: HIGHEST for action security_group_members [ 1255.260288] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock member-fe248172-4be4-4d95-a8ca-c9c2ef203894 taken with stack trace [, , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1255.260404] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fe248172-4be4-4d95-a8ca-c9c2ef203894" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1255.260500] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fe248172-4be4-4d95-a8ca-c9c2ef203894" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1255.260688] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fe248172-4be4-4d95-a8ca-c9c2ef203894" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1255.260843] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1255.260936] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1255.260995] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1255.261156] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1255.261240] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1255.261330] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('fe248172-4be4-4d95-a8ca-c9c2ef203894',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1255.602716] env[65370]: DEBUG networking_nsxv3.common.locking [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Lock network-609 taken with stack trace [, , , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1255.602920] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquiring lock "network-609" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1255.603054] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquired lock "network-609" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1255.603403] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquired external semaphore "network-609" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1255.603656] env[65370]: DEBUG networking_nsxv3.common.locking [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1255.603817] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquiring lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1255.603931] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquired lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1255.604168] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquired external semaphore "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1255.604307] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Releasing lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1255.604590] env[65370]: DEBUG dogpile.cache.region [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] No value present for key: 'zone-id' {{(pid=65370) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1255.604708] env[65370]: DEBUG dogpile.lock [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] NeedRegenerationException {{(pid=65370) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1255.604817] env[65370]: DEBUG dogpile.lock [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] no value, waiting for create lock {{(pid=65370) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1255.604924] env[65370]: DEBUG dogpile.lock [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] value creation lock acquired {{(pid=65370) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1255.605042] env[65370]: DEBUG dogpile.cache.region [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] No value present for key: 'zone-id' {{(pid=65370) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1255.605133] env[65370]: DEBUG dogpile.lock [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Calling creation function for not-yet-present value {{(pid=65370) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1255.605257] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1255.624281] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1255.624457] env[65370]: DEBUG dogpile.cache.region [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=65370) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1255.624593] env[65370]: DEBUG dogpile.lock [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Released creation lock {{(pid=65370) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1255.624764] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Releasing lock "network-609" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1255.625090] env[65370]: DEBUG networking_nsxv3.common.locking [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Lock port-4601eba3-7099-426b-88f5-aad21f5b7c9c taken with stack trace [, , , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1255.625258] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquiring lock "port-4601eba3-7099-426b-88f5-aad21f5b7c9c" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1255.625384] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquired lock "port-4601eba3-7099-426b-88f5-aad21f5b7c9c" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1255.625697] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquired external semaphore "port-4601eba3-7099-426b-88f5-aad21f5b7c9c" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1255.625835] env[65370]: DEBUG networking_nsxv3.api.rpc [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4601eba3-7099-426b-88f5-aad21f5b7c9c',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1255.636424] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: be9c9972-d782-43b4-ba55-a29e461a1378 in Status: SUCCESS [ 1255.636854] env[65370]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: be9c9972-d782-43b4-ba55-a29e461a1378 deletion is rescheduled due to dependency. [ 1255.636854] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-be9c9972-d782-43b4-ba55-a29e461a1378" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1255.763962] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1255.764201] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1255.764201] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1255.764433] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1255.764525] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1255.765429] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1255.765429] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1255.765429] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1255.765429] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1255.765429] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1255.765429] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: fe248172-4be4-4d95-a8ca-c9c2ef203894 is going to be updated. [ 1255.788819] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1255.788988] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1255.789049] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1255.789236] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1255.789375] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1255.797851] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fe248172-4be4-4d95-a8ca-c9c2ef203894 in Status: IN_PROGRESS for 2s [ 1256.129786] env[65370]: DEBUG networking_nsxv3.common.locking [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1256.130186] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquiring lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1256.130295] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquired lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1256.130607] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquired external semaphore "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1256.130769] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Releasing lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1256.130912] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Segment Port 4601eba3-7099-426b-88f5-aad21f5b7c9c not found, creating... [ 1256.131204] env[65370]: DEBUG networking_nsxv3.common.locking [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1256.131365] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquiring lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1256.131500] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquired lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1256.131734] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquired external semaphore "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1256.131868] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Releasing lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1256.132159] env[65370]: DEBUG networking_nsxv3.common.locking [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1256.132322] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquiring lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1256.132438] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquired lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1256.132645] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquired external semaphore "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1256.132782] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Releasing lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1256.132908] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Resource: SegmentPort with ID: 4601eba3-7099-426b-88f5-aad21f5b7c9c is going to be created. [ 1256.152566] env[65370]: DEBUG networking_nsxv3.common.locking [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1256.152787] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquiring lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1256.152917] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquired lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1256.153172] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquired external semaphore "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1256.153396] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Releasing lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1256.153620] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Releasing lock "port-4601eba3-7099-426b-88f5-aad21f5b7c9c" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1256.868089] env[65370]: INFO networking_nsxv3.common.synchronization [req-92b02e68-213f-4b5e-b315-8e252f577c7c req-126bf024-bcbd-47aa-b742-2e80b4c0d4af service nova] Enqueued Resource ID: fe248172-4be4-4d95-a8ca-c9c2ef203894 with Priority: HIGHEST for action security_group_rules [ 1256.868327] env[65370]: INFO networking_nsxv3.common.synchronization [req-92b02e68-213f-4b5e-b315-8e252f577c7c req-126bf024-bcbd-47aa-b742-2e80b4c0d4af service nova] Enqueued Resource ID: fe248172-4be4-4d95-a8ca-c9c2ef203894 with Priority: HIGHEST for action security_group_members [ 1256.868444] env[65370]: INFO networking_nsxv3.common.synchronization [req-92b02e68-213f-4b5e-b315-8e252f577c7c req-126bf024-bcbd-47aa-b742-2e80b4c0d4af service nova] Enqueued Resource ID: 4601eba3-7099-426b-88f5-aad21f5b7c9c with Priority: HIGHEST for action port [ 1256.870796] env[65370]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fe248172-4be4-4d95-a8ca-c9c2ef203894 with Priority: HIGHEST for action security_group_rules [ 1256.870796] env[65370]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fe248172-4be4-4d95-a8ca-c9c2ef203894 with Priority: HIGHEST for action security_group_members [ 1256.870796] env[65370]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4601eba3-7099-426b-88f5-aad21f5b7c9c with Priority: HIGHEST for action port [ 1256.871623] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock rules-fe248172-4be4-4d95-a8ca-c9c2ef203894 taken with stack trace [, , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1256.871623] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-fe248172-4be4-4d95-a8ca-c9c2ef203894" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1256.871747] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-fe248172-4be4-4d95-a8ca-c9c2ef203894" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1256.871937] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-fe248172-4be4-4d95-a8ca-c9c2ef203894" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1256.872705] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('fe248172-4be4-4d95-a8ca-c9c2ef203894',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1256.873081] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock member-fe248172-4be4-4d95-a8ca-c9c2ef203894 taken with stack trace [, , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1256.873169] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fe248172-4be4-4d95-a8ca-c9c2ef203894" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1256.874153] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock port-4601eba3-7099-426b-88f5-aad21f5b7c9c taken with stack trace [, , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1256.874153] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-4601eba3-7099-426b-88f5-aad21f5b7c9c" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1256.874153] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-4601eba3-7099-426b-88f5-aad21f5b7c9c" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1256.874153] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-4601eba3-7099-426b-88f5-aad21f5b7c9c" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1256.874153] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4601eba3-7099-426b-88f5-aad21f5b7c9c',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1257.377096] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock member-fe248172-4be4-4d95-a8ca-c9c2ef203894 taken with stack trace [, , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1257.377096] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fe248172-4be4-4d95-a8ca-c9c2ef203894" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1257.377096] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 4601eba3-7099-426b-88f5-aad21f5b7c9c with status ACTIVE [ 1257.377096] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1257.377096] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1257.377538] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1257.377538] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1257.377538] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1257.377692] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1257.377793] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1257.377863] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1257.378072] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1257.378157] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1257.378447] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1257.378605] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1257.378686] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1257.378844] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1257.378917] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1257.379681] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 4601eba3-7099-426b-88f5-aad21f5b7c9c is going to be updated. [ 1257.403029] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1257.403257] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1257.403381] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1257.403639] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1257.403784] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1257.404012] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-4601eba3-7099-426b-88f5-aad21f5b7c9c" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1257.554450] env[65370]: INFO networking_nsxv3.common.synchronization [None req-b9e3689c-fd9c-4cc5-b166-57d9d013026b tempest-AttachInterfacesTestJSON-315686657 tempest-AttachInterfacesTestJSON-315686657-project-member] Enqueued Resource ID: 826ed52a-9222-434f-a4f9-e83fd60a5345 with Priority: HIGHEST for action security_group_members [ 1257.555066] env[65370]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 826ed52a-9222-434f-a4f9-e83fd60a5345 with Priority: HIGHEST for action security_group_members [ 1257.556301] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock member-826ed52a-9222-434f-a4f9-e83fd60a5345 taken with stack trace [, , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1257.556442] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-826ed52a-9222-434f-a4f9-e83fd60a5345" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1257.556520] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-826ed52a-9222-434f-a4f9-e83fd60a5345" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1257.556800] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-826ed52a-9222-434f-a4f9-e83fd60a5345" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1257.556942] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1257.557077] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1257.557160] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1257.557402] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1257.557500] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1257.557602] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('826ed52a-9222-434f-a4f9-e83fd60a5345',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1257.817153] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fe248172-4be4-4d95-a8ca-c9c2ef203894 in Status: SUCCESS [ 1257.817348] env[65370]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: fe248172-4be4-4d95-a8ca-c9c2ef203894 deletion is rescheduled due to dependency. [ 1257.817465] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fe248172-4be4-4d95-a8ca-c9c2ef203894" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1257.818081] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fe248172-4be4-4d95-a8ca-c9c2ef203894" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1257.818340] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fe248172-4be4-4d95-a8ca-c9c2ef203894" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1257.818565] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1257.818686] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1257.818751] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1257.818905] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1257.818988] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1257.819099] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('fe248172-4be4-4d95-a8ca-c9c2ef203894',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1258.059908] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1258.061034] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1258.061034] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1258.061034] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1258.061034] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1258.061034] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1258.061034] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1258.061034] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1258.061034] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1258.061034] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1258.061460] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 826ed52a-9222-434f-a4f9-e83fd60a5345 is going to be updated. [ 1258.090185] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1258.090366] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1258.090408] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1258.090688] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1258.090798] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1258.099659] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 826ed52a-9222-434f-a4f9-e83fd60a5345 in Status: IN_PROGRESS for 2s [ 1258.321891] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('fe248172-4be4-4d95-a8ca-c9c2ef203894',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1258.824018] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('fe248172-4be4-4d95-a8ca-c9c2ef203894',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1259.328806] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1259.328806] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1259.328806] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1259.328806] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1259.328806] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1259.328806] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: fe248172-4be4-4d95-a8ca-c9c2ef203894 is going to be updated. [ 1259.357229] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1259.357563] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1259.357716] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1259.358094] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1259.358373] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1259.369838] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fe248172-4be4-4d95-a8ca-c9c2ef203894 in Status: IN_PROGRESS for 2s [ 1259.988643] env[65370]: INFO networking_nsxv3.common.synchronization [req-9c9b3e08-435d-4d24-8fd1-10486cf231a8 req-f39a0579-cfba-4707-9015-9cdda3dd0efa tempest-ServerMetadataTestJSON-1068631085 tempest-ServerMetadataTestJSON-1068631085-project-member] Enqueued Resource ID: dce7e5a8-cd1c-43d7-bd27-e50a7be76eca with Priority: HIGHEST for action security_group_members [ 1259.989646] env[65370]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: dce7e5a8-cd1c-43d7-bd27-e50a7be76eca with Priority: HIGHEST for action security_group_members [ 1259.990134] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock member-dce7e5a8-cd1c-43d7-bd27-e50a7be76eca taken with stack trace [, , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1259.990410] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-dce7e5a8-cd1c-43d7-bd27-e50a7be76eca" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1259.990607] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-dce7e5a8-cd1c-43d7-bd27-e50a7be76eca" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1259.990955] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-dce7e5a8-cd1c-43d7-bd27-e50a7be76eca" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1259.991851] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1259.991851] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1259.991851] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1259.991851] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1259.991851] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1259.991851] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('dce7e5a8-cd1c-43d7-bd27-e50a7be76eca',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1260.110572] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 826ed52a-9222-434f-a4f9-e83fd60a5345 in Status: SUCCESS [ 1260.110872] env[65370]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 826ed52a-9222-434f-a4f9-e83fd60a5345 deletion is rescheduled due to dependency. [ 1260.111034] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-826ed52a-9222-434f-a4f9-e83fd60a5345" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1260.494573] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1260.494777] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1260.494777] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1260.495140] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1260.495267] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1260.495469] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1260.495576] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1260.495641] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1260.495812] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1260.495888] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1260.495972] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: dce7e5a8-cd1c-43d7-bd27-e50a7be76eca is going to be updated. [ 1260.522637] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1260.522860] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1260.522860] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1260.523050] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1260.523193] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1260.532724] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: dce7e5a8-cd1c-43d7-bd27-e50a7be76eca in Status: IN_PROGRESS for 2s [ 1261.380278] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fe248172-4be4-4d95-a8ca-c9c2ef203894 in Status: SUCCESS [ 1261.380642] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fe248172-4be4-4d95-a8ca-c9c2ef203894" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1261.381042] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fe248172-4be4-4d95-a8ca-c9c2ef203894" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1261.381042] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fe248172-4be4-4d95-a8ca-c9c2ef203894" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1261.381187] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1261.381264] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1261.381359] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1261.381620] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1261.381830] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1261.381946] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fe248172-4be4-4d95-a8ca-c9c2ef203894" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1261.382100] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('fe248172-4be4-4d95-a8ca-c9c2ef203894',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1261.884991] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('fe248172-4be4-4d95-a8ca-c9c2ef203894',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1262.388114] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for fe248172-4be4-4d95-a8ca-c9c2ef203894: rpc.has_security_group_logging(os_id): False [ 1262.410077] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1262.410077] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1262.410077] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1262.410077] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1262.410077] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1262.410077] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1262.410077] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1262.410077] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1262.410561] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1262.410561] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1262.410561] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: fe248172-4be4-4d95-a8ca-c9c2ef203894 is going to be updated. [ 1262.474583] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1262.474583] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1262.474583] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1262.474583] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1262.474942] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1262.494398] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: fe248172-4be4-4d95-a8ca-c9c2ef203894 in Status: IN_PROGRESS for 2s [ 1262.545187] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: dce7e5a8-cd1c-43d7-bd27-e50a7be76eca in Status: SUCCESS [ 1262.545409] env[65370]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: dce7e5a8-cd1c-43d7-bd27-e50a7be76eca deletion is rescheduled due to dependency. [ 1262.545514] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-dce7e5a8-cd1c-43d7-bd27-e50a7be76eca" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1262.812507] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock all taken with stack trace [, , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1262.812697] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "all" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1262.812772] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "all" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1262.813073] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "all" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1262.813194] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_ports_with_revisions called with arguments (1000, 0) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1263.315708] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_groups_with_revisions called with arguments (1000, 0) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1263.818434] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_qos_policies_with_revisions called with arguments (1000, 0) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1264.320760] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Inventory metadata is going to be refreshed. [ 1264.321019] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Segment. [ 1264.510191] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: fe248172-4be4-4d95-a8ca-c9c2ef203894 in Status: SUCCESS [ 1264.510364] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-fe248172-4be4-4d95-a8ca-c9c2ef203894" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1264.991562] env[65370]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1264.991562] env[65370]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1265.172090] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1265.172291] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1265.172346] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1265.172516] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1265.187643] env[65370]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider [-] Duplicate resource with OS_ID: 992 ID: cl2-zone-992 [ 1265.188625] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1265.189547] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:SegmentPort. [ 1265.227318] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1265.227529] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1265.227604] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1265.227834] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1265.246558] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1265.247535] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:SegmentPort Is:0. [ 1265.247665] env[65370]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:SegmentPort Are:set() {{(pid=65370) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 1265.247791] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules). [ 1265.291625] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1265.291891] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1265.291891] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1265.292061] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1265.293463] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1265.293693] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules Remote IP Prefix). [ 1265.376860] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules Remote IP Prefix) taken with stack trace [, , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1265.377019] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules Remote IP Prefix)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1265.377142] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules Remote IP Prefix)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1265.377345] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules Remote IP Prefix)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1265.378114] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules Remote IP Prefix)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1265.378202] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Address Group. [ 1265.459027] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Address Group taken with stack trace [, , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1265.459027] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Address Group" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1265.459218] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Address Group" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1265.459444] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Address Group" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1265.459780] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Address Group" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1265.460303] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Security Group (Rules) Is:45. [ 1265.460379] env[65370]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Security Group (Rules) Are:{'408a8a38-c326-4f43-84a2-818a13f7e124', '237e1a89-daff-4fd5-b02a-97e1d536d9bd', '87bbb461-0dea-430b-adcd-ee0e3f4ed609', '23fa7df4-0993-48e9-9080-1087f76da31c', '420136f3-91df-4669-b5e3-cee436aeacb9', '154b7e30-9d22-43f4-84bb-7d8dd4d7cc9a', 'eba16cc3-e8ee-4772-ba0d-2b7b582b7844', 'f848ee13-2bde-41b3-b6a1-cf583163d5cd', '9b250822-f6be-41a2-9506-9d3472c0c4ae', '5dd6e6d4-a4c3-43e1-a153-05b659cf62c9', 'b7074d70-d8cb-411f-b8c4-a4007dfd74f8', 'fe248172-4be4-4d95-a8ca-c9c2ef203894', '1ba7c228-9a96-4f3b-9855-f84e883a5bfd', '8d9c7efa-60b6-44af-830b-f32145b1b403', '14c6c739-bd84-4bc8-9d1c-9bc29741c32d', '21a3b55c-64ce-4782-808a-31350166c184', '9496f4d5-71fb-471e-bab0-2220819ba7ed', '67f4a0c1-3a3c-4ed8-9358-3a9645aba154', 'aa619879-3f9d-4aea-b1cb-1e5adfe92cfd', 'c26b8d0b-5a65-4082-8dff-404228d547c4', '5c5eea1d-0338-4750-8d40-b5e68d251d49', '5b5e0c25-5d4e-4e13-9670-be19b4122c73', 'e32dcc83-5b25-41d1-bde2-d13514b085ad', 'e2790d7c-6d0c-45bc-84d1-8cb00d26b9b0', '1eaa763e-4469-4428-92d0-ba20a6c99edc', '78c0a4a2-12c9-4a82-bedc-df813ca8b608', 'd65082c9-0b60-42be-a86a-b728b05e4ca4', 'ff03ba53-594b-4bc2-b51c-5c04df76011d', '7c93cef4-117c-4bf3-aaf5-07dadeb90a88', 'ade9055b-2ef9-426f-9386-65654700ee06', '2011abd7-ba10-4aae-84fb-1b1bfbd238fa', '4269e0a9-b570-412a-9993-d1965229c186', 'b6c4259c-ea9b-4b2f-84b9-cbedce2ee198', 'dce7e5a8-cd1c-43d7-bd27-e50a7be76eca', '5f21eadf-115c-453d-a18a-ea8d6e583522', '48262726-1476-4e14-ad49-3cb37aeed405', '00a251e9-7a00-4293-9092-9556bc8b91c2', '1a7b0f53-ef43-4301-97b8-ab12f1f2ae45', '73fdcc5c-e9b7-4038-bdaa-9396e2912ed3', 'be9c9972-d782-43b4-ba55-a29e461a1378', '48cb2a6d-3a04-4700-a0e8-ee3e4e1a679c', 'd40b0ebb-5855-4234-b52c-c2003a5df171', '47d8b360-5d90-42ea-b9c3-ed76fddd03a3', 'a64b2117-cdc3-4b72-a9f3-57dfa8198991', '826ed52a-9222-434f-a4f9-e83fd60a5345'} {{(pid=65370) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 1265.460514] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Segment QoS. [ 1265.481681] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Segment QoS taken with stack trace [, , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1265.482196] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment QoS" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1265.482196] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment QoS" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1265.482354] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment QoS" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1265.482354] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment QoS" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1265.482474] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Segment QoS Is:0. [ 1265.482532] env[65370]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Segment QoS Are:set() {{(pid=65370) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 1265.482582] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Members). [ 1265.556916] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1265.557137] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1265.557137] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1265.557307] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1265.558385] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1265.558631] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Security Group (Members) Is:0. [ 1265.558700] env[65370]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Security Group (Members) Are:set() {{(pid=65370) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 1265.558776] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Inventory metadata have been refreshed. [ 1265.558840] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 0/0 resources of Type:Ports [ 1265.558918] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 20/45 resources of Type:Security Group Rules [ 1265.558986] env[65370]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 408a8a38-c326-4f43-84a2-818a13f7e124 with Priority: HIGH for action security_group_rules [ 1265.559079] env[65370]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 237e1a89-daff-4fd5-b02a-97e1d536d9bd with Priority: HIGH for action security_group_rules [ 1265.559146] env[65370]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 87bbb461-0dea-430b-adcd-ee0e3f4ed609 with Priority: HIGH for action security_group_rules [ 1265.559210] env[65370]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 23fa7df4-0993-48e9-9080-1087f76da31c with Priority: HIGH for action security_group_rules [ 1265.559273] env[65370]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 420136f3-91df-4669-b5e3-cee436aeacb9 with Priority: HIGH for action security_group_rules [ 1265.559336] env[65370]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 154b7e30-9d22-43f4-84bb-7d8dd4d7cc9a with Priority: HIGH for action security_group_rules [ 1265.559385] env[65370]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: eba16cc3-e8ee-4772-ba0d-2b7b582b7844 with Priority: HIGH for action security_group_rules [ 1265.559460] env[65370]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: f848ee13-2bde-41b3-b6a1-cf583163d5cd with Priority: HIGH for action security_group_rules [ 1265.559513] env[65370]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 9b250822-f6be-41a2-9506-9d3472c0c4ae with Priority: HIGH for action security_group_rules [ 1265.559576] env[65370]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 5dd6e6d4-a4c3-43e1-a153-05b659cf62c9 with Priority: HIGH for action security_group_rules [ 1265.559640] env[65370]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: b7074d70-d8cb-411f-b8c4-a4007dfd74f8 with Priority: HIGH for action security_group_rules [ 1265.559701] env[65370]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: fe248172-4be4-4d95-a8ca-c9c2ef203894 with Priority: HIGH for action security_group_rules [ 1265.559772] env[65370]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 1ba7c228-9a96-4f3b-9855-f84e883a5bfd with Priority: HIGH for action security_group_rules [ 1265.559861] env[65370]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 8d9c7efa-60b6-44af-830b-f32145b1b403 with Priority: HIGH for action security_group_rules [ 1265.559967] env[65370]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 14c6c739-bd84-4bc8-9d1c-9bc29741c32d with Priority: HIGH for action security_group_rules [ 1265.560545] env[65370]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 21a3b55c-64ce-4782-808a-31350166c184 with Priority: HIGH for action security_group_rules [ 1265.560545] env[65370]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 9496f4d5-71fb-471e-bab0-2220819ba7ed with Priority: HIGH for action security_group_rules [ 1265.560545] env[65370]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 67f4a0c1-3a3c-4ed8-9358-3a9645aba154 with Priority: HIGH for action security_group_rules [ 1265.560545] env[65370]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: aa619879-3f9d-4aea-b1cb-1e5adfe92cfd with Priority: HIGH for action security_group_rules [ 1265.560545] env[65370]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: c26b8d0b-5a65-4082-8dff-404228d547c4 with Priority: HIGH for action security_group_rules [ 1265.560545] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "all" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1269.992416] env[65370]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1269.992846] env[65370]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=20], Jobs=0 [ 1269.992846] env[65370]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 408a8a38-c326-4f43-84a2-818a13f7e124 with Priority: HIGH for action security_group_rules [ 1269.992846] env[65370]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 87bbb461-0dea-430b-adcd-ee0e3f4ed609 with Priority: HIGH for action security_group_rules [ 1269.992962] env[65370]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: eba16cc3-e8ee-4772-ba0d-2b7b582b7844 with Priority: HIGH for action security_group_rules [ 1269.993035] env[65370]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 14c6c739-bd84-4bc8-9d1c-9bc29741c32d with Priority: HIGH for action security_group_rules [ 1269.993135] env[65370]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c26b8d0b-5a65-4082-8dff-404228d547c4 with Priority: HIGH for action security_group_rules [ 1269.993222] env[65370]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: aa619879-3f9d-4aea-b1cb-1e5adfe92cfd with Priority: HIGH for action security_group_rules [ 1269.993312] env[65370]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 67f4a0c1-3a3c-4ed8-9358-3a9645aba154 with Priority: HIGH for action security_group_rules [ 1269.993400] env[65370]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9496f4d5-71fb-471e-bab0-2220819ba7ed with Priority: HIGH for action security_group_rules [ 1269.993488] env[65370]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8d9c7efa-60b6-44af-830b-f32145b1b403 with Priority: HIGH for action security_group_rules [ 1269.993580] env[65370]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 21a3b55c-64ce-4782-808a-31350166c184 with Priority: HIGH for action security_group_rules [ 1269.993667] env[65370]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1ba7c228-9a96-4f3b-9855-f84e883a5bfd with Priority: HIGH for action security_group_rules [ 1269.993755] env[65370]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fe248172-4be4-4d95-a8ca-c9c2ef203894 with Priority: HIGH for action security_group_rules [ 1269.993841] env[65370]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b7074d70-d8cb-411f-b8c4-a4007dfd74f8 with Priority: HIGH for action security_group_rules [ 1269.993927] env[65370]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5dd6e6d4-a4c3-43e1-a153-05b659cf62c9 with Priority: HIGH for action security_group_rules [ 1269.994023] env[65370]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9b250822-f6be-41a2-9506-9d3472c0c4ae with Priority: HIGH for action security_group_rules [ 1269.994114] env[65370]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 154b7e30-9d22-43f4-84bb-7d8dd4d7cc9a with Priority: HIGH for action security_group_rules [ 1269.994200] env[65370]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f848ee13-2bde-41b3-b6a1-cf583163d5cd with Priority: HIGH for action security_group_rules [ 1269.994283] env[65370]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 420136f3-91df-4669-b5e3-cee436aeacb9 with Priority: HIGH for action security_group_rules [ 1269.994367] env[65370]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 237e1a89-daff-4fd5-b02a-97e1d536d9bd with Priority: HIGH for action security_group_rules [ 1269.994454] env[65370]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 23fa7df4-0993-48e9-9080-1087f76da31c with Priority: HIGH for action security_group_rules [ 1269.994783] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock rules-408a8a38-c326-4f43-84a2-818a13f7e124 taken with stack trace [, , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1269.994912] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-408a8a38-c326-4f43-84a2-818a13f7e124" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1269.994976] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-408a8a38-c326-4f43-84a2-818a13f7e124" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1269.995205] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-408a8a38-c326-4f43-84a2-818a13f7e124" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1269.995320] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('408a8a38-c326-4f43-84a2-818a13f7e124',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1269.996286] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock rules-87bbb461-0dea-430b-adcd-ee0e3f4ed609 taken with stack trace [, , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1269.996413] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-87bbb461-0dea-430b-adcd-ee0e3f4ed609" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1269.996480] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-87bbb461-0dea-430b-adcd-ee0e3f4ed609" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1269.996649] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-87bbb461-0dea-430b-adcd-ee0e3f4ed609" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1269.996723] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('87bbb461-0dea-430b-adcd-ee0e3f4ed609',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1269.998343] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock rules-eba16cc3-e8ee-4772-ba0d-2b7b582b7844 taken with stack trace [, , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1269.998343] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-eba16cc3-e8ee-4772-ba0d-2b7b582b7844" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1269.998343] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-eba16cc3-e8ee-4772-ba0d-2b7b582b7844" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1269.998343] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-eba16cc3-e8ee-4772-ba0d-2b7b582b7844" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1269.998343] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('eba16cc3-e8ee-4772-ba0d-2b7b582b7844',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1269.998950] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock rules-14c6c739-bd84-4bc8-9d1c-9bc29741c32d taken with stack trace [, , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1269.998950] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-14c6c739-bd84-4bc8-9d1c-9bc29741c32d" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1269.998950] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-14c6c739-bd84-4bc8-9d1c-9bc29741c32d" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1269.999121] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-14c6c739-bd84-4bc8-9d1c-9bc29741c32d" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1269.999161] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('14c6c739-bd84-4bc8-9d1c-9bc29741c32d',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1269.999827] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock rules-c26b8d0b-5a65-4082-8dff-404228d547c4 taken with stack trace [, , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1269.999932] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-c26b8d0b-5a65-4082-8dff-404228d547c4" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1269.999997] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-c26b8d0b-5a65-4082-8dff-404228d547c4" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1270.000153] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-c26b8d0b-5a65-4082-8dff-404228d547c4" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1270.000223] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('c26b8d0b-5a65-4082-8dff-404228d547c4',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1270.000922] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock rules-aa619879-3f9d-4aea-b1cb-1e5adfe92cfd taken with stack trace [, , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1270.001038] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-aa619879-3f9d-4aea-b1cb-1e5adfe92cfd" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1270.001094] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-aa619879-3f9d-4aea-b1cb-1e5adfe92cfd" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1270.001239] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-aa619879-3f9d-4aea-b1cb-1e5adfe92cfd" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1270.001311] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('aa619879-3f9d-4aea-b1cb-1e5adfe92cfd',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1270.001981] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock rules-67f4a0c1-3a3c-4ed8-9358-3a9645aba154 taken with stack trace [, , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1270.002125] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-67f4a0c1-3a3c-4ed8-9358-3a9645aba154" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1270.002192] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-67f4a0c1-3a3c-4ed8-9358-3a9645aba154" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1270.002339] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-67f4a0c1-3a3c-4ed8-9358-3a9645aba154" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1270.002410] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('67f4a0c1-3a3c-4ed8-9358-3a9645aba154',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1270.003409] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock rules-9496f4d5-71fb-471e-bab0-2220819ba7ed taken with stack trace [, , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1270.003409] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-9496f4d5-71fb-471e-bab0-2220819ba7ed" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1270.003409] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-9496f4d5-71fb-471e-bab0-2220819ba7ed" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1270.003606] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-9496f4d5-71fb-471e-bab0-2220819ba7ed" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1270.003606] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('9496f4d5-71fb-471e-bab0-2220819ba7ed',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1270.004235] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock rules-8d9c7efa-60b6-44af-830b-f32145b1b403 taken with stack trace [, , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1270.004318] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-8d9c7efa-60b6-44af-830b-f32145b1b403" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1270.004414] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-8d9c7efa-60b6-44af-830b-f32145b1b403" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1270.004526] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-8d9c7efa-60b6-44af-830b-f32145b1b403" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1270.004593] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('8d9c7efa-60b6-44af-830b-f32145b1b403',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1270.005243] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock rules-21a3b55c-64ce-4782-808a-31350166c184 taken with stack trace [, , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1270.005356] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-21a3b55c-64ce-4782-808a-31350166c184" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1270.005404] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-21a3b55c-64ce-4782-808a-31350166c184" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1270.005549] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-21a3b55c-64ce-4782-808a-31350166c184" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1270.005618] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('21a3b55c-64ce-4782-808a-31350166c184',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1270.006370] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock rules-1ba7c228-9a96-4f3b-9855-f84e883a5bfd taken with stack trace [, , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1270.006370] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-1ba7c228-9a96-4f3b-9855-f84e883a5bfd" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1270.006370] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-1ba7c228-9a96-4f3b-9855-f84e883a5bfd" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1270.006370] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-1ba7c228-9a96-4f3b-9855-f84e883a5bfd" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1270.006911] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('1ba7c228-9a96-4f3b-9855-f84e883a5bfd',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1270.007421] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock rules-fe248172-4be4-4d95-a8ca-c9c2ef203894 taken with stack trace [, , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1270.007487] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-fe248172-4be4-4d95-a8ca-c9c2ef203894" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1270.007526] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-fe248172-4be4-4d95-a8ca-c9c2ef203894" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1270.007687] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-fe248172-4be4-4d95-a8ca-c9c2ef203894" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1270.007746] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('fe248172-4be4-4d95-a8ca-c9c2ef203894',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1270.008537] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock rules-b7074d70-d8cb-411f-b8c4-a4007dfd74f8 taken with stack trace [, , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1270.008537] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-b7074d70-d8cb-411f-b8c4-a4007dfd74f8" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1270.008537] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-b7074d70-d8cb-411f-b8c4-a4007dfd74f8" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1270.008723] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-b7074d70-d8cb-411f-b8c4-a4007dfd74f8" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1270.008723] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('b7074d70-d8cb-411f-b8c4-a4007dfd74f8',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1270.009370] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock rules-5dd6e6d4-a4c3-43e1-a153-05b659cf62c9 taken with stack trace [, , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1270.009468] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-5dd6e6d4-a4c3-43e1-a153-05b659cf62c9" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1270.009531] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-5dd6e6d4-a4c3-43e1-a153-05b659cf62c9" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1270.010172] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-5dd6e6d4-a4c3-43e1-a153-05b659cf62c9" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1270.010172] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('5dd6e6d4-a4c3-43e1-a153-05b659cf62c9',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1270.010475] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock rules-9b250822-f6be-41a2-9506-9d3472c0c4ae taken with stack trace [, , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1270.011181] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-9b250822-f6be-41a2-9506-9d3472c0c4ae" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1270.011181] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-9b250822-f6be-41a2-9506-9d3472c0c4ae" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1270.011181] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-9b250822-f6be-41a2-9506-9d3472c0c4ae" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1270.011329] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('9b250822-f6be-41a2-9506-9d3472c0c4ae',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1270.011869] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock rules-154b7e30-9d22-43f4-84bb-7d8dd4d7cc9a taken with stack trace [, , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1270.011962] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-154b7e30-9d22-43f4-84bb-7d8dd4d7cc9a" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1270.012399] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-154b7e30-9d22-43f4-84bb-7d8dd4d7cc9a" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1270.012399] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-154b7e30-9d22-43f4-84bb-7d8dd4d7cc9a" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1270.012399] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('154b7e30-9d22-43f4-84bb-7d8dd4d7cc9a',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1270.012896] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock rules-f848ee13-2bde-41b3-b6a1-cf583163d5cd taken with stack trace [, , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1270.013440] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-f848ee13-2bde-41b3-b6a1-cf583163d5cd" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1270.013440] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-f848ee13-2bde-41b3-b6a1-cf583163d5cd" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1270.013440] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-f848ee13-2bde-41b3-b6a1-cf583163d5cd" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1270.013440] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('f848ee13-2bde-41b3-b6a1-cf583163d5cd',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1270.013957] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock rules-420136f3-91df-4669-b5e3-cee436aeacb9 taken with stack trace [, , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1270.014074] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-420136f3-91df-4669-b5e3-cee436aeacb9" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1270.014138] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-420136f3-91df-4669-b5e3-cee436aeacb9" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1270.014282] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-420136f3-91df-4669-b5e3-cee436aeacb9" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1270.014350] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('420136f3-91df-4669-b5e3-cee436aeacb9',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1270.014980] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock rules-237e1a89-daff-4fd5-b02a-97e1d536d9bd taken with stack trace [, , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1270.015090] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-237e1a89-daff-4fd5-b02a-97e1d536d9bd" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1270.015142] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-237e1a89-daff-4fd5-b02a-97e1d536d9bd" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1270.015289] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-237e1a89-daff-4fd5-b02a-97e1d536d9bd" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1270.015359] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('237e1a89-daff-4fd5-b02a-97e1d536d9bd',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1270.016187] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock rules-23fa7df4-0993-48e9-9080-1087f76da31c taken with stack trace [, , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1270.016187] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-23fa7df4-0993-48e9-9080-1087f76da31c" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1270.016406] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-23fa7df4-0993-48e9-9080-1087f76da31c" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1270.016406] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-23fa7df4-0993-48e9-9080-1087f76da31c" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1270.016406] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('23fa7df4-0993-48e9-9080-1087f76da31c',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1270.048791] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1270.049192] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1270.049192] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1270.049192] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1270.051158] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1270.051287] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1270.052051] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1270.052148] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1270.052851] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1270.052989] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1270.053526] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1270.053620] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1270.071193] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1270.071357] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 87bbb461-0dea-430b-adcd-ee0e3f4ed609 is going to be deleted. [ 1270.072224] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1270.072426] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1270.089793] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1270.089944] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: c26b8d0b-5a65-4082-8dff-404228d547c4 is going to be deleted. [ 1270.090905] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1270.091112] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1270.108205] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1270.108364] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 408a8a38-c326-4f43-84a2-818a13f7e124 is going to be deleted. [ 1270.109192] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1270.109392] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1270.127935] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1270.128132] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 14c6c739-bd84-4bc8-9d1c-9bc29741c32d is going to be deleted. [ 1270.129330] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1270.129555] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1270.132760] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1270.132951] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1270.149254] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1270.149525] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1270.158496] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1270.158664] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: eba16cc3-e8ee-4772-ba0d-2b7b582b7844 is going to be deleted. [ 1270.159560] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1270.159772] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1270.159865] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1270.159985] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-87bbb461-0dea-430b-adcd-ee0e3f4ed609" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1270.160814] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1270.160937] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1270.161018] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1270.161152] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1270.161314] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1270.161360] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-408a8a38-c326-4f43-84a2-818a13f7e124" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1270.161856] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1270.161856] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1270.161856] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1270.161856] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-c26b8d0b-5a65-4082-8dff-404228d547c4" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1270.195869] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1270.196171] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1270.196242] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1270.196441] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1270.196531] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1270.196649] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-14c6c739-bd84-4bc8-9d1c-9bc29741c32d" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1270.236078] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1270.236078] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1270.236078] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1270.236345] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1270.236499] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1270.236557] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-eba16cc3-e8ee-4772-ba0d-2b7b582b7844" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1270.523319] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock member-9b250822-f6be-41a2-9506-9d3472c0c4ae taken with stack trace [, , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1270.523542] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9b250822-f6be-41a2-9506-9d3472c0c4ae" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1270.523542] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9b250822-f6be-41a2-9506-9d3472c0c4ae" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1270.523679] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9b250822-f6be-41a2-9506-9d3472c0c4ae" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1270.523843] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1270.523945] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1270.524025] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1270.524178] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1270.524263] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1270.524350] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9b250822-f6be-41a2-9506-9d3472c0c4ae" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1270.524438] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('9b250822-f6be-41a2-9506-9d3472c0c4ae',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1270.527400] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock member-f848ee13-2bde-41b3-b6a1-cf583163d5cd taken with stack trace [, , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1270.527400] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f848ee13-2bde-41b3-b6a1-cf583163d5cd" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1270.527520] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f848ee13-2bde-41b3-b6a1-cf583163d5cd" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1270.527604] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f848ee13-2bde-41b3-b6a1-cf583163d5cd" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1270.527773] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1270.527916] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1270.527916] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1270.528080] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1270.528159] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1270.528244] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f848ee13-2bde-41b3-b6a1-cf583163d5cd" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1270.528321] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('f848ee13-2bde-41b3-b6a1-cf583163d5cd',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1270.532602] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock member-fe248172-4be4-4d95-a8ca-c9c2ef203894 taken with stack trace [, , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1270.532711] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fe248172-4be4-4d95-a8ca-c9c2ef203894" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1270.532780] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fe248172-4be4-4d95-a8ca-c9c2ef203894" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1270.532939] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fe248172-4be4-4d95-a8ca-c9c2ef203894" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1270.533096] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1270.533218] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1270.533260] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1270.533385] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1270.533462] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1270.533545] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fe248172-4be4-4d95-a8ca-c9c2ef203894" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1270.533624] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('fe248172-4be4-4d95-a8ca-c9c2ef203894',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1270.569894] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1270.570178] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1270.570178] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1270.570369] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1270.571997] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1270.572156] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1270.572758] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1270.572841] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1270.573520] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1270.573614] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1270.574397] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1270.574491] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1270.575255] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1270.575349] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1270.576101] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1270.576185] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1270.576838] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1270.576931] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1270.577575] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1270.577666] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1270.578665] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1270.578780] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1270.579444] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1270.579534] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1270.580135] env[65370]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1270.580532] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1270.580649] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1270.595984] env[65370]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1270.596529] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1270.596662] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 67f4a0c1-3a3c-4ed8-9358-3a9645aba154 is going to be deleted. [ 1270.597610] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1270.597727] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1270.616838] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1270.617041] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 21a3b55c-64ce-4782-808a-31350166c184 is going to be deleted. [ 1270.618185] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1270.618575] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1270.639184] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1270.639386] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 8d9c7efa-60b6-44af-830b-f32145b1b403 is going to be deleted. [ 1270.640195] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1270.640407] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1270.652720] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1270.652950] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1270.660117] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1270.660273] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 1ba7c228-9a96-4f3b-9855-f84e883a5bfd is going to be deleted. [ 1270.661224] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1270.661620] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1270.672049] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1270.672279] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1270.683165] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1270.683296] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 5dd6e6d4-a4c3-43e1-a153-05b659cf62c9 is going to be deleted. [ 1270.684656] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1270.684904] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1270.704703] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1270.704703] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1270.706823] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1270.706947] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 9496f4d5-71fb-471e-bab0-2220819ba7ed is going to be deleted. [ 1270.707857] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1270.708089] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1270.741732] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1270.741984] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: b7074d70-d8cb-411f-b8c4-a4007dfd74f8 is going to be deleted. [ 1270.743375] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1270.743705] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1270.766416] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1270.766622] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1270.883038] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1270.883223] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1270.903435] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1270.903555] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 420136f3-91df-4669-b5e3-cee436aeacb9 is going to be deleted. [ 1270.904551] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1270.905031] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1270.906505] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1270.906647] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1270.953472] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1270.953669] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: aa619879-3f9d-4aea-b1cb-1e5adfe92cfd is going to be deleted. [ 1270.954984] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1270.955476] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1270.984871] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1270.985084] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1270.993525] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1270.993860] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 237e1a89-daff-4fd5-b02a-97e1d536d9bd is going to be deleted. [ 1270.994878] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1270.995081] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1271.031074] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock member-9b250822-f6be-41a2-9506-9d3472c0c4ae taken with stack trace [, , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1271.031241] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9b250822-f6be-41a2-9506-9d3472c0c4ae" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1271.031282] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9b250822-f6be-41a2-9506-9d3472c0c4ae" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1271.031499] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9b250822-f6be-41a2-9506-9d3472c0c4ae" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1271.031675] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1271.031798] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1271.031863] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1271.032040] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1271.032128] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1271.032377] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9b250822-f6be-41a2-9506-9d3472c0c4ae" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1271.032377] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock member-9b250822-f6be-41a2-9506-9d3472c0c4ae taken with stack trace [, , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1271.032537] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9b250822-f6be-41a2-9506-9d3472c0c4ae" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1271.032573] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9b250822-f6be-41a2-9506-9d3472c0c4ae" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1271.032714] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9b250822-f6be-41a2-9506-9d3472c0c4ae" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1271.032882] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1271.032996] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1271.033072] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1271.033214] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1271.033292] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1271.033373] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9b250822-f6be-41a2-9506-9d3472c0c4ae" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1271.033460] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('9b250822-f6be-41a2-9506-9d3472c0c4ae',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1271.039246] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('fe248172-4be4-4d95-a8ca-c9c2ef203894',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1271.041485] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('f848ee13-2bde-41b3-b6a1-cf583163d5cd',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1271.062172] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1271.062316] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 23fa7df4-0993-48e9-9080-1087f76da31c is going to be deleted. [ 1271.063370] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1271.063630] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1271.090541] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1271.090722] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1271.100260] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1271.100260] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1271.106922] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1271.107110] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 154b7e30-9d22-43f4-84bb-7d8dd4d7cc9a is going to be deleted. [ 1271.108071] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1271.108313] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1271.108409] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1271.108956] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-67f4a0c1-3a3c-4ed8-9358-3a9645aba154" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1271.109193] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1271.109384] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1271.109470] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1271.109594] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-21a3b55c-64ce-4782-808a-31350166c184" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1271.110190] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1271.110415] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1271.110463] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1271.110579] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-8d9c7efa-60b6-44af-830b-f32145b1b403" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1271.110773] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1271.110899] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1271.111566] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1271.111566] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-1ba7c228-9a96-4f3b-9855-f84e883a5bfd" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1271.111566] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1271.111566] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1271.111566] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1271.111566] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-5dd6e6d4-a4c3-43e1-a153-05b659cf62c9" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1271.112069] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1271.112069] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1271.112069] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1271.112069] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-9496f4d5-71fb-471e-bab0-2220819ba7ed" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1271.112210] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1271.112320] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1271.112382] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1271.112488] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-b7074d70-d8cb-411f-b8c4-a4007dfd74f8" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1271.112611] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1271.112748] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1271.112823] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1271.112928] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-420136f3-91df-4669-b5e3-cee436aeacb9" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1271.113110] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1271.113254] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1271.113319] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1271.113427] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-aa619879-3f9d-4aea-b1cb-1e5adfe92cfd" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1271.191249] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1271.191404] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1271.191472] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1271.191737] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1271.191856] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1271.191979] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-237e1a89-daff-4fd5-b02a-97e1d536d9bd" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1271.325851] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1271.326126] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1271.326126] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1271.326299] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1271.326388] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1271.326507] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-23fa7df4-0993-48e9-9080-1087f76da31c" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1271.327299] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1271.327415] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1271.327483] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1271.327642] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1271.327723] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1271.327834] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-154b7e30-9d22-43f4-84bb-7d8dd4d7cc9a" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1271.537706] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 9b250822-f6be-41a2-9506-9d3472c0c4ae: rpc.has_security_group_logging(os_id): False [ 1271.540510] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for fe248172-4be4-4d95-a8ca-c9c2ef203894: rpc.has_security_group_logging(os_id): False [ 1271.542932] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for f848ee13-2bde-41b3-b6a1-cf583163d5cd: rpc.has_security_group_logging(os_id): False [ 1271.559557] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1271.559779] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1271.559779] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1271.559922] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1271.564161] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1271.564359] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1271.565130] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1271.565272] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1271.580633] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1271.580912] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1271.581052] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1271.581120] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1271.581328] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1271.581396] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1271.581649] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1271.581766] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1271.581828] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1271.581981] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1271.582069] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1271.582258] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1271.582332] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1271.582389] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1271.582544] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1271.582622] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1271.582742] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 9b250822-f6be-41a2-9506-9d3472c0c4ae is going to be updated. [ 1271.583872] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1271.584051] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1271.604243] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1271.604541] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1271.604638] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1271.604707] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1271.604895] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1271.604977] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1271.605075] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: fe248172-4be4-4d95-a8ca-c9c2ef203894 is going to be updated. [ 1271.606189] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1271.606365] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1271.624809] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1271.625171] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1271.625319] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1271.625408] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1271.625636] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1271.625737] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1271.625844] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: f848ee13-2bde-41b3-b6a1-cf583163d5cd is going to be updated. [ 1271.678743] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1271.678992] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1271.678992] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1271.679227] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1271.679421] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1271.694822] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1271.695052] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1271.695052] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1271.695379] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1271.695554] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1271.700851] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1271.701103] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1271.701103] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1271.701258] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1271.701404] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1271.708209] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 9b250822-f6be-41a2-9506-9d3472c0c4ae in Status: IN_PROGRESS for 2s [ 1271.719044] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: fe248172-4be4-4d95-a8ca-c9c2ef203894 in Status: IN_PROGRESS for 2s [ 1271.726383] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: f848ee13-2bde-41b3-b6a1-cf583163d5cd in Status: IN_PROGRESS for 2s [ 1272.213879] env[65370]: INFO networking_nsxv3.common.synchronization [req-b13d3ace-4226-4aea-88bf-e864c83ce719 req-a5d5a9ab-39aa-442d-b73f-4d10f2b495d9 tempest-ServerRescueTestJSON-711577094 tempest-ServerRescueTestJSON-711577094-project-member] Enqueued Resource ID: 9b250822-f6be-41a2-9506-9d3472c0c4ae with Priority: HIGHEST for action security_group_members [ 1272.214420] env[65370]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9b250822-f6be-41a2-9506-9d3472c0c4ae with Priority: HIGHEST for action security_group_members [ 1272.214769] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock member-9b250822-f6be-41a2-9506-9d3472c0c4ae taken with stack trace [, , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1272.214845] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9b250822-f6be-41a2-9506-9d3472c0c4ae" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1272.214995] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9b250822-f6be-41a2-9506-9d3472c0c4ae" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1272.215130] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9b250822-f6be-41a2-9506-9d3472c0c4ae" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1272.215270] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1272.215363] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1272.215445] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1272.215564] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1272.215647] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1272.215735] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9b250822-f6be-41a2-9506-9d3472c0c4ae',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1272.718998] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('9b250822-f6be-41a2-9506-9d3472c0c4ae',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1273.221046] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('9b250822-f6be-41a2-9506-9d3472c0c4ae',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1273.723834] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 9b250822-f6be-41a2-9506-9d3472c0c4ae in Status: SUCCESS [ 1273.724107] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-9b250822-f6be-41a2-9506-9d3472c0c4ae" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1273.724440] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1273.724602] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1273.724709] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1273.724863] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1273.724966] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1273.724966] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9b250822-f6be-41a2-9506-9d3472c0c4ae is going to be updated. [ 1273.733760] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: fe248172-4be4-4d95-a8ca-c9c2ef203894 in Status: SUCCESS [ 1273.733992] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-fe248172-4be4-4d95-a8ca-c9c2ef203894" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1273.739843] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: f848ee13-2bde-41b3-b6a1-cf583163d5cd in Status: SUCCESS [ 1273.740051] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-f848ee13-2bde-41b3-b6a1-cf583163d5cd" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1273.754145] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1273.754294] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1273.754362] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1273.754569] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1273.754738] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1273.763714] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9b250822-f6be-41a2-9506-9d3472c0c4ae in Status: IN_PROGRESS for 2s [ 1275.775495] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9b250822-f6be-41a2-9506-9d3472c0c4ae in Status: SUCCESS [ 1275.775893] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9b250822-f6be-41a2-9506-9d3472c0c4ae" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1277.215421] env[65370]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1277.215854] env[65370]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1277.282032] env[65370]: INFO networking_nsxv3.common.synchronization [req-c902d932-cc1f-45ec-bbf0-e647aef518c1 req-f057a7fa-b73b-47f5-adf4-4415dfa8bc8d tempest-AttachVolumeTestJSON-1795434373 tempest-AttachVolumeTestJSON-1795434373-project-member] Enqueued Resource ID: f848ee13-2bde-41b3-b6a1-cf583163d5cd with Priority: HIGHEST for action security_group_members [ 1277.282709] env[65370]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f848ee13-2bde-41b3-b6a1-cf583163d5cd with Priority: HIGHEST for action security_group_members [ 1277.282793] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock member-f848ee13-2bde-41b3-b6a1-cf583163d5cd taken with stack trace [, , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1277.282915] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f848ee13-2bde-41b3-b6a1-cf583163d5cd" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1277.282977] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f848ee13-2bde-41b3-b6a1-cf583163d5cd" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1277.283183] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f848ee13-2bde-41b3-b6a1-cf583163d5cd" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1277.283330] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1277.283425] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1277.283484] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1277.283658] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1277.283954] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1277.284039] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f848ee13-2bde-41b3-b6a1-cf583163d5cd',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1277.787829] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1277.787829] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1277.787829] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1277.787829] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1277.787829] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1277.787829] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1277.787829] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1277.788299] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1277.788299] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1277.788299] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1277.788299] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f848ee13-2bde-41b3-b6a1-cf583163d5cd is going to be updated. [ 1277.818587] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1277.818878] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1277.818878] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1277.819204] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1277.819422] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1277.828198] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f848ee13-2bde-41b3-b6a1-cf583163d5cd in Status: IN_PROGRESS for 2s [ 1278.792969] env[65370]: INFO networking_nsxv3.common.synchronization [req-31116608-738e-4501-9456-76bbcc2deaf3 req-e1948928-9e0b-4e5b-85ab-58e1f4cc5199 tempest-ServerRescueTestJSON-711577094 tempest-ServerRescueTestJSON-711577094-project-member] Enqueued Resource ID: 9b250822-f6be-41a2-9506-9d3472c0c4ae with Priority: HIGHEST for action security_group_members [ 1278.793541] env[65370]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9b250822-f6be-41a2-9506-9d3472c0c4ae with Priority: HIGHEST for action security_group_members [ 1278.794355] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock member-9b250822-f6be-41a2-9506-9d3472c0c4ae taken with stack trace [, , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1278.794477] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9b250822-f6be-41a2-9506-9d3472c0c4ae" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1278.794546] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9b250822-f6be-41a2-9506-9d3472c0c4ae" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1278.794749] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9b250822-f6be-41a2-9506-9d3472c0c4ae" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1278.794908] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1278.795017] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1278.795070] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1278.795220] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1278.795303] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1278.795397] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9b250822-f6be-41a2-9506-9d3472c0c4ae',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1279.297996] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1279.298192] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1279.298262] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1279.298512] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1279.298624] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1279.298842] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1279.298947] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1279.299022] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1279.299199] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1279.299299] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1279.299394] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9b250822-f6be-41a2-9506-9d3472c0c4ae is going to be updated. [ 1279.328382] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1279.328540] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1279.328607] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1279.328821] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1279.328974] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1279.338683] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9b250822-f6be-41a2-9506-9d3472c0c4ae in Status: IN_PROGRESS for 2s [ 1279.841974] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f848ee13-2bde-41b3-b6a1-cf583163d5cd in Status: SUCCESS [ 1279.841974] env[65370]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f848ee13-2bde-41b3-b6a1-cf583163d5cd deletion is rescheduled due to dependency. [ 1279.841974] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f848ee13-2bde-41b3-b6a1-cf583163d5cd" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1281.358385] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9b250822-f6be-41a2-9506-9d3472c0c4ae in Status: SUCCESS [ 1281.358765] env[65370]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9b250822-f6be-41a2-9506-9d3472c0c4ae deletion is rescheduled due to dependency. [ 1281.358765] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9b250822-f6be-41a2-9506-9d3472c0c4ae" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1283.795052] env[65370]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1283.795480] env[65370]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1286.821534] env[65370]: INFO networking_nsxv3.common.synchronization [None req-5a968a5c-b071-4b9b-a0a9-9847bd82d6f1 None None] Enqueued Resource ID: 726ac04a-cbe0-45fb-8bcf-78c0f65db602 with Priority: HIGHEST for action port [ 1286.822210] env[65370]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 726ac04a-cbe0-45fb-8bcf-78c0f65db602 with Priority: HIGHEST for action port [ 1286.822916] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock port-726ac04a-cbe0-45fb-8bcf-78c0f65db602 taken with stack trace [, , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1286.822916] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-726ac04a-cbe0-45fb-8bcf-78c0f65db602" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1286.822916] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-726ac04a-cbe0-45fb-8bcf-78c0f65db602" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1286.823164] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-726ac04a-cbe0-45fb-8bcf-78c0f65db602" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1286.823164] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('726ac04a-cbe0-45fb-8bcf-78c0f65db602',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1287.325372] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 726ac04a-cbe0-45fb-8bcf-78c0f65db602 [ 1287.325597] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1287.325733] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1287.325794] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1287.326015] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1287.326107] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1287.326203] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:726ac04a-cbe0-45fb-8bcf-78c0f65db602 already deleted. [ 1287.326287] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-726ac04a-cbe0-45fb-8bcf-78c0f65db602" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1289.059337] env[65370]: INFO networking_nsxv3.common.synchronization [None req-a7babba6-5dfc-42e2-916f-6ba4209c1472 None None] Enqueued Resource ID: e803868a-bc37-4800-add7-cf2e75019f74 with Priority: HIGHEST for action port [ 1289.059337] env[65370]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e803868a-bc37-4800-add7-cf2e75019f74 with Priority: HIGHEST for action port [ 1289.059337] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock port-e803868a-bc37-4800-add7-cf2e75019f74 taken with stack trace [, , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1289.059337] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-e803868a-bc37-4800-add7-cf2e75019f74" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1289.059337] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-e803868a-bc37-4800-add7-cf2e75019f74" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1289.059337] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-e803868a-bc37-4800-add7-cf2e75019f74" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1289.059337] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e803868a-bc37-4800-add7-cf2e75019f74',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1289.561447] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port e803868a-bc37-4800-add7-cf2e75019f74 [ 1289.561702] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1289.561828] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1289.561884] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1289.562286] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1289.562286] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1289.562428] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:e803868a-bc37-4800-add7-cf2e75019f74 already deleted. [ 1289.562489] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-e803868a-bc37-4800-add7-cf2e75019f74" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1292.067350] env[65370]: INFO networking_nsxv3.common.synchronization [req-9cd17e86-c1a1-42c0-b73f-376af59e4782 req-b3f3d945-2649-4752-8527-ec6aaef5b655 tempest-ServersTestJSON-2095698355 tempest-ServersTestJSON-2095698355-project-member] Enqueued Resource ID: f7eb5b75-281d-41af-870c-257f422c5a89 with Priority: HIGHEST for action security_group_members [ 1292.067860] env[65370]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f7eb5b75-281d-41af-870c-257f422c5a89 with Priority: HIGHEST for action security_group_members [ 1292.068178] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock member-f7eb5b75-281d-41af-870c-257f422c5a89 taken with stack trace [, , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1292.068295] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f7eb5b75-281d-41af-870c-257f422c5a89" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1292.068372] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f7eb5b75-281d-41af-870c-257f422c5a89" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1292.068995] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f7eb5b75-281d-41af-870c-257f422c5a89" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1292.068995] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1292.068995] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1292.068995] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1292.069309] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1292.069309] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1292.069309] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f7eb5b75-281d-41af-870c-257f422c5a89',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1292.323249] env[65370]: DEBUG networking_nsxv3.common.locking [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Lock network-353 taken with stack trace [, , , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1292.323871] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquiring lock "network-353" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1292.323871] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquired lock "network-353" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1292.323871] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquired external semaphore "network-353" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1292.324543] env[65370]: DEBUG networking_nsxv3.common.locking [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1292.325038] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquiring lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1292.325038] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquired lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1292.325309] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquired external semaphore "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1292.325541] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Releasing lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1292.325784] env[65370]: DEBUG dogpile.cache.region [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] No value present for key: 'zone-id' {{(pid=65370) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1292.325899] env[65370]: DEBUG dogpile.lock [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] NeedRegenerationException {{(pid=65370) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1292.326016] env[65370]: DEBUG dogpile.lock [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] no value, waiting for create lock {{(pid=65370) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1292.326128] env[65370]: DEBUG dogpile.lock [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] value creation lock acquired {{(pid=65370) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1292.326236] env[65370]: DEBUG dogpile.cache.region [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] No value present for key: 'zone-id' {{(pid=65370) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1292.326338] env[65370]: DEBUG dogpile.lock [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Calling creation function for not-yet-present value {{(pid=65370) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1292.326465] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1292.349044] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1292.349247] env[65370]: DEBUG dogpile.cache.region [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=65370) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1292.349363] env[65370]: DEBUG dogpile.lock [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Released creation lock {{(pid=65370) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1292.349538] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Releasing lock "network-353" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1292.349848] env[65370]: DEBUG networking_nsxv3.common.locking [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Lock port-d5546950-7feb-46d4-a41d-e082a053ccd1 taken with stack trace [, , , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1292.350031] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquiring lock "port-d5546950-7feb-46d4-a41d-e082a053ccd1" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1292.350148] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquired lock "port-d5546950-7feb-46d4-a41d-e082a053ccd1" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1292.350486] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquired external semaphore "port-d5546950-7feb-46d4-a41d-e082a053ccd1" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1292.350607] env[65370]: DEBUG networking_nsxv3.api.rpc [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d5546950-7feb-46d4-a41d-e082a053ccd1',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1292.571075] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1292.571254] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1292.571326] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1292.571549] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1292.571659] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1292.571844] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1292.571968] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1292.572038] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1292.572190] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1292.572263] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1292.572350] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f7eb5b75-281d-41af-870c-257f422c5a89 already deleted. [ 1292.572425] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f7eb5b75-281d-41af-870c-257f422c5a89" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1292.853135] env[65370]: DEBUG networking_nsxv3.common.locking [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1292.854092] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquiring lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1292.854092] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquired lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1292.854996] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquired external semaphore "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1292.855446] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Releasing lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1292.856593] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Segment Port d5546950-7feb-46d4-a41d-e082a053ccd1 not found, creating... [ 1292.856982] env[65370]: DEBUG networking_nsxv3.common.locking [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1292.857099] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquiring lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1292.857242] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquired lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1292.857820] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquired external semaphore "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1292.858134] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Releasing lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1292.858499] env[65370]: DEBUG networking_nsxv3.common.locking [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1292.858697] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquiring lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1292.858819] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquired lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1292.859464] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquired external semaphore "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1292.859464] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Releasing lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1292.859631] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Resource: SegmentPort with ID: d5546950-7feb-46d4-a41d-e082a053ccd1 is going to be created. [ 1292.880662] env[65370]: DEBUG networking_nsxv3.common.locking [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1292.881072] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquiring lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1292.881311] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquired lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1292.881657] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquired external semaphore "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1292.882018] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Releasing lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1292.882724] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Releasing lock "port-d5546950-7feb-46d4-a41d-e082a053ccd1" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1293.651759] env[65370]: INFO networking_nsxv3.common.synchronization [req-9cd17e86-c1a1-42c0-b73f-376af59e4782 req-03cef7f1-3f2e-4cbd-ac79-5de713ad2931 service nova] Enqueued Resource ID: f7eb5b75-281d-41af-870c-257f422c5a89 with Priority: HIGHEST for action security_group_rules [ 1293.652054] env[65370]: INFO networking_nsxv3.common.synchronization [req-9cd17e86-c1a1-42c0-b73f-376af59e4782 req-03cef7f1-3f2e-4cbd-ac79-5de713ad2931 service nova] Enqueued Resource ID: f7eb5b75-281d-41af-870c-257f422c5a89 with Priority: HIGHEST for action security_group_members [ 1293.652093] env[65370]: INFO networking_nsxv3.common.synchronization [req-9cd17e86-c1a1-42c0-b73f-376af59e4782 req-03cef7f1-3f2e-4cbd-ac79-5de713ad2931 service nova] Enqueued Resource ID: d5546950-7feb-46d4-a41d-e082a053ccd1 with Priority: HIGHEST for action port [ 1293.652572] env[65370]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f7eb5b75-281d-41af-870c-257f422c5a89 with Priority: HIGHEST for action security_group_rules [ 1293.652707] env[65370]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f7eb5b75-281d-41af-870c-257f422c5a89 with Priority: HIGHEST for action security_group_members [ 1293.652800] env[65370]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d5546950-7feb-46d4-a41d-e082a053ccd1 with Priority: HIGHEST for action port [ 1293.659030] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock rules-f7eb5b75-281d-41af-870c-257f422c5a89 taken with stack trace [, , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1293.659030] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-f7eb5b75-281d-41af-870c-257f422c5a89" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1293.659030] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-f7eb5b75-281d-41af-870c-257f422c5a89" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1293.660188] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-f7eb5b75-281d-41af-870c-257f422c5a89" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1293.660188] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('f7eb5b75-281d-41af-870c-257f422c5a89',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1293.660682] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock member-f7eb5b75-281d-41af-870c-257f422c5a89 taken with stack trace [, , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1293.660803] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f7eb5b75-281d-41af-870c-257f422c5a89" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1293.660894] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f7eb5b75-281d-41af-870c-257f422c5a89" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1293.661147] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f7eb5b75-281d-41af-870c-257f422c5a89" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1293.661388] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1293.661503] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1293.661503] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1293.661654] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1293.661654] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1293.661819] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f7eb5b75-281d-41af-870c-257f422c5a89',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1293.663278] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock port-d5546950-7feb-46d4-a41d-e082a053ccd1 taken with stack trace [, , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1293.663278] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-d5546950-7feb-46d4-a41d-e082a053ccd1" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1293.663278] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-d5546950-7feb-46d4-a41d-e082a053ccd1" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1293.663278] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-d5546950-7feb-46d4-a41d-e082a053ccd1" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1293.663278] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d5546950-7feb-46d4-a41d-e082a053ccd1',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1294.164904] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock member-f7eb5b75-281d-41af-870c-257f422c5a89 taken with stack trace [, , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1294.165058] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f7eb5b75-281d-41af-870c-257f422c5a89" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1294.165285] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('f7eb5b75-281d-41af-870c-257f422c5a89',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1294.168727] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port d5546950-7feb-46d4-a41d-e082a053ccd1 with status ACTIVE [ 1294.169206] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1294.169372] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1294.169465] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1294.169688] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1294.169803] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1294.169993] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1294.170106] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1294.170188] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1294.170343] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1294.170434] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1294.170612] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1294.170703] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1294.170757] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1294.170936] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1294.171020] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1294.171099] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: d5546950-7feb-46d4-a41d-e082a053ccd1 is going to be updated. [ 1294.190699] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1294.190904] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1294.190955] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1294.191173] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1294.191309] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1294.191463] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-d5546950-7feb-46d4-a41d-e082a053ccd1" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1294.667450] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('f7eb5b75-281d-41af-870c-257f422c5a89',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1295.169567] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1295.169769] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1295.169769] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1295.169990] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1295.170321] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1295.170321] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f7eb5b75-281d-41af-870c-257f422c5a89 is going to be created. [ 1295.194088] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1295.194364] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1295.194364] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1295.194607] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1295.194771] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1295.205634] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f7eb5b75-281d-41af-870c-257f422c5a89 in Status: UNINITIALIZED for 2s [ 1297.215932] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f7eb5b75-281d-41af-870c-257f422c5a89 in Status: SUCCESS [ 1297.216324] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f7eb5b75-281d-41af-870c-257f422c5a89" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1297.216324] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f7eb5b75-281d-41af-870c-257f422c5a89" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1297.216528] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f7eb5b75-281d-41af-870c-257f422c5a89" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1297.216763] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1297.216888] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1297.216954] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1297.217140] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1297.217220] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1297.217302] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f7eb5b75-281d-41af-870c-257f422c5a89" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1297.217389] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('f7eb5b75-281d-41af-870c-257f422c5a89',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1297.719413] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock member-f7eb5b75-281d-41af-870c-257f422c5a89 taken with stack trace [, , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1297.719599] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f7eb5b75-281d-41af-870c-257f422c5a89" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1297.719707] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f7eb5b75-281d-41af-870c-257f422c5a89" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1297.719966] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f7eb5b75-281d-41af-870c-257f422c5a89" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1297.720198] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1297.720337] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1297.720432] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1297.720586] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1297.720704] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1297.720812] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f7eb5b75-281d-41af-870c-257f422c5a89" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1297.721045] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock member-f7eb5b75-281d-41af-870c-257f422c5a89 taken with stack trace [, , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1297.721145] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f7eb5b75-281d-41af-870c-257f422c5a89" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1297.721197] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f7eb5b75-281d-41af-870c-257f422c5a89" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1297.721319] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f7eb5b75-281d-41af-870c-257f422c5a89" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1297.721458] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1297.721552] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1297.721616] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1297.721731] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1297.721805] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1297.721884] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f7eb5b75-281d-41af-870c-257f422c5a89" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1297.721992] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('f7eb5b75-281d-41af-870c-257f422c5a89',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1298.223968] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for f7eb5b75-281d-41af-870c-257f422c5a89: rpc.has_security_group_logging(os_id): False [ 1298.241790] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1298.242011] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1298.242011] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1298.242248] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1298.242337] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1298.242560] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1298.242662] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1298.242723] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1298.242872] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1298.242949] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1298.243136] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1298.243269] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1298.243333] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1298.243443] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1298.243527] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1298.243683] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1298.243774] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1298.243828] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1298.243955] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1298.244039] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1298.244147] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: f7eb5b75-281d-41af-870c-257f422c5a89 is going to be created. [ 1298.314045] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1298.314281] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1298.314281] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1298.314398] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1298.314576] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1298.327836] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: f7eb5b75-281d-41af-870c-257f422c5a89 in Status: IN_PROGRESS for 2s [ 1298.653565] env[65370]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1298.653763] env[65370]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=1 [ 1299.314182] env[65370]: DEBUG networking_nsxv3.common.locking [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Lock network-745 taken with stack trace [, , , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1299.314510] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquiring lock "network-745" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1299.314510] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquired lock "network-745" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1299.314778] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquired external semaphore "network-745" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1299.315045] env[65370]: DEBUG networking_nsxv3.common.locking [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1299.315212] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquiring lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1299.315321] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquired lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1299.315520] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquired external semaphore "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1299.315657] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Releasing lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1299.315856] env[65370]: DEBUG dogpile.cache.region [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] No value present for key: 'zone-id' {{(pid=65370) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1299.315964] env[65370]: DEBUG dogpile.lock [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] NeedRegenerationException {{(pid=65370) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1299.316080] env[65370]: DEBUG dogpile.lock [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] no value, waiting for create lock {{(pid=65370) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1299.316185] env[65370]: DEBUG dogpile.lock [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] value creation lock acquired {{(pid=65370) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1299.316289] env[65370]: DEBUG dogpile.cache.region [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] No value present for key: 'zone-id' {{(pid=65370) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1299.316388] env[65370]: DEBUG dogpile.lock [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Calling creation function for not-yet-present value {{(pid=65370) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1299.316535] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1299.334019] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1299.334167] env[65370]: DEBUG dogpile.cache.region [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Cache value generated in 0.018 seconds for key(s): 'zone-id' {{(pid=65370) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1299.334341] env[65370]: DEBUG dogpile.lock [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Released creation lock {{(pid=65370) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1299.334469] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Releasing lock "network-745" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1299.334760] env[65370]: DEBUG networking_nsxv3.common.locking [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Lock port-bda06847-f669-4ad5-80e8-361096347174 taken with stack trace [, , , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1299.334922] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquiring lock "port-bda06847-f669-4ad5-80e8-361096347174" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1299.335056] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquired lock "port-bda06847-f669-4ad5-80e8-361096347174" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1299.335313] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquired external semaphore "port-bda06847-f669-4ad5-80e8-361096347174" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1299.335447] env[65370]: DEBUG networking_nsxv3.api.rpc [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('bda06847-f669-4ad5-80e8-361096347174',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1299.838801] env[65370]: DEBUG networking_nsxv3.common.locking [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1299.838801] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquiring lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1299.838801] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquired lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1299.838801] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquired external semaphore "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1299.839185] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Releasing lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1299.839185] env[65370]: DEBUG networking_nsxv3.common.locking [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1299.839351] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquiring lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1299.839495] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquired lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1299.839714] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquired external semaphore "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1299.839845] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Releasing lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1299.840186] env[65370]: DEBUG networking_nsxv3.common.locking [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1299.840384] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquiring lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1299.840524] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquired lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1299.840753] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquired external semaphore "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1299.840888] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Releasing lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1299.841309] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Resource: SegmentPort with ID: bda06847-f669-4ad5-80e8-361096347174 is going to be updated. [ 1299.863707] env[65370]: DEBUG networking_nsxv3.common.locking [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1299.863946] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquiring lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1299.864066] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquired lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1299.864350] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquired external semaphore "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1299.864605] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Releasing lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1299.864857] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Releasing lock "port-bda06847-f669-4ad5-80e8-361096347174" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1300.340020] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: f7eb5b75-281d-41af-870c-257f422c5a89 in Status: SUCCESS [ 1300.340379] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-f7eb5b75-281d-41af-870c-257f422c5a89" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1300.543941] env[65370]: INFO networking_nsxv3.common.synchronization [req-2bb2e20e-0f62-4cea-90e7-7c6d29ca4e98 req-79da089e-f7fd-4885-a819-6d2109cc5fb3 service nova] Enqueued Resource ID: d40b0ebb-5855-4234-b52c-c2003a5df171 with Priority: HIGHEST for action security_group_rules [ 1300.544166] env[65370]: INFO networking_nsxv3.common.synchronization [req-2bb2e20e-0f62-4cea-90e7-7c6d29ca4e98 req-79da089e-f7fd-4885-a819-6d2109cc5fb3 service nova] Enqueued Resource ID: d40b0ebb-5855-4234-b52c-c2003a5df171 with Priority: HIGHEST for action security_group_members [ 1300.544263] env[65370]: INFO networking_nsxv3.common.synchronization [req-2bb2e20e-0f62-4cea-90e7-7c6d29ca4e98 req-79da089e-f7fd-4885-a819-6d2109cc5fb3 service nova] Enqueued Resource ID: bda06847-f669-4ad5-80e8-361096347174 with Priority: HIGHEST for action port [ 1300.544487] env[65370]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d40b0ebb-5855-4234-b52c-c2003a5df171 with Priority: HIGHEST for action security_group_rules [ 1300.544643] env[65370]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d40b0ebb-5855-4234-b52c-c2003a5df171 with Priority: HIGHEST for action security_group_members [ 1300.544702] env[65370]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bda06847-f669-4ad5-80e8-361096347174 with Priority: HIGHEST for action port [ 1300.545314] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d40b0ebb-5855-4234-b52c-c2003a5df171 taken with stack trace [, , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1300.545482] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d40b0ebb-5855-4234-b52c-c2003a5df171" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1300.545581] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d40b0ebb-5855-4234-b52c-c2003a5df171" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1300.545830] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d40b0ebb-5855-4234-b52c-c2003a5df171" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1300.545939] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d40b0ebb-5855-4234-b52c-c2003a5df171',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1300.546796] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock member-d40b0ebb-5855-4234-b52c-c2003a5df171 taken with stack trace [, , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1300.546948] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d40b0ebb-5855-4234-b52c-c2003a5df171" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1300.547054] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d40b0ebb-5855-4234-b52c-c2003a5df171" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1300.547248] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d40b0ebb-5855-4234-b52c-c2003a5df171" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1300.547448] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1300.547575] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1300.547658] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1300.547826] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1300.547937] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1300.548061] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d40b0ebb-5855-4234-b52c-c2003a5df171',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1300.548895] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock port-bda06847-f669-4ad5-80e8-361096347174 taken with stack trace [, , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1300.549065] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-bda06847-f669-4ad5-80e8-361096347174" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1300.549166] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-bda06847-f669-4ad5-80e8-361096347174" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1300.549343] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-bda06847-f669-4ad5-80e8-361096347174" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1300.549444] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('bda06847-f669-4ad5-80e8-361096347174',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1301.051543] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('d40b0ebb-5855-4234-b52c-c2003a5df171',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1301.052683] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock member-d40b0ebb-5855-4234-b52c-c2003a5df171 taken with stack trace [, , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1301.052792] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d40b0ebb-5855-4234-b52c-c2003a5df171" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1301.052988] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port bda06847-f669-4ad5-80e8-361096347174 with status ACTIVE [ 1301.053148] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1301.053302] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1301.053378] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1301.053602] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1301.053692] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1301.053866] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1301.053967] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1301.054043] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1301.054194] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1301.054269] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1301.054470] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1301.054568] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1301.054628] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1301.054892] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1301.055052] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1301.055157] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: bda06847-f669-4ad5-80e8-361096347174 is going to be updated. [ 1301.077195] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1301.077417] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1301.077417] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1301.077626] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1301.077872] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1301.077964] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-bda06847-f669-4ad5-80e8-361096347174" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1301.557920] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('d40b0ebb-5855-4234-b52c-c2003a5df171',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1302.060858] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1302.061095] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1302.061191] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1302.061393] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1302.061495] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1302.061595] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d40b0ebb-5855-4234-b52c-c2003a5df171 is going to be updated. [ 1302.095568] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1302.095786] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1302.095837] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1302.096043] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1302.096198] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1302.105104] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d40b0ebb-5855-4234-b52c-c2003a5df171 in Status: IN_PROGRESS for 2s [ 1304.116087] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d40b0ebb-5855-4234-b52c-c2003a5df171 in Status: SUCCESS [ 1304.116087] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d40b0ebb-5855-4234-b52c-c2003a5df171" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1304.116087] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d40b0ebb-5855-4234-b52c-c2003a5df171" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1304.116087] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d40b0ebb-5855-4234-b52c-c2003a5df171" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1304.116087] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1304.116773] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1304.116773] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1304.116773] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1304.116773] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1304.116773] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d40b0ebb-5855-4234-b52c-c2003a5df171" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1304.116773] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('d40b0ebb-5855-4234-b52c-c2003a5df171',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1304.619518] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('d40b0ebb-5855-4234-b52c-c2003a5df171',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1305.122053] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for d40b0ebb-5855-4234-b52c-c2003a5df171: rpc.has_security_group_logging(os_id): False [ 1305.141364] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1305.141576] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1305.141576] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1305.141926] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1305.163637] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1305.164049] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1305.164210] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1305.164276] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1305.164439] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1305.164524] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1305.164616] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d40b0ebb-5855-4234-b52c-c2003a5df171 is going to be updated. [ 1305.223967] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1305.224238] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1305.224238] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1305.224409] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1305.224913] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1305.240023] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d40b0ebb-5855-4234-b52c-c2003a5df171 in Status: IN_PROGRESS for 2s [ 1305.546053] env[65370]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1305.546190] env[65370]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=1 [ 1307.254847] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d40b0ebb-5855-4234-b52c-c2003a5df171 in Status: SUCCESS [ 1307.255256] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d40b0ebb-5855-4234-b52c-c2003a5df171" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1307.476577] env[65370]: INFO networking_nsxv3.common.synchronization [req-66d219ee-7874-4998-a6e3-1a75cfbe53e8 req-445c9163-6589-46e6-be80-13adc0565373 tempest-ServersTestJSON-2095698355 tempest-ServersTestJSON-2095698355-project-member] Enqueued Resource ID: f7eb5b75-281d-41af-870c-257f422c5a89 with Priority: HIGHEST for action security_group_members [ 1307.477355] env[65370]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f7eb5b75-281d-41af-870c-257f422c5a89 with Priority: HIGHEST for action security_group_members [ 1307.477757] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock member-f7eb5b75-281d-41af-870c-257f422c5a89 taken with stack trace [, , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1307.477931] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f7eb5b75-281d-41af-870c-257f422c5a89" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1307.478032] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f7eb5b75-281d-41af-870c-257f422c5a89" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1307.478285] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f7eb5b75-281d-41af-870c-257f422c5a89" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1307.478490] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1307.478619] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1307.478863] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1307.479088] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1307.479216] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1307.479339] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f7eb5b75-281d-41af-870c-257f422c5a89',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1307.796212] env[65370]: DEBUG networking_nsxv3.common.locking [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Lock network-353 taken with stack trace [, , , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1307.796451] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquiring lock "network-353" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1307.796579] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquired lock "network-353" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1307.796846] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquired external semaphore "network-353" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1307.797115] env[65370]: DEBUG networking_nsxv3.common.locking [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1307.797330] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquiring lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1307.797480] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquired lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1307.797694] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquired external semaphore "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1307.797838] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Releasing lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1307.798068] env[65370]: DEBUG dogpile.cache.region [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] No value present for key: 'zone-id' {{(pid=65370) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1307.798189] env[65370]: DEBUG dogpile.lock [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] NeedRegenerationException {{(pid=65370) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1307.798292] env[65370]: DEBUG dogpile.lock [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] no value, waiting for create lock {{(pid=65370) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1307.798395] env[65370]: DEBUG dogpile.lock [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] value creation lock acquired {{(pid=65370) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1307.798497] env[65370]: DEBUG dogpile.cache.region [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] No value present for key: 'zone-id' {{(pid=65370) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1307.798597] env[65370]: DEBUG dogpile.lock [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Calling creation function for not-yet-present value {{(pid=65370) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1307.798739] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1307.818339] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1307.818513] env[65370]: DEBUG dogpile.cache.region [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=65370) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1307.818647] env[65370]: DEBUG dogpile.lock [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Released creation lock {{(pid=65370) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1307.818822] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Releasing lock "network-353" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1307.819296] env[65370]: DEBUG networking_nsxv3.common.locking [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Lock port-22b8943b-56e0-4aa1-a28f-bf3c8ac33c5c taken with stack trace [, , , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1307.819436] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquiring lock "port-22b8943b-56e0-4aa1-a28f-bf3c8ac33c5c" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1307.819559] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquired lock "port-22b8943b-56e0-4aa1-a28f-bf3c8ac33c5c" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1307.819897] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquired external semaphore "port-22b8943b-56e0-4aa1-a28f-bf3c8ac33c5c" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1307.820044] env[65370]: DEBUG networking_nsxv3.api.rpc [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('22b8943b-56e0-4aa1-a28f-bf3c8ac33c5c',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1307.981658] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('f7eb5b75-281d-41af-870c-257f422c5a89',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1308.322065] env[65370]: DEBUG networking_nsxv3.common.locking [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1308.322433] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquiring lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1308.322478] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquired lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1308.322736] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquired external semaphore "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1308.322872] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Releasing lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1308.323067] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Segment Port 22b8943b-56e0-4aa1-a28f-bf3c8ac33c5c not found, creating... [ 1308.323297] env[65370]: DEBUG networking_nsxv3.common.locking [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1308.323431] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquiring lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1308.323547] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquired lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1308.323761] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquired external semaphore "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1308.323891] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Releasing lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1308.324175] env[65370]: DEBUG networking_nsxv3.common.locking [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1308.324325] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquiring lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1308.324435] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquired lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1308.324633] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquired external semaphore "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1308.324758] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Releasing lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1308.324885] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Resource: SegmentPort with ID: 22b8943b-56e0-4aa1-a28f-bf3c8ac33c5c is going to be created. [ 1308.344021] env[65370]: DEBUG networking_nsxv3.common.locking [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1308.344242] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquiring lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1308.344362] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquired lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1308.344660] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquired external semaphore "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1308.344900] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Releasing lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1308.345129] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Releasing lock "port-22b8943b-56e0-4aa1-a28f-bf3c8ac33c5c" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1308.484383] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('f7eb5b75-281d-41af-870c-257f422c5a89',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1308.986745] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1308.986903] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1308.986973] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1308.987266] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1308.987449] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1308.987631] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f7eb5b75-281d-41af-870c-257f422c5a89 is going to be updated. [ 1309.018806] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1309.019091] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1309.019091] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1309.019269] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1309.019418] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1309.029694] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f7eb5b75-281d-41af-870c-257f422c5a89 in Status: IN_PROGRESS for 2s [ 1309.068222] env[65370]: INFO networking_nsxv3.common.synchronization [req-66d219ee-7874-4998-a6e3-1a75cfbe53e8 req-14acd13a-22fd-4725-bb55-0a654b20c79a service nova] Enqueued Resource ID: f7eb5b75-281d-41af-870c-257f422c5a89 with Priority: HIGHEST for action security_group_rules [ 1309.068329] env[65370]: INFO networking_nsxv3.common.synchronization [req-66d219ee-7874-4998-a6e3-1a75cfbe53e8 req-14acd13a-22fd-4725-bb55-0a654b20c79a service nova] Enqueued Resource ID: f7eb5b75-281d-41af-870c-257f422c5a89 with Priority: HIGHEST for action security_group_members [ 1309.068399] env[65370]: INFO networking_nsxv3.common.synchronization [req-66d219ee-7874-4998-a6e3-1a75cfbe53e8 req-14acd13a-22fd-4725-bb55-0a654b20c79a service nova] Enqueued Resource ID: 22b8943b-56e0-4aa1-a28f-bf3c8ac33c5c with Priority: HIGHEST for action port [ 1309.068923] env[65370]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f7eb5b75-281d-41af-870c-257f422c5a89 with Priority: HIGHEST for action security_group_rules [ 1309.069096] env[65370]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f7eb5b75-281d-41af-870c-257f422c5a89 with Priority: HIGHEST for action security_group_members [ 1309.069255] env[65370]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 22b8943b-56e0-4aa1-a28f-bf3c8ac33c5c with Priority: HIGHEST for action port [ 1309.069605] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock rules-f7eb5b75-281d-41af-870c-257f422c5a89 taken with stack trace [, , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1309.069736] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-f7eb5b75-281d-41af-870c-257f422c5a89" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1309.069802] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-f7eb5b75-281d-41af-870c-257f422c5a89" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1309.070015] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-f7eb5b75-281d-41af-870c-257f422c5a89" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1309.070104] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('f7eb5b75-281d-41af-870c-257f422c5a89',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1309.071191] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock member-f7eb5b75-281d-41af-870c-257f422c5a89 taken with stack trace [, , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1309.071303] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f7eb5b75-281d-41af-870c-257f422c5a89" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1309.073754] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock port-22b8943b-56e0-4aa1-a28f-bf3c8ac33c5c taken with stack trace [, , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1309.073880] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-22b8943b-56e0-4aa1-a28f-bf3c8ac33c5c" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1309.073948] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-22b8943b-56e0-4aa1-a28f-bf3c8ac33c5c" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1309.074263] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-22b8943b-56e0-4aa1-a28f-bf3c8ac33c5c" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1309.074378] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('22b8943b-56e0-4aa1-a28f-bf3c8ac33c5c',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1309.576711] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock member-f7eb5b75-281d-41af-870c-257f422c5a89 taken with stack trace [, , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1309.576999] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f7eb5b75-281d-41af-870c-257f422c5a89" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1309.579312] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 22b8943b-56e0-4aa1-a28f-bf3c8ac33c5c with status ACTIVE [ 1309.579620] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1309.579792] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1309.579907] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1309.580414] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1309.580414] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1309.580547] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1309.580722] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1309.580817] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1309.581015] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1309.581147] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1309.581417] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1309.581546] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1309.581605] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1309.581772] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1309.581853] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1309.581964] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 22b8943b-56e0-4aa1-a28f-bf3c8ac33c5c is going to be updated. [ 1309.606716] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1309.606928] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1309.606972] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1309.607230] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1309.607410] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1309.607583] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-22b8943b-56e0-4aa1-a28f-bf3c8ac33c5c" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1311.040318] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f7eb5b75-281d-41af-870c-257f422c5a89 in Status: SUCCESS [ 1311.040600] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f7eb5b75-281d-41af-870c-257f422c5a89" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1311.040703] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f7eb5b75-281d-41af-870c-257f422c5a89" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1311.040955] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f7eb5b75-281d-41af-870c-257f422c5a89" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1311.041124] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1311.041303] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1311.041303] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1311.041476] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1311.041562] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1311.041672] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f7eb5b75-281d-41af-870c-257f422c5a89',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1311.543808] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('f7eb5b75-281d-41af-870c-257f422c5a89',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1312.046865] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('f7eb5b75-281d-41af-870c-257f422c5a89',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1312.549677] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1312.549879] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1312.549950] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1312.550186] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1312.550276] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1312.550375] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f7eb5b75-281d-41af-870c-257f422c5a89 is going to be updated. [ 1312.576952] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1312.576952] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1312.577239] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1312.577291] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1312.578634] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1312.586994] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f7eb5b75-281d-41af-870c-257f422c5a89 in Status: IN_PROGRESS for 2s [ 1314.070559] env[65370]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1314.070939] env[65370]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=2 [ 1314.598364] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f7eb5b75-281d-41af-870c-257f422c5a89 in Status: SUCCESS [ 1314.598591] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f7eb5b75-281d-41af-870c-257f422c5a89" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1314.598755] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f7eb5b75-281d-41af-870c-257f422c5a89" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1314.599067] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f7eb5b75-281d-41af-870c-257f422c5a89" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1314.599244] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1314.599369] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1314.599429] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1314.599588] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1314.599670] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1314.599756] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f7eb5b75-281d-41af-870c-257f422c5a89" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1314.599847] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('f7eb5b75-281d-41af-870c-257f422c5a89',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1315.102180] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock member-f7eb5b75-281d-41af-870c-257f422c5a89 taken with stack trace [, , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1315.102608] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f7eb5b75-281d-41af-870c-257f422c5a89" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1315.102608] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f7eb5b75-281d-41af-870c-257f422c5a89" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1315.102608] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f7eb5b75-281d-41af-870c-257f422c5a89" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1315.102825] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1315.102904] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1315.102957] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1315.103100] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1315.103178] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1315.103271] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f7eb5b75-281d-41af-870c-257f422c5a89" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1315.103425] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock member-f7eb5b75-281d-41af-870c-257f422c5a89 taken with stack trace [, , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1315.103538] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f7eb5b75-281d-41af-870c-257f422c5a89" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1315.103595] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f7eb5b75-281d-41af-870c-257f422c5a89" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1315.103738] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f7eb5b75-281d-41af-870c-257f422c5a89" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1315.103877] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1315.103966] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1315.104031] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1315.104178] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1315.104235] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1315.104308] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f7eb5b75-281d-41af-870c-257f422c5a89" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1315.104395] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('f7eb5b75-281d-41af-870c-257f422c5a89',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1315.606862] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for f7eb5b75-281d-41af-870c-257f422c5a89: rpc.has_security_group_logging(os_id): False [ 1315.630068] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1315.630253] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1315.630253] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1315.630458] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1315.630543] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1315.630763] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1315.630867] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1315.630938] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1315.631110] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1315.631216] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1315.631399] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1315.631494] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1315.631554] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1315.631694] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1315.631766] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1315.631936] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1315.632038] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1315.632097] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1315.632274] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1315.632356] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1315.632440] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: f7eb5b75-281d-41af-870c-257f422c5a89 is going to be updated. [ 1315.701974] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1315.702201] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1315.702201] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1315.702418] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1315.702568] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1315.715607] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: f7eb5b75-281d-41af-870c-257f422c5a89 in Status: IN_PROGRESS for 2s [ 1317.729530] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: f7eb5b75-281d-41af-870c-257f422c5a89 in Status: SUCCESS [ 1317.729984] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-f7eb5b75-281d-41af-870c-257f422c5a89" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1318.687060] env[65370]: INFO networking_nsxv3.common.synchronization [req-ea8a0628-7055-4c7f-b198-13f5ac90a7fd req-dc801d5e-2679-4440-82be-e35452ba0b76 tempest-ServersTestJSON-2095698355 tempest-ServersTestJSON-2095698355-project-member] Enqueued Resource ID: f7eb5b75-281d-41af-870c-257f422c5a89 with Priority: HIGHEST for action security_group_members [ 1318.687060] env[65370]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f7eb5b75-281d-41af-870c-257f422c5a89 with Priority: HIGHEST for action security_group_members [ 1318.687060] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock member-f7eb5b75-281d-41af-870c-257f422c5a89 taken with stack trace [, , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1318.687268] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f7eb5b75-281d-41af-870c-257f422c5a89" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1318.687603] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f7eb5b75-281d-41af-870c-257f422c5a89" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1318.687603] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f7eb5b75-281d-41af-870c-257f422c5a89" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1318.688446] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1318.688446] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1318.688446] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1318.688446] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1318.688446] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1318.688796] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f7eb5b75-281d-41af-870c-257f422c5a89',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1319.194448] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('f7eb5b75-281d-41af-870c-257f422c5a89',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1319.697426] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('f7eb5b75-281d-41af-870c-257f422c5a89',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1320.200139] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1320.200570] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1320.200570] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1320.200570] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1320.200685] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1320.200718] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f7eb5b75-281d-41af-870c-257f422c5a89 is going to be updated. [ 1320.235652] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1320.235881] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1320.235881] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1320.236097] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1320.236266] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1320.246132] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f7eb5b75-281d-41af-870c-257f422c5a89 in Status: IN_PROGRESS for 2s [ 1322.258258] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f7eb5b75-281d-41af-870c-257f422c5a89 in Status: SUCCESS [ 1322.258606] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f7eb5b75-281d-41af-870c-257f422c5a89" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1322.380360] env[65370]: INFO networking_nsxv3.common.synchronization [req-b6cda82f-acd5-4890-835f-83634bdc2fac req-26b8823d-5826-4f9f-9bca-03bc86757bf4 tempest-ServerActionsTestJSON-720598601 tempest-ServerActionsTestJSON-720598601-project-member] Enqueued Resource ID: fe248172-4be4-4d95-a8ca-c9c2ef203894 with Priority: HIGHEST for action security_group_members [ 1322.380886] env[65370]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fe248172-4be4-4d95-a8ca-c9c2ef203894 with Priority: HIGHEST for action security_group_members [ 1322.381213] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock member-fe248172-4be4-4d95-a8ca-c9c2ef203894 taken with stack trace [, , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1322.381373] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fe248172-4be4-4d95-a8ca-c9c2ef203894" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1322.381468] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fe248172-4be4-4d95-a8ca-c9c2ef203894" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1322.382021] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fe248172-4be4-4d95-a8ca-c9c2ef203894" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1322.382194] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1322.382306] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1322.382392] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1322.382527] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1322.382612] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1322.382706] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('fe248172-4be4-4d95-a8ca-c9c2ef203894',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1322.884946] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1322.885271] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1322.885359] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1322.885569] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1322.885665] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1322.885873] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1322.885975] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1322.886051] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1322.886205] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1322.886282] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1322.886370] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: fe248172-4be4-4d95-a8ca-c9c2ef203894 is going to be updated. [ 1322.913793] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1322.914050] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1322.914050] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1322.914213] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1322.914358] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1322.922308] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fe248172-4be4-4d95-a8ca-c9c2ef203894 in Status: IN_PROGRESS for 2s [ 1324.933604] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fe248172-4be4-4d95-a8ca-c9c2ef203894 in Status: SUCCESS [ 1324.933987] env[65370]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: fe248172-4be4-4d95-a8ca-c9c2ef203894 deletion is rescheduled due to dependency. [ 1324.933987] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fe248172-4be4-4d95-a8ca-c9c2ef203894" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1327.381894] env[65370]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1327.382193] env[65370]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1329.141633] env[65370]: INFO networking_nsxv3.common.synchronization [req-9ccdafc4-5eed-4838-a781-96629747da21 req-74b898a6-90e6-4f6d-b96b-6d05b4c0ce04 tempest-ServersTestJSON-2095698355 tempest-ServersTestJSON-2095698355-project-member] Enqueued Resource ID: f7eb5b75-281d-41af-870c-257f422c5a89 with Priority: HIGHEST for action security_group_members [ 1329.142169] env[65370]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f7eb5b75-281d-41af-870c-257f422c5a89 with Priority: HIGHEST for action security_group_members [ 1329.142529] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock member-f7eb5b75-281d-41af-870c-257f422c5a89 taken with stack trace [, , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1329.142586] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f7eb5b75-281d-41af-870c-257f422c5a89" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1329.142653] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f7eb5b75-281d-41af-870c-257f422c5a89" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1329.142845] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f7eb5b75-281d-41af-870c-257f422c5a89" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1329.143008] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1329.143246] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1329.143306] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1329.143467] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1329.143555] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1329.143649] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f7eb5b75-281d-41af-870c-257f422c5a89',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1329.452045] env[65370]: DEBUG networking_nsxv3.common.locking [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Lock network-353 taken with stack trace [, , , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1329.452224] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquiring lock "network-353" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1329.452299] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquired lock "network-353" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1329.452633] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquired external semaphore "network-353" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1329.453436] env[65370]: DEBUG networking_nsxv3.common.locking [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1329.454087] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquiring lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1329.454087] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquired lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1329.454287] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquired external semaphore "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1329.454567] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Releasing lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1329.454823] env[65370]: DEBUG dogpile.cache.region [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] No value present for key: 'zone-id' {{(pid=65370) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1329.455030] env[65370]: DEBUG dogpile.lock [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] NeedRegenerationException {{(pid=65370) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1329.455242] env[65370]: DEBUG dogpile.lock [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] no value, waiting for create lock {{(pid=65370) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1329.455440] env[65370]: DEBUG dogpile.lock [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] value creation lock acquired {{(pid=65370) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1329.455613] env[65370]: DEBUG dogpile.cache.region [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] No value present for key: 'zone-id' {{(pid=65370) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1329.455705] env[65370]: DEBUG dogpile.lock [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Calling creation function for not-yet-present value {{(pid=65370) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1329.455891] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1329.476670] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1329.476844] env[65370]: DEBUG dogpile.cache.region [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=65370) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1329.477063] env[65370]: DEBUG dogpile.lock [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Released creation lock {{(pid=65370) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1329.477333] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Releasing lock "network-353" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1329.477723] env[65370]: DEBUG networking_nsxv3.common.locking [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Lock port-705f68d3-39f0-435e-a39d-4a7a90208b30 taken with stack trace [, , , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1329.477930] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquiring lock "port-705f68d3-39f0-435e-a39d-4a7a90208b30" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1329.478095] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquired lock "port-705f68d3-39f0-435e-a39d-4a7a90208b30" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1329.478428] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquired external semaphore "port-705f68d3-39f0-435e-a39d-4a7a90208b30" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1329.478592] env[65370]: DEBUG networking_nsxv3.api.rpc [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('705f68d3-39f0-435e-a39d-4a7a90208b30',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1329.645644] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('f7eb5b75-281d-41af-870c-257f422c5a89',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1329.980612] env[65370]: DEBUG networking_nsxv3.common.locking [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1329.980835] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquiring lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1329.980959] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquired lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1329.981256] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquired external semaphore "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1329.981470] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Releasing lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1329.981622] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Segment Port 705f68d3-39f0-435e-a39d-4a7a90208b30 not found, creating... [ 1329.981867] env[65370]: DEBUG networking_nsxv3.common.locking [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1329.982035] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquiring lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1329.982152] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquired lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1329.982383] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquired external semaphore "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1329.982528] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Releasing lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1329.982797] env[65370]: DEBUG networking_nsxv3.common.locking [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1329.982945] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquiring lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1329.983069] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquired lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1329.983272] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquired external semaphore "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1329.983401] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Releasing lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1329.983532] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Resource: SegmentPort with ID: 705f68d3-39f0-435e-a39d-4a7a90208b30 is going to be created. [ 1330.002940] env[65370]: DEBUG networking_nsxv3.common.locking [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1330.003175] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquiring lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1330.003275] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquired lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1330.003535] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquired external semaphore "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1330.003761] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Releasing lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1330.003977] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Releasing lock "port-705f68d3-39f0-435e-a39d-4a7a90208b30" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1330.147661] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('f7eb5b75-281d-41af-870c-257f422c5a89',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1330.650578] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1330.650783] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1330.650840] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1330.651048] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1330.651303] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1330.651303] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f7eb5b75-281d-41af-870c-257f422c5a89 is going to be updated. [ 1330.682456] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1330.682639] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1330.682688] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1330.682906] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1330.683067] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1330.691797] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f7eb5b75-281d-41af-870c-257f422c5a89 in Status: IN_PROGRESS for 2s [ 1330.697920] env[65370]: INFO networking_nsxv3.common.synchronization [req-9ccdafc4-5eed-4838-a781-96629747da21 req-0784333a-d637-4ef4-94eb-50944f8e1c39 service nova] Enqueued Resource ID: f7eb5b75-281d-41af-870c-257f422c5a89 with Priority: HIGHEST for action security_group_rules [ 1330.697920] env[65370]: INFO networking_nsxv3.common.synchronization [req-9ccdafc4-5eed-4838-a781-96629747da21 req-0784333a-d637-4ef4-94eb-50944f8e1c39 service nova] Enqueued Resource ID: f7eb5b75-281d-41af-870c-257f422c5a89 with Priority: HIGHEST for action security_group_members [ 1330.698414] env[65370]: INFO networking_nsxv3.common.synchronization [req-9ccdafc4-5eed-4838-a781-96629747da21 req-0784333a-d637-4ef4-94eb-50944f8e1c39 service nova] Enqueued Resource ID: 705f68d3-39f0-435e-a39d-4a7a90208b30 with Priority: HIGHEST for action port [ 1330.698414] env[65370]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f7eb5b75-281d-41af-870c-257f422c5a89 with Priority: HIGHEST for action security_group_rules [ 1330.698414] env[65370]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f7eb5b75-281d-41af-870c-257f422c5a89 with Priority: HIGHEST for action security_group_members [ 1330.698414] env[65370]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 705f68d3-39f0-435e-a39d-4a7a90208b30 with Priority: HIGHEST for action port [ 1330.698952] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock rules-f7eb5b75-281d-41af-870c-257f422c5a89 taken with stack trace [, , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1330.699088] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-f7eb5b75-281d-41af-870c-257f422c5a89" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1330.699169] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-f7eb5b75-281d-41af-870c-257f422c5a89" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1330.699404] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-f7eb5b75-281d-41af-870c-257f422c5a89" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1330.699522] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('f7eb5b75-281d-41af-870c-257f422c5a89',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1330.700656] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock member-f7eb5b75-281d-41af-870c-257f422c5a89 taken with stack trace [, , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1330.700754] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f7eb5b75-281d-41af-870c-257f422c5a89" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1330.700948] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock port-705f68d3-39f0-435e-a39d-4a7a90208b30 taken with stack trace [, , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1330.701062] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-705f68d3-39f0-435e-a39d-4a7a90208b30" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1330.701125] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-705f68d3-39f0-435e-a39d-4a7a90208b30" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1330.701308] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-705f68d3-39f0-435e-a39d-4a7a90208b30" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1330.701433] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('705f68d3-39f0-435e-a39d-4a7a90208b30',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1331.203352] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock member-f7eb5b75-281d-41af-870c-257f422c5a89 taken with stack trace [, , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1331.203757] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f7eb5b75-281d-41af-870c-257f422c5a89" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1331.203757] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 705f68d3-39f0-435e-a39d-4a7a90208b30 with status ACTIVE [ 1331.203837] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1331.203906] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1331.204029] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1331.204208] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1331.204304] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1331.204481] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1331.204580] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1331.204639] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1331.204793] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1331.204870] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1331.205056] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1331.205153] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1331.205212] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1331.205387] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1331.205439] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1331.205498] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 705f68d3-39f0-435e-a39d-4a7a90208b30 is going to be updated. [ 1331.224911] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1331.225185] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1331.225185] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1331.225310] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1331.225448] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1331.225621] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-705f68d3-39f0-435e-a39d-4a7a90208b30" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1332.702143] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f7eb5b75-281d-41af-870c-257f422c5a89 in Status: SUCCESS [ 1332.702600] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f7eb5b75-281d-41af-870c-257f422c5a89" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1332.702600] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f7eb5b75-281d-41af-870c-257f422c5a89" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1332.702844] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f7eb5b75-281d-41af-870c-257f422c5a89" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1332.703069] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1332.703221] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1332.703328] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1332.703564] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1332.703681] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1332.703813] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f7eb5b75-281d-41af-870c-257f422c5a89',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1333.206089] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('f7eb5b75-281d-41af-870c-257f422c5a89',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1333.708518] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('f7eb5b75-281d-41af-870c-257f422c5a89',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1334.210569] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1334.210744] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1334.210851] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1334.211090] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1334.211183] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1334.211285] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f7eb5b75-281d-41af-870c-257f422c5a89 is going to be updated. [ 1334.240303] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1334.240303] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1334.240303] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1334.240303] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1334.240303] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1334.248220] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f7eb5b75-281d-41af-870c-257f422c5a89 in Status: IN_PROGRESS for 2s [ 1335.699772] env[65370]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1335.700180] env[65370]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=2 [ 1336.263165] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f7eb5b75-281d-41af-870c-257f422c5a89 in Status: SUCCESS [ 1336.263385] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f7eb5b75-281d-41af-870c-257f422c5a89" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1336.263564] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f7eb5b75-281d-41af-870c-257f422c5a89" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1336.263832] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f7eb5b75-281d-41af-870c-257f422c5a89" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1336.264042] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1336.264165] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1336.264231] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1336.264402] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1336.264487] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1336.264573] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f7eb5b75-281d-41af-870c-257f422c5a89" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1336.264663] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('f7eb5b75-281d-41af-870c-257f422c5a89',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1336.766827] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock member-f7eb5b75-281d-41af-870c-257f422c5a89 taken with stack trace [, , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1336.767139] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f7eb5b75-281d-41af-870c-257f422c5a89" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1336.767139] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f7eb5b75-281d-41af-870c-257f422c5a89" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1336.767304] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f7eb5b75-281d-41af-870c-257f422c5a89" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1336.767476] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1336.767582] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1336.767648] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1336.767798] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1336.767885] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1336.767973] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f7eb5b75-281d-41af-870c-257f422c5a89" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1336.768138] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock member-f7eb5b75-281d-41af-870c-257f422c5a89 taken with stack trace [, , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1336.768232] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f7eb5b75-281d-41af-870c-257f422c5a89" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1336.768293] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f7eb5b75-281d-41af-870c-257f422c5a89" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1336.768432] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f7eb5b75-281d-41af-870c-257f422c5a89" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1336.768573] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1336.768666] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1336.768723] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1336.768856] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1336.768931] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1336.769030] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f7eb5b75-281d-41af-870c-257f422c5a89" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1336.769124] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('f7eb5b75-281d-41af-870c-257f422c5a89',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1337.271297] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for f7eb5b75-281d-41af-870c-257f422c5a89: rpc.has_security_group_logging(os_id): False [ 1337.288319] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1337.288559] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1337.288559] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1337.288737] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1337.288824] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1337.289048] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1337.289152] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1337.289214] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1337.289397] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1337.289516] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1337.289626] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1337.289713] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1337.289770] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1337.289903] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1337.289972] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1337.290155] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1337.290247] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1337.290297] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1337.290453] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1337.290524] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1337.290604] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: f7eb5b75-281d-41af-870c-257f422c5a89 is going to be updated. [ 1337.349159] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1337.349380] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1337.349380] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1337.349573] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1337.349728] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1337.362153] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: f7eb5b75-281d-41af-870c-257f422c5a89 in Status: IN_PROGRESS for 2s [ 1339.379932] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: f7eb5b75-281d-41af-870c-257f422c5a89 in Status: SUCCESS [ 1339.380388] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-f7eb5b75-281d-41af-870c-257f422c5a89" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1340.076466] env[65370]: INFO networking_nsxv3.common.synchronization [req-fa32bb50-f541-43ca-870e-e28611ea2612 req-7096b1a7-4571-4fd7-9538-6f8ef729ffdb tempest-ServersTestJSON-2095698355 tempest-ServersTestJSON-2095698355-project-member] Enqueued Resource ID: f7eb5b75-281d-41af-870c-257f422c5a89 with Priority: HIGHEST for action security_group_members [ 1340.076466] env[65370]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f7eb5b75-281d-41af-870c-257f422c5a89 with Priority: HIGHEST for action security_group_members [ 1340.076740] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock member-f7eb5b75-281d-41af-870c-257f422c5a89 taken with stack trace [, , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1340.076740] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f7eb5b75-281d-41af-870c-257f422c5a89" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1340.076740] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f7eb5b75-281d-41af-870c-257f422c5a89" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1340.076957] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f7eb5b75-281d-41af-870c-257f422c5a89" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1340.077210] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1340.077376] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1340.077488] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1340.077742] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1340.077888] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1340.078157] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f7eb5b75-281d-41af-870c-257f422c5a89',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1340.580488] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('f7eb5b75-281d-41af-870c-257f422c5a89',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1341.083071] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('f7eb5b75-281d-41af-870c-257f422c5a89',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1341.586099] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1341.586514] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1341.586514] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1341.586598] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1341.586661] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1341.586719] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f7eb5b75-281d-41af-870c-257f422c5a89 is going to be updated. [ 1341.615871] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1341.616077] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1341.616166] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1341.616475] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1341.616636] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1341.627598] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f7eb5b75-281d-41af-870c-257f422c5a89 in Status: IN_PROGRESS for 2s [ 1343.638644] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f7eb5b75-281d-41af-870c-257f422c5a89 in Status: SUCCESS [ 1343.639059] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f7eb5b75-281d-41af-870c-257f422c5a89" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1345.077032] env[65370]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1345.077418] env[65370]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1349.164215] env[65370]: INFO networking_nsxv3.common.synchronization [req-d7d8f485-7a2d-4b75-97d7-d29b013baf84 req-021c75ea-fade-4f44-a2cb-3e9a008fabec tempest-ServersTestJSON-2095698355 tempest-ServersTestJSON-2095698355-project-member] Enqueued Resource ID: f7eb5b75-281d-41af-870c-257f422c5a89 with Priority: HIGHEST for action security_group_members [ 1349.164931] env[65370]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f7eb5b75-281d-41af-870c-257f422c5a89 with Priority: HIGHEST for action security_group_members [ 1349.166078] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock member-f7eb5b75-281d-41af-870c-257f422c5a89 taken with stack trace [, , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1349.166078] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f7eb5b75-281d-41af-870c-257f422c5a89" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1349.166078] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f7eb5b75-281d-41af-870c-257f422c5a89" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1349.166078] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f7eb5b75-281d-41af-870c-257f422c5a89" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1349.166078] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1349.166078] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1349.166078] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1349.166078] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1349.166078] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1349.166078] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f7eb5b75-281d-41af-870c-257f422c5a89',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1349.469033] env[65370]: DEBUG networking_nsxv3.common.locking [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Lock network-353 taken with stack trace [, , , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1349.469033] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquiring lock "network-353" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1349.469255] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquired lock "network-353" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1349.469391] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquired external semaphore "network-353" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1349.469638] env[65370]: DEBUG networking_nsxv3.common.locking [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1349.469821] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquiring lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1349.469947] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquired lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1349.470176] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquired external semaphore "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1349.470316] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Releasing lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1349.470541] env[65370]: DEBUG dogpile.cache.region [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] No value present for key: 'zone-id' {{(pid=65370) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1349.470722] env[65370]: DEBUG dogpile.lock [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] NeedRegenerationException {{(pid=65370) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1349.470805] env[65370]: DEBUG dogpile.lock [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] no value, waiting for create lock {{(pid=65370) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1349.470923] env[65370]: DEBUG dogpile.lock [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] value creation lock acquired {{(pid=65370) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1349.471054] env[65370]: DEBUG dogpile.cache.region [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] No value present for key: 'zone-id' {{(pid=65370) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1349.471160] env[65370]: DEBUG dogpile.lock [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Calling creation function for not-yet-present value {{(pid=65370) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1349.471288] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1349.491725] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1349.491923] env[65370]: DEBUG dogpile.cache.region [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=65370) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1349.492063] env[65370]: DEBUG dogpile.lock [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Released creation lock {{(pid=65370) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1349.492200] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Releasing lock "network-353" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1349.492522] env[65370]: DEBUG networking_nsxv3.common.locking [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Lock port-8e1faca1-a6b4-4275-82c4-868b9f2d0697 taken with stack trace [, , , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1349.492716] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquiring lock "port-8e1faca1-a6b4-4275-82c4-868b9f2d0697" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1349.492865] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquired lock "port-8e1faca1-a6b4-4275-82c4-868b9f2d0697" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1349.493207] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquired external semaphore "port-8e1faca1-a6b4-4275-82c4-868b9f2d0697" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1349.493343] env[65370]: DEBUG networking_nsxv3.api.rpc [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8e1faca1-a6b4-4275-82c4-868b9f2d0697',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1349.668251] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('f7eb5b75-281d-41af-870c-257f422c5a89',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1349.996047] env[65370]: DEBUG networking_nsxv3.common.locking [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1349.996047] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquiring lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1349.996047] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquired lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1349.996301] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquired external semaphore "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1349.996397] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Releasing lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1349.996558] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Segment Port 8e1faca1-a6b4-4275-82c4-868b9f2d0697 not found, creating... [ 1349.996853] env[65370]: DEBUG networking_nsxv3.common.locking [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1349.997020] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquiring lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1349.997141] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquired lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1349.997357] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquired external semaphore "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1349.997488] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Releasing lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1349.997753] env[65370]: DEBUG networking_nsxv3.common.locking [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1349.997905] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquiring lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1349.998018] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquired lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1349.998220] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquired external semaphore "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1349.998345] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Releasing lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1349.998475] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Resource: SegmentPort with ID: 8e1faca1-a6b4-4275-82c4-868b9f2d0697 is going to be created. [ 1350.018471] env[65370]: DEBUG networking_nsxv3.common.locking [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1350.018672] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquiring lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1350.018775] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquired lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1350.019023] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquired external semaphore "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1350.019248] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Releasing lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1350.019480] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Releasing lock "port-8e1faca1-a6b4-4275-82c4-868b9f2d0697" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1350.170429] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('f7eb5b75-281d-41af-870c-257f422c5a89',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1350.673708] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1350.673954] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1350.674033] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1350.674231] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1350.674326] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1350.674429] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f7eb5b75-281d-41af-870c-257f422c5a89 is going to be updated. [ 1350.704339] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1350.704546] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1350.704546] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1350.704755] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1350.704896] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1350.714833] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f7eb5b75-281d-41af-870c-257f422c5a89 in Status: IN_PROGRESS for 2s [ 1350.731445] env[65370]: INFO networking_nsxv3.common.synchronization [req-d7d8f485-7a2d-4b75-97d7-d29b013baf84 req-8fd486bb-2117-4d02-833b-4c7e07911e5d service nova] Enqueued Resource ID: f7eb5b75-281d-41af-870c-257f422c5a89 with Priority: HIGHEST for action security_group_rules [ 1350.731651] env[65370]: INFO networking_nsxv3.common.synchronization [req-d7d8f485-7a2d-4b75-97d7-d29b013baf84 req-8fd486bb-2117-4d02-833b-4c7e07911e5d service nova] Enqueued Resource ID: f7eb5b75-281d-41af-870c-257f422c5a89 with Priority: HIGHEST for action security_group_members [ 1350.731792] env[65370]: INFO networking_nsxv3.common.synchronization [req-d7d8f485-7a2d-4b75-97d7-d29b013baf84 req-8fd486bb-2117-4d02-833b-4c7e07911e5d service nova] Enqueued Resource ID: 8e1faca1-a6b4-4275-82c4-868b9f2d0697 with Priority: HIGHEST for action port [ 1350.732317] env[65370]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f7eb5b75-281d-41af-870c-257f422c5a89 with Priority: HIGHEST for action security_group_rules [ 1350.732454] env[65370]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f7eb5b75-281d-41af-870c-257f422c5a89 with Priority: HIGHEST for action security_group_members [ 1350.732925] env[65370]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8e1faca1-a6b4-4275-82c4-868b9f2d0697 with Priority: HIGHEST for action port [ 1350.733242] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock rules-f7eb5b75-281d-41af-870c-257f422c5a89 taken with stack trace [, , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1350.733368] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-f7eb5b75-281d-41af-870c-257f422c5a89" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1350.733433] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-f7eb5b75-281d-41af-870c-257f422c5a89" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1350.733630] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-f7eb5b75-281d-41af-870c-257f422c5a89" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1350.733712] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('f7eb5b75-281d-41af-870c-257f422c5a89',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1350.734788] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock member-f7eb5b75-281d-41af-870c-257f422c5a89 taken with stack trace [, , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1350.734903] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f7eb5b75-281d-41af-870c-257f422c5a89" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1350.735112] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock port-8e1faca1-a6b4-4275-82c4-868b9f2d0697 taken with stack trace [, , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1350.735237] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-8e1faca1-a6b4-4275-82c4-868b9f2d0697" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1350.735290] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-8e1faca1-a6b4-4275-82c4-868b9f2d0697" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1350.736221] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-8e1faca1-a6b4-4275-82c4-868b9f2d0697" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1350.736309] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8e1faca1-a6b4-4275-82c4-868b9f2d0697',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1351.238362] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock member-f7eb5b75-281d-41af-870c-257f422c5a89 taken with stack trace [, , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1351.238776] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f7eb5b75-281d-41af-870c-257f422c5a89" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1351.238776] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 8e1faca1-a6b4-4275-82c4-868b9f2d0697 with status ACTIVE [ 1351.238868] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1351.238926] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1351.238969] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1351.239190] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1351.239279] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1351.239459] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1351.239563] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1351.239650] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1351.239783] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1351.239847] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1351.240034] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1351.240129] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1351.240188] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1351.240324] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1351.240395] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1351.240477] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 8e1faca1-a6b4-4275-82c4-868b9f2d0697 is going to be updated. [ 1351.260232] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1351.260453] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1351.260453] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1351.260612] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1351.260755] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1351.260909] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-8e1faca1-a6b4-4275-82c4-868b9f2d0697" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1352.724852] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f7eb5b75-281d-41af-870c-257f422c5a89 in Status: SUCCESS [ 1352.725561] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f7eb5b75-281d-41af-870c-257f422c5a89" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1352.725561] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f7eb5b75-281d-41af-870c-257f422c5a89" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1352.725801] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f7eb5b75-281d-41af-870c-257f422c5a89" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1352.725801] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1352.725983] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1352.726139] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1352.726267] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1352.726397] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1352.726542] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f7eb5b75-281d-41af-870c-257f422c5a89',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1353.228711] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('f7eb5b75-281d-41af-870c-257f422c5a89',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1353.493667] env[65370]: INFO networking_nsxv3.common.synchronization [req-339257bf-fb86-49a6-ac78-db4101597702 req-2459cfe0-ae87-4d4e-9daf-93fc03aa1275 tempest-AttachVolumeShelveTestJSON-478164993 tempest-AttachVolumeShelveTestJSON-478164993-project-member] Enqueued Resource ID: d40b0ebb-5855-4234-b52c-c2003a5df171 with Priority: HIGHEST for action security_group_members [ 1353.494230] env[65370]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d40b0ebb-5855-4234-b52c-c2003a5df171 with Priority: HIGHEST for action security_group_members [ 1353.494760] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock member-d40b0ebb-5855-4234-b52c-c2003a5df171 taken with stack trace [, , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1353.494760] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d40b0ebb-5855-4234-b52c-c2003a5df171" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1353.494760] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d40b0ebb-5855-4234-b52c-c2003a5df171" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1353.494961] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d40b0ebb-5855-4234-b52c-c2003a5df171" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1353.495084] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1353.495171] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1353.495228] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1353.495355] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1353.495428] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1353.495521] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d40b0ebb-5855-4234-b52c-c2003a5df171',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1353.731411] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('f7eb5b75-281d-41af-870c-257f422c5a89',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1353.999783] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1354.000043] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1354.000043] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1354.000247] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1354.000336] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1354.000533] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1354.000675] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1354.000675] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1354.000828] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1354.000898] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1354.000981] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d40b0ebb-5855-4234-b52c-c2003a5df171 is going to be updated. [ 1354.025990] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1354.026217] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1354.026217] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1354.026390] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1354.026526] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1354.034480] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d40b0ebb-5855-4234-b52c-c2003a5df171 in Status: IN_PROGRESS for 2s [ 1354.234864] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1354.234864] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1354.234864] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1354.234864] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1354.234864] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1354.234864] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f7eb5b75-281d-41af-870c-257f422c5a89 is going to be updated. [ 1354.261681] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1354.261848] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1354.261896] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1354.262106] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1354.262249] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1354.271335] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f7eb5b75-281d-41af-870c-257f422c5a89 in Status: IN_PROGRESS for 2s [ 1356.044244] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d40b0ebb-5855-4234-b52c-c2003a5df171 in Status: SUCCESS [ 1356.044686] env[65370]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d40b0ebb-5855-4234-b52c-c2003a5df171 deletion is rescheduled due to dependency. [ 1356.044686] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d40b0ebb-5855-4234-b52c-c2003a5df171" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1356.282059] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f7eb5b75-281d-41af-870c-257f422c5a89 in Status: SUCCESS [ 1356.282323] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f7eb5b75-281d-41af-870c-257f422c5a89" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1356.282432] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f7eb5b75-281d-41af-870c-257f422c5a89" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1356.282673] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f7eb5b75-281d-41af-870c-257f422c5a89" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1356.283067] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1356.283067] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1356.283067] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1356.283265] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1356.283265] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1356.283359] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f7eb5b75-281d-41af-870c-257f422c5a89" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1356.283432] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('f7eb5b75-281d-41af-870c-257f422c5a89',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1356.786297] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock member-f7eb5b75-281d-41af-870c-257f422c5a89 taken with stack trace [, , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1356.786424] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f7eb5b75-281d-41af-870c-257f422c5a89" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1356.786507] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f7eb5b75-281d-41af-870c-257f422c5a89" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1356.786723] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f7eb5b75-281d-41af-870c-257f422c5a89" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1356.786892] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1356.787015] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1356.787080] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1356.787244] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1356.787322] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1356.787431] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f7eb5b75-281d-41af-870c-257f422c5a89" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1356.787581] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock member-f7eb5b75-281d-41af-870c-257f422c5a89 taken with stack trace [, , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1356.787674] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f7eb5b75-281d-41af-870c-257f422c5a89" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1356.787741] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f7eb5b75-281d-41af-870c-257f422c5a89" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1356.787869] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f7eb5b75-281d-41af-870c-257f422c5a89" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1356.788029] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1356.788122] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1356.788183] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1356.788312] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1356.788403] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1356.788485] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f7eb5b75-281d-41af-870c-257f422c5a89" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1356.788573] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('f7eb5b75-281d-41af-870c-257f422c5a89',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1357.290776] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for f7eb5b75-281d-41af-870c-257f422c5a89: rpc.has_security_group_logging(os_id): False [ 1357.310126] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1357.310300] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1357.310365] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1357.310555] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1357.310959] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1357.310959] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1357.310959] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1357.311169] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1357.311169] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1357.311287] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1357.311413] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1357.311508] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1357.311641] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1357.311744] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1357.311817] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1357.312200] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1357.312200] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1357.312200] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1357.312430] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1357.312430] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1357.312430] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: f7eb5b75-281d-41af-870c-257f422c5a89 is going to be updated. [ 1357.377249] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1357.377514] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1357.377514] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1357.377653] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1357.377854] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1357.397203] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: f7eb5b75-281d-41af-870c-257f422c5a89 in Status: IN_PROGRESS for 2s [ 1358.495793] env[65370]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1358.496260] env[65370]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=1 [ 1359.416038] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: f7eb5b75-281d-41af-870c-257f422c5a89 in Status: SUCCESS [ 1359.416218] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-f7eb5b75-281d-41af-870c-257f422c5a89" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1363.496694] env[65370]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1363.497057] env[65370]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1363.840849] env[65370]: INFO networking_nsxv3.common.synchronization [req-86e99cff-36ca-4a4d-ae3a-19dbad3d3af5 req-6b05fde9-a3af-499c-bc38-dceae1438999 tempest-ServersTestJSON-2095698355 tempest-ServersTestJSON-2095698355-project-member] Enqueued Resource ID: f7eb5b75-281d-41af-870c-257f422c5a89 with Priority: HIGHEST for action security_group_members [ 1363.841381] env[65370]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f7eb5b75-281d-41af-870c-257f422c5a89 with Priority: HIGHEST for action security_group_members [ 1363.841750] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock member-f7eb5b75-281d-41af-870c-257f422c5a89 taken with stack trace [, , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1363.841888] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f7eb5b75-281d-41af-870c-257f422c5a89" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1363.841955] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f7eb5b75-281d-41af-870c-257f422c5a89" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1363.842146] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f7eb5b75-281d-41af-870c-257f422c5a89" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1363.842300] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1363.842400] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1363.842568] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1363.842608] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1363.842684] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1363.842790] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f7eb5b75-281d-41af-870c-257f422c5a89',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1364.094628] env[65370]: DEBUG networking_nsxv3.common.locking [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Lock network-353 taken with stack trace [, , , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1364.095100] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquiring lock "network-353" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1364.095100] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquired lock "network-353" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1364.095264] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquired external semaphore "network-353" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1364.095494] env[65370]: DEBUG networking_nsxv3.common.locking [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1364.095648] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquiring lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1364.095761] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquired lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1364.095975] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquired external semaphore "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1364.096265] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Releasing lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1364.096479] env[65370]: DEBUG dogpile.cache.region [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] No value present for key: 'zone-id' {{(pid=65370) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1364.096591] env[65370]: DEBUG dogpile.lock [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] NeedRegenerationException {{(pid=65370) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1364.096695] env[65370]: DEBUG dogpile.lock [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] no value, waiting for create lock {{(pid=65370) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1364.096798] env[65370]: DEBUG dogpile.lock [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] value creation lock acquired {{(pid=65370) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1364.096904] env[65370]: DEBUG dogpile.cache.region [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] No value present for key: 'zone-id' {{(pid=65370) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1364.097015] env[65370]: DEBUG dogpile.lock [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Calling creation function for not-yet-present value {{(pid=65370) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1364.097160] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1364.117427] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1364.117590] env[65370]: DEBUG dogpile.cache.region [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=65370) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1364.117718] env[65370]: DEBUG dogpile.lock [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Released creation lock {{(pid=65370) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1364.117885] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Releasing lock "network-353" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1364.118215] env[65370]: DEBUG networking_nsxv3.common.locking [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Lock port-a6292acf-b7a4-49a7-9f3e-ef43ce303163 taken with stack trace [, , , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1364.118391] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquiring lock "port-a6292acf-b7a4-49a7-9f3e-ef43ce303163" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1364.118510] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquired lock "port-a6292acf-b7a4-49a7-9f3e-ef43ce303163" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1364.118836] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquired external semaphore "port-a6292acf-b7a4-49a7-9f3e-ef43ce303163" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1364.118977] env[65370]: DEBUG networking_nsxv3.api.rpc [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a6292acf-b7a4-49a7-9f3e-ef43ce303163',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1364.344690] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('f7eb5b75-281d-41af-870c-257f422c5a89',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1364.621149] env[65370]: DEBUG networking_nsxv3.common.locking [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1364.621592] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquiring lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1364.621592] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquired lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1364.621827] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquired external semaphore "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1364.621975] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Releasing lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1364.622143] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Segment Port a6292acf-b7a4-49a7-9f3e-ef43ce303163 not found, creating... [ 1364.622441] env[65370]: DEBUG networking_nsxv3.common.locking [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1364.622578] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquiring lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1364.622668] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquired lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1364.622875] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquired external semaphore "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1364.623015] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Releasing lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1364.623443] env[65370]: DEBUG networking_nsxv3.common.locking [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1364.623626] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquiring lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1364.623740] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquired lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1364.623944] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquired external semaphore "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1364.624156] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Releasing lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1364.624309] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Resource: SegmentPort with ID: a6292acf-b7a4-49a7-9f3e-ef43ce303163 is going to be created. [ 1364.647362] env[65370]: DEBUG networking_nsxv3.common.locking [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1364.647603] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquiring lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1364.647726] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquired lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1364.647987] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquired external semaphore "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1364.648223] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Releasing lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1364.648428] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Releasing lock "port-a6292acf-b7a4-49a7-9f3e-ef43ce303163" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1364.847400] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('f7eb5b75-281d-41af-870c-257f422c5a89',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1365.323738] env[65370]: INFO networking_nsxv3.common.synchronization [req-86e99cff-36ca-4a4d-ae3a-19dbad3d3af5 req-2aced1e7-f49b-48c7-829f-fdb52e9d000c service nova] Enqueued Resource ID: f7eb5b75-281d-41af-870c-257f422c5a89 with Priority: HIGHEST for action security_group_rules [ 1365.323917] env[65370]: INFO networking_nsxv3.common.synchronization [req-86e99cff-36ca-4a4d-ae3a-19dbad3d3af5 req-2aced1e7-f49b-48c7-829f-fdb52e9d000c service nova] Enqueued Resource ID: f7eb5b75-281d-41af-870c-257f422c5a89 with Priority: HIGHEST for action security_group_members [ 1365.324096] env[65370]: INFO networking_nsxv3.common.synchronization [req-86e99cff-36ca-4a4d-ae3a-19dbad3d3af5 req-2aced1e7-f49b-48c7-829f-fdb52e9d000c service nova] Enqueued Resource ID: a6292acf-b7a4-49a7-9f3e-ef43ce303163 with Priority: HIGHEST for action port [ 1365.324325] env[65370]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f7eb5b75-281d-41af-870c-257f422c5a89 with Priority: HIGHEST for action security_group_rules [ 1365.324464] env[65370]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f7eb5b75-281d-41af-870c-257f422c5a89 with Priority: HIGHEST for action security_group_members [ 1365.324560] env[65370]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a6292acf-b7a4-49a7-9f3e-ef43ce303163 with Priority: HIGHEST for action port [ 1365.325367] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock rules-f7eb5b75-281d-41af-870c-257f422c5a89 taken with stack trace [, , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1365.325476] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-f7eb5b75-281d-41af-870c-257f422c5a89" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1365.325582] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-f7eb5b75-281d-41af-870c-257f422c5a89" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1365.325902] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-f7eb5b75-281d-41af-870c-257f422c5a89" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1365.325974] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('f7eb5b75-281d-41af-870c-257f422c5a89',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1365.327663] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock member-f7eb5b75-281d-41af-870c-257f422c5a89 taken with stack trace [, , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1365.327663] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f7eb5b75-281d-41af-870c-257f422c5a89" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1365.327793] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock port-a6292acf-b7a4-49a7-9f3e-ef43ce303163 taken with stack trace [, , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1365.327887] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-a6292acf-b7a4-49a7-9f3e-ef43ce303163" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1365.327958] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-a6292acf-b7a4-49a7-9f3e-ef43ce303163" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1365.328477] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-a6292acf-b7a4-49a7-9f3e-ef43ce303163" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1365.328566] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a6292acf-b7a4-49a7-9f3e-ef43ce303163',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1365.349851] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1365.350036] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1365.350120] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1365.350348] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1365.350442] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1365.350540] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f7eb5b75-281d-41af-870c-257f422c5a89 is going to be updated. [ 1365.378536] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1365.378536] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1365.378764] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1365.378764] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1365.378899] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1365.387011] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f7eb5b75-281d-41af-870c-257f422c5a89 in Status: IN_PROGRESS for 2s [ 1365.828047] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock member-f7eb5b75-281d-41af-870c-257f422c5a89 taken with stack trace [, , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1365.828369] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f7eb5b75-281d-41af-870c-257f422c5a89" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1365.830576] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port a6292acf-b7a4-49a7-9f3e-ef43ce303163 with status ACTIVE [ 1365.830764] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1365.830884] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1365.830951] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1365.831174] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1365.831267] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1365.831439] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1365.831536] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1365.831595] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1365.831803] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1365.831877] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1365.832069] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1365.832166] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1365.832224] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1365.832362] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1365.832436] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1365.832516] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: a6292acf-b7a4-49a7-9f3e-ef43ce303163 is going to be updated. [ 1365.853996] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1365.854196] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1365.854245] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1365.854451] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1365.854593] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1365.854755] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-a6292acf-b7a4-49a7-9f3e-ef43ce303163" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1367.397670] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f7eb5b75-281d-41af-870c-257f422c5a89 in Status: SUCCESS [ 1367.398061] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f7eb5b75-281d-41af-870c-257f422c5a89" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1367.398061] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f7eb5b75-281d-41af-870c-257f422c5a89" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1367.398201] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f7eb5b75-281d-41af-870c-257f422c5a89" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1367.398389] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1367.398513] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1367.398578] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1367.398717] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1367.398797] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1367.398892] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f7eb5b75-281d-41af-870c-257f422c5a89',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1367.901079] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('f7eb5b75-281d-41af-870c-257f422c5a89',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1368.404166] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('f7eb5b75-281d-41af-870c-257f422c5a89',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1368.906091] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1368.906390] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1368.906390] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1368.906565] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1368.906638] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1368.906740] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f7eb5b75-281d-41af-870c-257f422c5a89 is going to be updated. [ 1368.935666] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1368.935961] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1368.935961] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1368.936103] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1368.936246] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1368.944859] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f7eb5b75-281d-41af-870c-257f422c5a89 in Status: IN_PROGRESS for 2s [ 1370.325317] env[65370]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1370.325742] env[65370]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=2 [ 1370.955850] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f7eb5b75-281d-41af-870c-257f422c5a89 in Status: SUCCESS [ 1370.956116] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f7eb5b75-281d-41af-870c-257f422c5a89" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1370.956308] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f7eb5b75-281d-41af-870c-257f422c5a89" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1370.956545] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f7eb5b75-281d-41af-870c-257f422c5a89" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1370.956767] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1370.956893] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1370.956956] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1370.957128] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1370.957209] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1370.957295] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f7eb5b75-281d-41af-870c-257f422c5a89" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1370.957385] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('f7eb5b75-281d-41af-870c-257f422c5a89',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1371.460322] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock member-f7eb5b75-281d-41af-870c-257f422c5a89 taken with stack trace [, , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1371.460762] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f7eb5b75-281d-41af-870c-257f422c5a89" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1371.460762] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f7eb5b75-281d-41af-870c-257f422c5a89" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1371.460762] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f7eb5b75-281d-41af-870c-257f422c5a89" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1371.460911] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1371.461120] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1371.461120] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1371.461316] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1371.461316] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1371.461440] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f7eb5b75-281d-41af-870c-257f422c5a89" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1371.461603] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock member-f7eb5b75-281d-41af-870c-257f422c5a89 taken with stack trace [, , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1371.461738] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f7eb5b75-281d-41af-870c-257f422c5a89" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1371.461821] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f7eb5b75-281d-41af-870c-257f422c5a89" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1371.461964] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f7eb5b75-281d-41af-870c-257f422c5a89" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1371.462118] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1371.462210] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1371.462264] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1371.462401] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1371.462469] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1371.462549] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f7eb5b75-281d-41af-870c-257f422c5a89" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1371.462635] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('f7eb5b75-281d-41af-870c-257f422c5a89',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1371.964885] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for f7eb5b75-281d-41af-870c-257f422c5a89: rpc.has_security_group_logging(os_id): False [ 1371.988117] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1371.988356] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1371.988356] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1371.988531] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1371.988622] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1371.988849] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1371.988952] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1371.989026] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1371.989186] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1371.989262] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1371.989449] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1371.989546] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1371.989607] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1371.989754] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1371.989834] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1371.990051] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1371.990150] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1371.990213] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1371.990358] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1371.990434] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1371.990519] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: f7eb5b75-281d-41af-870c-257f422c5a89 is going to be updated. [ 1372.062240] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1372.062482] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1372.062482] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1372.062635] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1372.062809] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1372.079122] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: f7eb5b75-281d-41af-870c-257f422c5a89 in Status: IN_PROGRESS for 2s [ 1374.095533] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: f7eb5b75-281d-41af-870c-257f422c5a89 in Status: SUCCESS [ 1374.095917] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-f7eb5b75-281d-41af-870c-257f422c5a89" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1375.125091] env[65370]: INFO networking_nsxv3.common.synchronization [req-3625e11e-f39b-406a-8dc9-b0432155a2b6 req-b8415b0e-1ead-449c-8b89-cb856bb5d4e9 tempest-ServersTestJSON-2095698355 tempest-ServersTestJSON-2095698355-project-member] Enqueued Resource ID: f7eb5b75-281d-41af-870c-257f422c5a89 with Priority: HIGHEST for action security_group_members [ 1375.125620] env[65370]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f7eb5b75-281d-41af-870c-257f422c5a89 with Priority: HIGHEST for action security_group_members [ 1375.125917] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock member-f7eb5b75-281d-41af-870c-257f422c5a89 taken with stack trace [, , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1375.126049] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f7eb5b75-281d-41af-870c-257f422c5a89" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1375.126115] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f7eb5b75-281d-41af-870c-257f422c5a89" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1375.126305] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f7eb5b75-281d-41af-870c-257f422c5a89" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1375.126454] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1375.126550] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1375.126609] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1375.126747] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1375.126831] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1375.126931] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f7eb5b75-281d-41af-870c-257f422c5a89',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1375.629648] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('f7eb5b75-281d-41af-870c-257f422c5a89',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1376.132184] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('f7eb5b75-281d-41af-870c-257f422c5a89',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1376.635266] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1376.635524] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1376.635524] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1376.635717] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1376.635811] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1376.635913] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f7eb5b75-281d-41af-870c-257f422c5a89 is going to be updated. [ 1376.665047] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1376.665047] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1376.665047] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1376.665047] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1376.665047] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1376.673365] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f7eb5b75-281d-41af-870c-257f422c5a89 in Status: IN_PROGRESS for 2s [ 1378.684331] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f7eb5b75-281d-41af-870c-257f422c5a89 in Status: SUCCESS [ 1378.684708] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f7eb5b75-281d-41af-870c-257f422c5a89" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1380.127347] env[65370]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1380.127724] env[65370]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1381.714559] env[65370]: INFO networking_nsxv3.common.synchronization [req-f11ab7a0-dd31-45cd-ba19-5883d219bbad req-ceda7462-1a88-46ea-85f1-ae07633ff1da tempest-ServersTestJSON-2095698355 tempest-ServersTestJSON-2095698355-project-member] Enqueued Resource ID: f7eb5b75-281d-41af-870c-257f422c5a89 with Priority: HIGHEST for action security_group_members [ 1381.715080] env[65370]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f7eb5b75-281d-41af-870c-257f422c5a89 with Priority: HIGHEST for action security_group_members [ 1381.715321] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock member-f7eb5b75-281d-41af-870c-257f422c5a89 taken with stack trace [, , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1381.715440] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f7eb5b75-281d-41af-870c-257f422c5a89" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1381.715506] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f7eb5b75-281d-41af-870c-257f422c5a89" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1381.715695] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f7eb5b75-281d-41af-870c-257f422c5a89" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1381.715847] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1381.715955] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1381.716016] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1381.716329] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1381.716329] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1381.716329] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f7eb5b75-281d-41af-870c-257f422c5a89',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1382.218438] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('f7eb5b75-281d-41af-870c-257f422c5a89',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1382.720956] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('f7eb5b75-281d-41af-870c-257f422c5a89',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1383.224067] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1383.224292] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1383.224292] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1383.224516] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1383.224606] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1383.224705] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f7eb5b75-281d-41af-870c-257f422c5a89 is going to be updated. [ 1383.253827] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1383.254151] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1383.254151] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1383.254336] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1383.254420] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1383.263868] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f7eb5b75-281d-41af-870c-257f422c5a89 in Status: IN_PROGRESS for 2s [ 1385.275257] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f7eb5b75-281d-41af-870c-257f422c5a89 in Status: SUCCESS [ 1385.275654] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f7eb5b75-281d-41af-870c-257f422c5a89" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1386.716808] env[65370]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1386.717235] env[65370]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1391.146331] env[65370]: INFO networking_nsxv3.common.synchronization [req-2d6ba343-59e8-4307-af7d-70b1540d7741 req-b2d61c83-aed6-44d3-8714-064fcfeacafe tempest-ServersTestJSON-2095698355 tempest-ServersTestJSON-2095698355-project-member] Enqueued Resource ID: f7eb5b75-281d-41af-870c-257f422c5a89 with Priority: HIGHEST for action security_group_members [ 1391.146331] env[65370]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f7eb5b75-281d-41af-870c-257f422c5a89 with Priority: HIGHEST for action security_group_members [ 1391.146331] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock member-f7eb5b75-281d-41af-870c-257f422c5a89 taken with stack trace [, , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1391.146664] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f7eb5b75-281d-41af-870c-257f422c5a89" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1391.146664] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f7eb5b75-281d-41af-870c-257f422c5a89" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1391.146664] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f7eb5b75-281d-41af-870c-257f422c5a89" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1391.146823] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1391.146916] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1391.146977] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1391.147181] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1391.147225] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1391.147294] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f7eb5b75-281d-41af-870c-257f422c5a89',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1391.427662] env[65370]: DEBUG networking_nsxv3.common.locking [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Lock network-353 taken with stack trace [, , , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1391.427909] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquiring lock "network-353" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1391.428086] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquired lock "network-353" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1391.428408] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquired external semaphore "network-353" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1391.428719] env[65370]: DEBUG networking_nsxv3.common.locking [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1391.428919] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquiring lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1391.429098] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquired lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1391.429375] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquired external semaphore "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1391.429554] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Releasing lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1391.429802] env[65370]: DEBUG dogpile.cache.region [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] No value present for key: 'zone-id' {{(pid=65370) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1391.429974] env[65370]: DEBUG dogpile.lock [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] NeedRegenerationException {{(pid=65370) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1391.430121] env[65370]: DEBUG dogpile.lock [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] no value, waiting for create lock {{(pid=65370) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1391.430267] env[65370]: DEBUG dogpile.lock [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] value creation lock acquired {{(pid=65370) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1391.430416] env[65370]: DEBUG dogpile.cache.region [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] No value present for key: 'zone-id' {{(pid=65370) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1391.430548] env[65370]: DEBUG dogpile.lock [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Calling creation function for not-yet-present value {{(pid=65370) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1391.430722] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1391.452960] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1391.453235] env[65370]: DEBUG dogpile.cache.region [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=65370) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1391.453787] env[65370]: DEBUG dogpile.lock [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Released creation lock {{(pid=65370) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1391.453787] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Releasing lock "network-353" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1391.453971] env[65370]: DEBUG networking_nsxv3.common.locking [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Lock port-8ffcdd50-c34b-43a7-a73a-b3049f51179d taken with stack trace [, , , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1391.454193] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquiring lock "port-8ffcdd50-c34b-43a7-a73a-b3049f51179d" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1391.454359] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquired lock "port-8ffcdd50-c34b-43a7-a73a-b3049f51179d" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1391.454685] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquired external semaphore "port-8ffcdd50-c34b-43a7-a73a-b3049f51179d" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1391.454836] env[65370]: DEBUG networking_nsxv3.api.rpc [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8ffcdd50-c34b-43a7-a73a-b3049f51179d',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1391.650425] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('f7eb5b75-281d-41af-870c-257f422c5a89',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1391.957121] env[65370]: DEBUG networking_nsxv3.common.locking [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1391.957357] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquiring lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1391.957412] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquired lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1391.957687] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquired external semaphore "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1391.957835] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Releasing lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1391.957992] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Segment Port 8ffcdd50-c34b-43a7-a73a-b3049f51179d not found, creating... [ 1391.958275] env[65370]: DEBUG networking_nsxv3.common.locking [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1391.958467] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquiring lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1391.958593] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquired lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1391.958809] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquired external semaphore "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1391.958944] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Releasing lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1391.959242] env[65370]: DEBUG networking_nsxv3.common.locking [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1391.959398] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquiring lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1391.959513] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquired lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1391.959714] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquired external semaphore "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1391.959855] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Releasing lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1391.959996] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Resource: SegmentPort with ID: 8ffcdd50-c34b-43a7-a73a-b3049f51179d is going to be created. [ 1391.979438] env[65370]: DEBUG networking_nsxv3.common.locking [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1391.979660] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquiring lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1391.979750] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquired lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1391.980049] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Acquired external semaphore "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1391.980279] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Releasing lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1391.980493] env[65370]: DEBUG oslo_concurrency.lockutils [None req-b6914dde-f7c4-4abc-9c18-96b7a0a16406 None None] Releasing lock "port-8ffcdd50-c34b-43a7-a73a-b3049f51179d" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1392.153426] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('f7eb5b75-281d-41af-870c-257f422c5a89',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1392.655691] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1392.655884] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1392.655936] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1392.656171] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1392.656267] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1392.656368] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f7eb5b75-281d-41af-870c-257f422c5a89 is going to be updated. [ 1392.666357] env[65370]: INFO networking_nsxv3.common.synchronization [req-2d6ba343-59e8-4307-af7d-70b1540d7741 req-e08f7dea-7158-4fe4-a921-01348ccd5aa3 service nova] Enqueued Resource ID: f7eb5b75-281d-41af-870c-257f422c5a89 with Priority: HIGHEST for action security_group_rules [ 1392.666528] env[65370]: INFO networking_nsxv3.common.synchronization [req-2d6ba343-59e8-4307-af7d-70b1540d7741 req-e08f7dea-7158-4fe4-a921-01348ccd5aa3 service nova] Enqueued Resource ID: f7eb5b75-281d-41af-870c-257f422c5a89 with Priority: HIGHEST for action security_group_members [ 1392.666652] env[65370]: INFO networking_nsxv3.common.synchronization [req-2d6ba343-59e8-4307-af7d-70b1540d7741 req-e08f7dea-7158-4fe4-a921-01348ccd5aa3 service nova] Enqueued Resource ID: 8ffcdd50-c34b-43a7-a73a-b3049f51179d with Priority: HIGHEST for action port [ 1392.666875] env[65370]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f7eb5b75-281d-41af-870c-257f422c5a89 with Priority: HIGHEST for action security_group_rules [ 1392.667014] env[65370]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f7eb5b75-281d-41af-870c-257f422c5a89 with Priority: HIGHEST for action security_group_members [ 1392.667145] env[65370]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8ffcdd50-c34b-43a7-a73a-b3049f51179d with Priority: HIGHEST for action port [ 1392.667707] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock rules-f7eb5b75-281d-41af-870c-257f422c5a89 taken with stack trace [, , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1392.667947] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-f7eb5b75-281d-41af-870c-257f422c5a89" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1392.668047] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-f7eb5b75-281d-41af-870c-257f422c5a89" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1392.668241] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-f7eb5b75-281d-41af-870c-257f422c5a89" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1392.668320] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('f7eb5b75-281d-41af-870c-257f422c5a89',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1392.670011] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock member-f7eb5b75-281d-41af-870c-257f422c5a89 taken with stack trace [, , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1392.670137] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f7eb5b75-281d-41af-870c-257f422c5a89" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1392.670990] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock port-8ffcdd50-c34b-43a7-a73a-b3049f51179d taken with stack trace [, , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1392.670990] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-8ffcdd50-c34b-43a7-a73a-b3049f51179d" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1392.670990] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-8ffcdd50-c34b-43a7-a73a-b3049f51179d" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1392.670990] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-8ffcdd50-c34b-43a7-a73a-b3049f51179d" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1392.670990] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8ffcdd50-c34b-43a7-a73a-b3049f51179d',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1392.689546] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1392.689761] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1392.689761] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1392.689982] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1392.690142] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1392.699561] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f7eb5b75-281d-41af-870c-257f422c5a89 in Status: IN_PROGRESS for 2s [ 1393.171135] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock member-f7eb5b75-281d-41af-870c-257f422c5a89 taken with stack trace [, , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1393.171557] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f7eb5b75-281d-41af-870c-257f422c5a89" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1393.172560] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 8ffcdd50-c34b-43a7-a73a-b3049f51179d with status ACTIVE [ 1393.172770] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1393.172907] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1393.173038] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1393.173322] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1393.173437] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1393.173581] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1393.173695] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1393.173800] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1393.173991] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1393.174112] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1393.174326] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1393.174429] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1393.174500] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1393.174651] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1393.174762] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1393.174853] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 8ffcdd50-c34b-43a7-a73a-b3049f51179d is going to be updated. [ 1393.195208] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1393.195411] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1393.195411] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1393.195604] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1393.195732] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1393.195889] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-8ffcdd50-c34b-43a7-a73a-b3049f51179d" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1394.712912] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f7eb5b75-281d-41af-870c-257f422c5a89 in Status: SUCCESS [ 1394.713329] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f7eb5b75-281d-41af-870c-257f422c5a89" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1394.713329] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f7eb5b75-281d-41af-870c-257f422c5a89" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1394.713459] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f7eb5b75-281d-41af-870c-257f422c5a89" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1394.713621] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1394.713805] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1394.713805] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1394.713884] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1394.713960] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1394.714069] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f7eb5b75-281d-41af-870c-257f422c5a89',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1395.216511] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('f7eb5b75-281d-41af-870c-257f422c5a89',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1395.719177] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('f7eb5b75-281d-41af-870c-257f422c5a89',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1396.221941] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1396.221941] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1396.221941] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1396.222315] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1396.222352] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1396.222457] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f7eb5b75-281d-41af-870c-257f422c5a89 is going to be updated. [ 1396.250350] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1396.250599] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1396.250599] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1396.250805] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1396.250872] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1396.258721] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f7eb5b75-281d-41af-870c-257f422c5a89 in Status: IN_PROGRESS for 2s [ 1397.667995] env[65370]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1397.668460] env[65370]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=2 [ 1398.270440] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f7eb5b75-281d-41af-870c-257f422c5a89 in Status: SUCCESS [ 1398.270651] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f7eb5b75-281d-41af-870c-257f422c5a89" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1398.270812] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f7eb5b75-281d-41af-870c-257f422c5a89" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1398.271045] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f7eb5b75-281d-41af-870c-257f422c5a89" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1398.271249] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1398.271386] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1398.271459] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1398.271615] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1398.271693] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1398.271773] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f7eb5b75-281d-41af-870c-257f422c5a89" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1398.271864] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('f7eb5b75-281d-41af-870c-257f422c5a89',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1398.773881] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock member-f7eb5b75-281d-41af-870c-257f422c5a89 taken with stack trace [, , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1398.774336] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f7eb5b75-281d-41af-870c-257f422c5a89" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1398.774336] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f7eb5b75-281d-41af-870c-257f422c5a89" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1398.774336] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f7eb5b75-281d-41af-870c-257f422c5a89" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1398.774458] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1398.774563] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1398.774675] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1398.774771] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1398.774857] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1398.774944] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f7eb5b75-281d-41af-870c-257f422c5a89" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1398.775118] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock member-f7eb5b75-281d-41af-870c-257f422c5a89 taken with stack trace [, , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1398.775216] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f7eb5b75-281d-41af-870c-257f422c5a89" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1398.775337] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f7eb5b75-281d-41af-870c-257f422c5a89" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1398.775484] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f7eb5b75-281d-41af-870c-257f422c5a89" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1398.775626] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1398.775716] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1398.775769] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1398.775908] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1398.775981] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1398.776081] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f7eb5b75-281d-41af-870c-257f422c5a89" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1398.776185] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('f7eb5b75-281d-41af-870c-257f422c5a89',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1399.278376] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for f7eb5b75-281d-41af-870c-257f422c5a89: rpc.has_security_group_logging(os_id): False [ 1399.304912] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1399.305222] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1399.305222] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1399.305343] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1399.305425] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1399.305643] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1399.305748] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1399.305814] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1399.305949] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1399.306039] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1399.306220] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1399.306317] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1399.306374] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1399.306504] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1399.306576] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1399.306749] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1399.306850] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1399.306912] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1399.307050] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1399.307129] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1399.307206] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: f7eb5b75-281d-41af-870c-257f422c5a89 is going to be updated. [ 1399.364033] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1399.364033] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1399.364033] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1399.364318] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1399.364380] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1399.381519] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: f7eb5b75-281d-41af-870c-257f422c5a89 in Status: IN_PROGRESS for 2s [ 1401.400438] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: f7eb5b75-281d-41af-870c-257f422c5a89 in Status: SUCCESS [ 1401.400856] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-f7eb5b75-281d-41af-870c-257f422c5a89" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1402.670093] env[65370]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1402.670625] env[65370]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1403.235569] env[65370]: INFO networking_nsxv3.common.synchronization [req-1c06ed0b-f237-460d-a8d2-cea55bf8e471 req-2b02eb52-8e1c-4272-bc25-9bdd2a34f5c3 tempest-ServersTestJSON-2095698355 tempest-ServersTestJSON-2095698355-project-member] Enqueued Resource ID: f7eb5b75-281d-41af-870c-257f422c5a89 with Priority: HIGHEST for action security_group_members [ 1403.236146] env[65370]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f7eb5b75-281d-41af-870c-257f422c5a89 with Priority: HIGHEST for action security_group_members [ 1403.236498] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock member-f7eb5b75-281d-41af-870c-257f422c5a89 taken with stack trace [, , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1403.236632] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f7eb5b75-281d-41af-870c-257f422c5a89" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1403.236793] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f7eb5b75-281d-41af-870c-257f422c5a89" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1403.237016] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f7eb5b75-281d-41af-870c-257f422c5a89" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1403.237226] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1403.237359] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1403.237448] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1403.240921] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1403.242270] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1403.242396] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f7eb5b75-281d-41af-870c-257f422c5a89',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1403.746241] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('f7eb5b75-281d-41af-870c-257f422c5a89',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1404.248184] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('f7eb5b75-281d-41af-870c-257f422c5a89',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1404.751335] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1404.751727] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1404.751727] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1404.751812] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1404.751864] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1404.751965] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f7eb5b75-281d-41af-870c-257f422c5a89 is going to be updated. [ 1404.782233] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1404.782441] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1404.782441] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1404.782641] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1404.782788] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1404.792319] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f7eb5b75-281d-41af-870c-257f422c5a89 in Status: IN_PROGRESS for 2s [ 1406.803090] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f7eb5b75-281d-41af-870c-257f422c5a89 in Status: SUCCESS [ 1406.803534] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f7eb5b75-281d-41af-870c-257f422c5a89" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1408.237872] env[65370]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1408.238287] env[65370]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1412.294589] env[65370]: INFO networking_nsxv3.common.synchronization [req-944d62f9-a169-4d77-bcfd-2ef36f31da60 req-41e81d9e-5a87-491f-b218-8b5a48dd059d tempest-ServersTestJSON-2095698355 tempest-ServersTestJSON-2095698355-project-member] Enqueued Resource ID: f7eb5b75-281d-41af-870c-257f422c5a89 with Priority: HIGHEST for action security_group_members [ 1412.295115] env[65370]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f7eb5b75-281d-41af-870c-257f422c5a89 with Priority: HIGHEST for action security_group_members [ 1412.295412] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock member-f7eb5b75-281d-41af-870c-257f422c5a89 taken with stack trace [, , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1412.295532] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f7eb5b75-281d-41af-870c-257f422c5a89" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1412.295596] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f7eb5b75-281d-41af-870c-257f422c5a89" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1412.295783] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f7eb5b75-281d-41af-870c-257f422c5a89" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1412.295933] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1412.297069] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1412.297175] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1412.297398] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1412.297464] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1412.297837] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f7eb5b75-281d-41af-870c-257f422c5a89',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1412.596551] env[65370]: DEBUG networking_nsxv3.common.locking [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Lock network-353 taken with stack trace [, , , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1412.596758] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquiring lock "network-353" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1412.596877] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquired lock "network-353" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1412.597158] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquired external semaphore "network-353" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1412.597411] env[65370]: DEBUG networking_nsxv3.common.locking [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1412.597563] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquiring lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1412.597673] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquired lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1412.597881] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquired external semaphore "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1412.598049] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Releasing lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1412.598328] env[65370]: DEBUG dogpile.cache.region [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] No value present for key: 'zone-id' {{(pid=65370) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1412.598448] env[65370]: DEBUG dogpile.lock [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] NeedRegenerationException {{(pid=65370) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1412.598554] env[65370]: DEBUG dogpile.lock [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] no value, waiting for create lock {{(pid=65370) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1412.598657] env[65370]: DEBUG dogpile.lock [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] value creation lock acquired {{(pid=65370) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1412.598762] env[65370]: DEBUG dogpile.cache.region [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] No value present for key: 'zone-id' {{(pid=65370) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1412.598862] env[65370]: DEBUG dogpile.lock [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Calling creation function for not-yet-present value {{(pid=65370) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1412.598987] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1412.619728] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1412.619918] env[65370]: DEBUG dogpile.cache.region [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=65370) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1412.620068] env[65370]: DEBUG dogpile.lock [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Released creation lock {{(pid=65370) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1412.620256] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Releasing lock "network-353" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1412.620648] env[65370]: DEBUG networking_nsxv3.common.locking [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Lock port-0af56685-48d2-481a-a790-eb289af83a31 taken with stack trace [, , , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1412.620835] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquiring lock "port-0af56685-48d2-481a-a790-eb289af83a31" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1412.621038] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquired lock "port-0af56685-48d2-481a-a790-eb289af83a31" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1412.621311] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquired external semaphore "port-0af56685-48d2-481a-a790-eb289af83a31" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1412.621445] env[65370]: DEBUG networking_nsxv3.api.rpc [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0af56685-48d2-481a-a790-eb289af83a31',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1412.799519] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('f7eb5b75-281d-41af-870c-257f422c5a89',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1413.123486] env[65370]: DEBUG networking_nsxv3.common.locking [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1413.123702] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquiring lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1413.123823] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquired lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1413.124105] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquired external semaphore "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1413.124250] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Releasing lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1413.124428] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Segment Port 0af56685-48d2-481a-a790-eb289af83a31 not found, creating... [ 1413.124729] env[65370]: DEBUG networking_nsxv3.common.locking [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1413.124888] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquiring lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1413.125010] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquired lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1413.125223] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquired external semaphore "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1413.125357] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Releasing lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1413.125622] env[65370]: DEBUG networking_nsxv3.common.locking [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1413.125770] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquiring lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1413.125882] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquired lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1413.126090] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquired external semaphore "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1413.126219] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Releasing lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1413.126353] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Resource: SegmentPort with ID: 0af56685-48d2-481a-a790-eb289af83a31 is going to be created. [ 1413.148817] env[65370]: DEBUG networking_nsxv3.common.locking [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1413.149211] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquiring lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1413.149436] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquired lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1413.149726] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Acquired external semaphore "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1413.149956] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Releasing lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1413.150261] env[65370]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3f-8a1d-46cb-9be3-2e6e026d9500 None None] Releasing lock "port-0af56685-48d2-481a-a790-eb289af83a31" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1413.301521] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('f7eb5b75-281d-41af-870c-257f422c5a89',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1413.803746] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1413.803948] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1413.803948] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1413.804186] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1413.804279] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1413.804376] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f7eb5b75-281d-41af-870c-257f422c5a89 is going to be updated. [ 1413.837171] env[65370]: INFO networking_nsxv3.common.synchronization [req-944d62f9-a169-4d77-bcfd-2ef36f31da60 req-7d7721c9-9e39-4713-8183-d65d19662781 service nova] Enqueued Resource ID: f7eb5b75-281d-41af-870c-257f422c5a89 with Priority: HIGHEST for action security_group_rules [ 1413.837311] env[65370]: INFO networking_nsxv3.common.synchronization [req-944d62f9-a169-4d77-bcfd-2ef36f31da60 req-7d7721c9-9e39-4713-8183-d65d19662781 service nova] Enqueued Resource ID: f7eb5b75-281d-41af-870c-257f422c5a89 with Priority: HIGHEST for action security_group_members [ 1413.837448] env[65370]: INFO networking_nsxv3.common.synchronization [req-944d62f9-a169-4d77-bcfd-2ef36f31da60 req-7d7721c9-9e39-4713-8183-d65d19662781 service nova] Enqueued Resource ID: 0af56685-48d2-481a-a790-eb289af83a31 with Priority: HIGHEST for action port [ 1413.838492] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1413.838617] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1413.838689] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1413.838942] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1413.839049] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1413.840383] env[65370]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f7eb5b75-281d-41af-870c-257f422c5a89 with Priority: HIGHEST for action security_group_rules [ 1413.840523] env[65370]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f7eb5b75-281d-41af-870c-257f422c5a89 with Priority: HIGHEST for action security_group_members [ 1413.840622] env[65370]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0af56685-48d2-481a-a790-eb289af83a31 with Priority: HIGHEST for action port [ 1413.840888] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock rules-f7eb5b75-281d-41af-870c-257f422c5a89 taken with stack trace [, , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1413.841011] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-f7eb5b75-281d-41af-870c-257f422c5a89" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1413.841079] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-f7eb5b75-281d-41af-870c-257f422c5a89" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1413.841246] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-f7eb5b75-281d-41af-870c-257f422c5a89" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1413.841327] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('f7eb5b75-281d-41af-870c-257f422c5a89',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1413.842209] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock member-f7eb5b75-281d-41af-870c-257f422c5a89 taken with stack trace [, , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1413.842282] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f7eb5b75-281d-41af-870c-257f422c5a89" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1413.842481] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock port-0af56685-48d2-481a-a790-eb289af83a31 taken with stack trace [, , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1413.842578] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-0af56685-48d2-481a-a790-eb289af83a31" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1413.842641] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-0af56685-48d2-481a-a790-eb289af83a31" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1413.842792] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-0af56685-48d2-481a-a790-eb289af83a31" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1413.842870] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0af56685-48d2-481a-a790-eb289af83a31',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1413.852165] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f7eb5b75-281d-41af-870c-257f422c5a89 in Status: IN_PROGRESS for 2s [ 1414.344997] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock member-f7eb5b75-281d-41af-870c-257f422c5a89 taken with stack trace [, , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1414.345322] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f7eb5b75-281d-41af-870c-257f422c5a89" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1414.345370] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 0af56685-48d2-481a-a790-eb289af83a31 with status ACTIVE [ 1414.345535] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1414.345647] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1414.345714] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1414.345949] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1414.346050] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1414.346223] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1414.346323] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1414.346385] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1414.346544] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1414.346618] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1414.346793] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1414.346886] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1414.346947] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1414.347100] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1414.347176] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1414.347262] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 0af56685-48d2-481a-a790-eb289af83a31 is going to be updated. [ 1414.367438] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1414.367666] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1414.367666] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1414.367841] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1414.367973] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1414.368144] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-0af56685-48d2-481a-a790-eb289af83a31" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1415.864281] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f7eb5b75-281d-41af-870c-257f422c5a89 in Status: SUCCESS [ 1415.864792] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f7eb5b75-281d-41af-870c-257f422c5a89" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1415.865105] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f7eb5b75-281d-41af-870c-257f422c5a89" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1415.865494] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f7eb5b75-281d-41af-870c-257f422c5a89" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1415.865852] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1415.866079] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1415.866192] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1415.866462] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1415.866601] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1415.866774] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f7eb5b75-281d-41af-870c-257f422c5a89',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1416.369037] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('f7eb5b75-281d-41af-870c-257f422c5a89',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1416.871813] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('f7eb5b75-281d-41af-870c-257f422c5a89',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1417.374715] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1417.374987] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1417.374987] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1417.375183] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1417.375274] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1417.375373] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f7eb5b75-281d-41af-870c-257f422c5a89 is going to be updated. [ 1417.401685] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1417.401885] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1417.401885] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1417.402090] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1417.402261] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1417.410975] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f7eb5b75-281d-41af-870c-257f422c5a89 in Status: IN_PROGRESS for 2s [ 1418.841496] env[65370]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1418.841496] env[65370]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=2 [ 1419.421475] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f7eb5b75-281d-41af-870c-257f422c5a89 in Status: SUCCESS [ 1419.421741] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f7eb5b75-281d-41af-870c-257f422c5a89" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1419.421862] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f7eb5b75-281d-41af-870c-257f422c5a89" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1419.422121] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f7eb5b75-281d-41af-870c-257f422c5a89" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1419.422309] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1419.422425] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1419.422502] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1419.422643] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1419.422712] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1419.422799] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f7eb5b75-281d-41af-870c-257f422c5a89" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1419.422887] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('f7eb5b75-281d-41af-870c-257f422c5a89',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1419.924988] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock member-f7eb5b75-281d-41af-870c-257f422c5a89 taken with stack trace [, , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1419.925480] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f7eb5b75-281d-41af-870c-257f422c5a89" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1419.925480] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f7eb5b75-281d-41af-870c-257f422c5a89" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1419.925480] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f7eb5b75-281d-41af-870c-257f422c5a89" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1419.925735] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1419.925735] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1419.925917] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1419.925980] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1419.926077] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1419.926133] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f7eb5b75-281d-41af-870c-257f422c5a89" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1419.926248] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock member-f7eb5b75-281d-41af-870c-257f422c5a89 taken with stack trace [, , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1419.926355] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f7eb5b75-281d-41af-870c-257f422c5a89" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1419.926427] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f7eb5b75-281d-41af-870c-257f422c5a89" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1419.926541] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f7eb5b75-281d-41af-870c-257f422c5a89" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1419.926680] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1419.926760] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1419.926836] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1419.926954] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1419.927034] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1419.927104] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f7eb5b75-281d-41af-870c-257f422c5a89" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1419.927195] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('f7eb5b75-281d-41af-870c-257f422c5a89',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1420.429430] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for f7eb5b75-281d-41af-870c-257f422c5a89: rpc.has_security_group_logging(os_id): False [ 1420.446558] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1420.446756] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1420.446756] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1420.446971] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1420.447072] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1420.447300] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1420.447400] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1420.447462] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1420.447607] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1420.447679] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1420.447853] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1420.447946] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1420.448012] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1420.448156] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1420.448228] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1420.448404] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1420.448495] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1420.448554] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1420.448685] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1420.448757] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1420.448837] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: f7eb5b75-281d-41af-870c-257f422c5a89 is going to be updated. [ 1420.507389] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1420.507638] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1420.507638] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1420.507806] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1420.507951] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1420.525571] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: f7eb5b75-281d-41af-870c-257f422c5a89 in Status: IN_PROGRESS for 2s [ 1422.543128] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: f7eb5b75-281d-41af-870c-257f422c5a89 in Status: SUCCESS [ 1422.543541] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-f7eb5b75-281d-41af-870c-257f422c5a89" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1423.842799] env[65370]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1423.842799] env[65370]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1426.129175] env[65370]: INFO networking_nsxv3.common.synchronization [req-840e2c2e-d3f1-4bbe-bd4c-0b0b2101b2b3 req-8dc87f28-452f-4e5e-bcc1-6a1678d59156 tempest-ServersTestJSON-2095698355 tempest-ServersTestJSON-2095698355-project-member] Enqueued Resource ID: f7eb5b75-281d-41af-870c-257f422c5a89 with Priority: HIGHEST for action security_group_members [ 1426.129700] env[65370]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f7eb5b75-281d-41af-870c-257f422c5a89 with Priority: HIGHEST for action security_group_members [ 1426.130029] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock member-f7eb5b75-281d-41af-870c-257f422c5a89 taken with stack trace [, , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1426.130203] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f7eb5b75-281d-41af-870c-257f422c5a89" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1426.130203] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f7eb5b75-281d-41af-870c-257f422c5a89" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1426.130434] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f7eb5b75-281d-41af-870c-257f422c5a89" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1426.130596] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1426.130698] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1426.130762] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1426.130907] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1426.130989] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1426.131093] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f7eb5b75-281d-41af-870c-257f422c5a89',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1426.633149] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('f7eb5b75-281d-41af-870c-257f422c5a89',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1427.135368] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('f7eb5b75-281d-41af-870c-257f422c5a89',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1427.637772] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1427.638050] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1427.638108] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1427.638321] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1427.638417] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1427.638517] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f7eb5b75-281d-41af-870c-257f422c5a89 is going to be updated. [ 1427.669826] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1427.670021] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1427.670079] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1427.670242] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1427.670389] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1427.678854] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f7eb5b75-281d-41af-870c-257f422c5a89 in Status: IN_PROGRESS for 2s [ 1429.690446] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f7eb5b75-281d-41af-870c-257f422c5a89 in Status: SUCCESS [ 1429.690446] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f7eb5b75-281d-41af-870c-257f422c5a89" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1431.131059] env[65370]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1431.131059] env[65370]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1432.326907] env[65370]: INFO networking_nsxv3.common.synchronization [req-e50a5c8e-888b-4ff0-80fe-449396a3b932 req-0d60a8e5-935b-4aea-b6c9-b3456b833362 tempest-ServersTestJSON-2095698355 tempest-ServersTestJSON-2095698355-project-member] Enqueued Resource ID: f7eb5b75-281d-41af-870c-257f422c5a89 with Priority: HIGHEST for action security_group_members [ 1432.327516] env[65370]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f7eb5b75-281d-41af-870c-257f422c5a89 with Priority: HIGHEST for action security_group_members [ 1432.328120] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock member-f7eb5b75-281d-41af-870c-257f422c5a89 taken with stack trace [, , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1432.328429] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f7eb5b75-281d-41af-870c-257f422c5a89" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1432.328429] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f7eb5b75-281d-41af-870c-257f422c5a89" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1432.328550] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f7eb5b75-281d-41af-870c-257f422c5a89" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1432.328710] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1432.328858] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1432.328906] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1432.329033] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1432.329119] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1432.329211] env[65370]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f7eb5b75-281d-41af-870c-257f422c5a89',) {} {{(pid=65370) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1432.831391] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1432.831632] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1432.831632] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1432.831869] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1432.831961] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1432.832171] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1432.832311] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1432.832430] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1432.832596] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1432.832684] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1432.832770] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f7eb5b75-281d-41af-870c-257f422c5a89 is going to be updated. [ 1432.862528] env[65370]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65370) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1432.862695] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1432.862776] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1432.863013] env[65370]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1432.863174] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1432.873841] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f7eb5b75-281d-41af-870c-257f422c5a89 in Status: IN_PROGRESS for 2s [ 1434.884637] env[65370]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f7eb5b75-281d-41af-870c-257f422c5a89 in Status: SUCCESS [ 1434.885063] env[65370]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f7eb5b75-281d-41af-870c-257f422c5a89 deletion is rescheduled due to dependency. [ 1434.885063] env[65370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f7eb5b75-281d-41af-870c-257f422c5a89" {{(pid=65370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1437.328205] env[65370]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1437.328772] env[65370]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1442.329097] env[65370]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1442.329537] env[65370]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1447.330520] env[65370]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1447.330520] env[65370]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1452.331879] env[65370]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1452.332311] env[65370]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1457.332442] env[65370]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1457.332889] env[65370]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1462.333494] env[65370]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1462.333494] env[65370]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0